Best solution to sync HUGE QTY of files across slow WAN?
Hello creative experts!
I have 1.7 million files (4 TB) in one of our remote offices.
We presently use Vice-Versa to replicate the remote office data to headquarters.
Vice-versa is installed on a server here in HQ.
The initial "comparing source vs. destination" part of the run takes 21 hours over our 50 mbps wan connection.
The actual file copy of changed files typically takes about 3 hours.
I'm guessing it's soooo slow because it's having a chatty conversation across a slow WAN connection to determine which files got added and deleted. [This is a total guess as I don't know how the software is written]
What's the best solution?
Is there a solution that perhaps has agent software running on the other side such that each side determines local changes and THEN compares notes?
Is there a solution that works something like OneDrive? (For example: there's no day long process evaluating local vs cloud before figuring out what to sync. I presume if you delete a local folder, the agent gives the path of what to delete to the cloud and it's deleted. Likewise, if a file gets added locally, just that file gets uploaded).
As I type this: I wonder if there's a microsoft solution which could leverage our E3 Office 365 subscription for our 400 users?
We started getting quotes for cloud backup and it was surprisingly expensive: maybe $90,000 per year for 8TB - that's super approximate but gives me an order of magnitude.