Synchronize large number of files and folders between two networked computers

What is the most reliable way (as of Sept. 2013) to synchronize two windows folders?  One of the folders is local and the other is a networked drive on another machine.  Whenever a file is added to any folder of the source computer, I want a backup version of that file to be copied to the destination computer.  The folder structure needs to be maintained, and there is a fairly large number of files and folders.  There are perhaps 300k files, and hundreds of folders.

Given the large number of files and folders, I suspect that it will not be possible for the file sync process to happen in realtime, but it would be nice if it could.  

Any ideas?  Thank you.
DanielAttardAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Chris WongCommented:
How-to use Robocopy to synchronize files between two systems

http://burpee.smccme.edu/studenthowtos/robocopy.htm
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
DanielAttardAuthor Commented:
Great suggestion.  Robocopy looks like just what I was looking for.
0
Joe Winograd, Fellow&MVEDeveloperCommented:
Hi Daniel,
I've been using SyncBack from 2BrightSparks for many years to do exactly what you're looking for:
http://www.2brightsparks.com/

I started with their SE version and then moved to their Pro version. They also have a Free version. Here's a comparison table for all three versions:
http://www.2brightsparks.com/syncback/compare.html

I think they all can do what you want, even the Free one, but you'll need to check for sure, as I've never used the Free version. In terms of your volume, I'm sure that won't be a problem. I use it primarily to backup (or mirror or synchronize) my "J" drive, which is my data drive...it houses all of my data. I just checked and it contains around 350,000 files in more than 25,000 folders totalling more than 200 GB.

I run many SyncBack profiles to backup/mirror/synchronize files...between computers across the network, and between computers and network attached storage. I run the profiles periodically (it utilizes the Windows Task Scheduler to them), which comes close to being in real-time, because there are so many profiles. But there's also a true real-time option (I don't use it) which runs a profile when any files or folders are changed, as shown in this screenshot of configuring a profile:
run profile when changesAnother great feature is that it allows you to specify the number of versions of a file to keep, which has saved me many times. The Free version may meet your needs, but even the SE and Pro versions are reasonably priced. This is extraordinarily good software...I would not be without it! Regards, Joe
0
Joe Winograd, Fellow&MVEDeveloperCommented:
Hi Daniel,
Sorry for the late post above. I had a browser tab open with your question and it took me so long to write the post that when I clicked the Submit button, I then saw that you had already accepted an answer. In any case, Robocopy is a good tool, and here's a nice TechNet write-up on it:
http://technet.microsoft.com/en-us/magazine/2006.11.utilityspotlight.aspx

However, you may want to look at a newer tool, RichCopy, which has improvements over Robocopy. Here's another nice TechNet article about it:
http://technet.microsoft.com/en-us/magazine/2009.04.utilityspotlight.aspx

But neither provides the level of capability that SyncBack does, imo. Regards, Joe
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Windows Server 2008

From novice to tech pro — start learning today.