Andrew_Bella
asked on
What is the best way to copy ~2 million files on Windows 2003?
I've recently purchased a duplicate NAS for the sole purpose of mirroring the current one (for redundancy's sake). They each have a 10TB capacity (they are Netgear ReadyNAS Pros). The one with all the files on it has 1.8 million files in 64,357 folders taking up 6.42TB of space. I have tried over the previous two weeks to copy the files over to the new NAS with little success.
First tool i tried was SecondCopy, this crashed a few minutes into the copy, with no error. Second tool was TeraCopy, this too would just fail about 2-3% into the transfer, no error given (just stopped transferring). Third tool i tried was the built in rysnc tool on the readynas, it too failed, with a completely non descriptive error in the log. After that, the fourth tool I've tried is DSynchronize, which seems to work, except about 2 hours into a transfer it starts reporting that files are locked on the source drive, and it too stops in the middle of the job.
Is there a tool that is designed for copying so many files on Windows? I've even tried moving one folder (at the top level) at a time, but even that seems to fail.
First tool i tried was SecondCopy, this crashed a few minutes into the copy, with no error. Second tool was TeraCopy, this too would just fail about 2-3% into the transfer, no error given (just stopped transferring). Third tool i tried was the built in rysnc tool on the readynas, it too failed, with a completely non descriptive error in the log. After that, the fourth tool I've tried is DSynchronize, which seems to work, except about 2 hours into a transfer it starts reporting that files are locked on the source drive, and it too stops in the middle of the job.
Is there a tool that is designed for copying so many files on Windows? I've even tried moving one folder (at the top level) at a time, but even that seems to fail.
use an offline clone hadrive software to copy the files
ASKER
The volume spans across 6 HDs as a RAID array and taking it down would probably not work out for the users (and it would take too long to do it after hours).
Does synctoy use a different method than Windows copy (forgot to mention i gave that a shot too)?
Does synctoy use a different method than Windows copy (forgot to mention i gave that a shot too)?
Curious... any reason you have used Robocopy or XCOPY?
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
What about Rsync ?
It's an opensource remote sync server tool that can sync the master NAS to the Mirror on the fly.
http://en.wikipedia.org/wiki/Rsync
http://www.samba.org/rsync/
For setting up in windows
http://www.gaztronics.net/rsync.php
Cheers
/Daniel
It's an opensource remote sync server tool that can sync the master NAS to the Mirror on the fly.
http://en.wikipedia.org/wiki/Rsync
http://www.samba.org/rsync/
For setting up in windows
http://www.gaztronics.net/rsync.php
Cheers
/Daniel
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
I'm not out of the woods yet (it'll take many days for the copy to complete) but RichCopy has been performing great so far (48 hours into the copy now)!
If that fails, I'm going to need to go the route of a tape backup application.
Thanks everyone!
If that fails, I'm going to need to go the route of a tape backup application.
Thanks everyone!