xxcopy freezes when copying 3 million files

Hi,

 I am copying 3 million files from one USB external hard drive to another USB external had drive. I had xxcopy run overnight on my machine, and this morning the computer was frozen (black screen, but  the mouse icon is still movable).  I had to reboot the computer to bring it live again.

The command I use is: xxcopy d:\folder\    e:\folder\    /CLONE

It looks like xxcopy stopped at about half million files copied.  My computer is Windows XP pro, with 2GB memeroy. There are still enough free space on hard drives. CHKDSK does not find any issue.

 I suspect it is because xxcopy consumes too much system resources. Is there a workaround? I am not experienced at xxcopy at all.

So far I have tried XXCOPY, Robocopy, SyncBackSE, and Acronis TrueImage to copy these files.  They all stop at some point, and could not finish the whole task. I could not tell what caused the problem. In Windows Explore, the files look fine.


Thank you for your advice!

Gordon
gaog66Asked:
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

x
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

purplepomegraniteCommented:
Have you tried xcopy too (built into XP)?  The below code is the equivalent command with xcopy.

If it is hanging with different tools though, there may be one file in particular causing the problem.

Try piping the output of the copy command so that a log is created - you can then see how far the routine got if it does crash again.  To do this in xcopy, I have shown the command needed below.
xcopy "d:\folder\" "e:\folder\" /E /C /H /Z
 
# To save output to a log file
xcopy "d:\folder\" "e:\folder\" /E /C /H /Z > c:\copy.log

Open in new window

gaog66Author Commented:
Thanks. I have not tried xcopy, however I hear that xcopy is limited to 255 character path length. My folder names and file names are pretty long.


I guess I can use the above command in xxcopy as well?

Thanks,

Gordon
purplepomegraniteCommented:
The pipe command (i.e. the > c:\copy.log bit) should work with any command prompt program that normally outputs to the command window (stdout) - so that may well work with xxcopy.  And you are right that xcopy is limited in path length, so if your folders go over the limit it will fail.

One thing I notice is that you are copying from USB to USB.  I have had funny issues when trying to do large copies this way before too (including machine hanging, similar to your problem).  My workaround was to copy from one USB drive to the hard-disk, then from the hard-disk back to the other USB drive.

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Gary CaseRetiredCommented:
The same command will work with XXCopy, but you don't need the /C switch (XXCopy turns this on by default, unlike XCopy).

The total pathlength restriction is the same with both XCopy and XXCopy -- but I doubt that's the issue here, as you should get an error message if that was the case (in addition, XXCopy won't stop copying on an error with /Clone => it will simply list the errors at the end of the copy operation).

You should be able to simply run the "xxcopy d:\folder\    e:\folder\    /CLONE" command repeatedly until it completes the task -- not sure why it doesn't finish it in one pass, but there may indeed be some resource issue here.


It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Windows XP

From novice to tech pro — start learning today.