Solved

Which tool is the best for command line differential copies on Windows Server 2012

Posted on 2014-09-04
5
702 Views
Last Modified: 2014-09-15
I am currently on a project to transfer over our file shares on a Windows server to a new third party storage array.  We want to mirror all files and ACL information to the new storage array.  The shares we're trying to migrate are as low as 20 GB and at max 20 TB.  We have tried to copy over the files using Robocopy with the following switches:  

/mir /XO /ETA /MT:64 /zb  /r:1 /w:1

Unfortunately even though this copies over the files that have been modified, the ACLs have not copied over correctly.  We tried to then use the /SEC /SECFIX switches and would get the ACLs of the files, but it would "Modify" every file even if the destination and source ACL match.

We also tried EMCopy and that seemed to be perfect, but found a big flaw.  If EMCopy is unable to access a source file, then it will delete it on the same file on the destination side immediately.  This does not help if we're trying to do differentials.  

Now finally the question.  I would like to know what is the best command line tool for Windows that will allow me to do the following:

Allows mirroring of the source files and ACL info to the destination side, and only copy the changes
Fast; we cannot have this running for more than 12 hours at a time
Command line so that we are able to schedule the job in off hours
0
Comment
Question by:nvr8981
  • 3
  • 2
5 Comments
 
LVL 13

Expert Comment

by:lciprianionut
ID: 40304674
Did you tried to use switch /COPYALL or /SEC on Robocopy.exe?
0
 

Author Comment

by:nvr8981
ID: 40304681
Yes.  Even though it copies the data and the file attributes over on the initial run, it will modify every file every time it's run.  Meaning, even if some files have not been changed in any way from the source, it will still be copied over once more to the destination.  I'm looking for a tool that can compare the files and copy over the files that are different only.  It should be able to compare the data/time modified, the ACL structure on both files, and the size of the files.

Has anyone ever worked with RichCopy?  Does it have these features?
0
 
LVL 13

Expert Comment

by:lciprianionut
ID: 40304703
You can try also TeraCopy and ultracopier.
0
 

Accepted Solution

by:
nvr8981 earned 0 total points
ID: 40315270
Seems that the best copy utility so far for file migration is EMCopy.  Transferring differentials for a 9.1 TB share with Robocopy takes around 22 hours, if you're using the /SEC /SECFIX switches.  EMCopy transfers the diffs in a little less than 3 hours for our share, including the ACL differences between the files.

Yes, it still deletes the files from the destination side if locked from the source,  However we have a window of 12 hours during our migration that all of the files will be free, and the remaining files that were missed can be copied over.
0
 

Author Closing Comment

by:nvr8981
ID: 40322673
Only solution that I found that allowed me to script out the copy jobs for scheduling, and transferring differential data better than robocopy.
0

Featured Post

Does Powershell have you tied up in knots?

Managing Active Directory does not always have to be complicated.  If you are spending more time trying instead of doing, then it's time to look at something else. For nearly 20 years, AD admins around the world have used one tool for day-to-day AD management: Hyena. Discover why

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

I previously wrote an article addressing the use of UBCD4WIN and SARDU. All are great, but I have always been an advocate of SARDU. Recently it was suggested that I go back and take a look at Easy2Boot in comparison.
What to do when Windows Update is not working correctly? What tools can I use to detect the cause of the malfunction problem? What does this numeric error code mean? These and other questions that you have been asking in the past are answered here (…
This tutorial will walk an individual through the process of configuring their Windows Server 2012 domain controller to synchronize its time with a trusted, external resource. Use Google, Bing, or other preferred search engine to locate trusted NTP …
This tutorial will walk an individual through the process of installing of Data Protection Manager on a server running Windows Server 2012 R2, including the prerequisites. Microsoft .Net 3.5 is required. To install this feature, go to Server Manager…

929 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

13 Experts available now in Live!

Get 1:1 Help Now