Solved

Which tool is the best for command line differential copies on Windows Server 2012

Posted on 2014-09-04
5
690 Views
Last Modified: 2014-09-15
I am currently on a project to transfer over our file shares on a Windows server to a new third party storage array.  We want to mirror all files and ACL information to the new storage array.  The shares we're trying to migrate are as low as 20 GB and at max 20 TB.  We have tried to copy over the files using Robocopy with the following switches:  

/mir /XO /ETA /MT:64 /zb  /r:1 /w:1

Unfortunately even though this copies over the files that have been modified, the ACLs have not copied over correctly.  We tried to then use the /SEC /SECFIX switches and would get the ACLs of the files, but it would "Modify" every file even if the destination and source ACL match.

We also tried EMCopy and that seemed to be perfect, but found a big flaw.  If EMCopy is unable to access a source file, then it will delete it on the same file on the destination side immediately.  This does not help if we're trying to do differentials.  

Now finally the question.  I would like to know what is the best command line tool for Windows that will allow me to do the following:

Allows mirroring of the source files and ACL info to the destination side, and only copy the changes
Fast; we cannot have this running for more than 12 hours at a time
Command line so that we are able to schedule the job in off hours
0
Comment
Question by:nvr8981
  • 3
  • 2
5 Comments
 
LVL 13

Expert Comment

by:lciprianionut
ID: 40304674
Did you tried to use switch /COPYALL or /SEC on Robocopy.exe?
0
 

Author Comment

by:nvr8981
ID: 40304681
Yes.  Even though it copies the data and the file attributes over on the initial run, it will modify every file every time it's run.  Meaning, even if some files have not been changed in any way from the source, it will still be copied over once more to the destination.  I'm looking for a tool that can compare the files and copy over the files that are different only.  It should be able to compare the data/time modified, the ACL structure on both files, and the size of the files.

Has anyone ever worked with RichCopy?  Does it have these features?
0
 
LVL 13

Expert Comment

by:lciprianionut
ID: 40304703
You can try also TeraCopy and ultracopier.
0
 

Accepted Solution

by:
nvr8981 earned 0 total points
ID: 40315270
Seems that the best copy utility so far for file migration is EMCopy.  Transferring differentials for a 9.1 TB share with Robocopy takes around 22 hours, if you're using the /SEC /SECFIX switches.  EMCopy transfers the diffs in a little less than 3 hours for our share, including the ACL differences between the files.

Yes, it still deletes the files from the destination side if locked from the source,  However we have a window of 12 hours during our migration that all of the files will be free, and the remaining files that were missed can be copied over.
0
 

Author Closing Comment

by:nvr8981
ID: 40322673
Only solution that I found that allowed me to script out the copy jobs for scheduling, and transferring differential data better than robocopy.
0

Featured Post

Backup Your Microsoft Windows Server®

Backup all your Microsoft Windows Server – on-premises, in remote locations, in private and hybrid clouds. Your entire Windows Server will be backed up in one easy step with patented, block-level disk imaging. We achieve RTOs (recovery time objectives) as low as 15 seconds.

Join & Write a Comment

This article is an update and follow-up of my previous article:   Storage 101: common concepts in the IT enterprise storage This time, I expand on more frequently used storage concepts.
Sometimes drives fill up and we don't know why.  If you don't understand the best way to use the tools available, you may end up being stumped as to why your drive says it's not full when you have no space left!  Here's how you can find out...
This tutorial will walk an individual through the process of transferring the five major, necessary Active Directory Roles, commonly referred to as the FSMO roles from a Windows Server 2008 domain controller to a Windows Server 2012 domain controlle…
This tutorial will walk an individual through the process of installing the necessary services and then configuring a Windows Server 2012 system as an iSCSI target. To install the necessary roles, go to Server Manager, and select Add Roles and Featu…

707 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

16 Experts available now in Live!

Get 1:1 Help Now