Solved

Which tool is the best for command line differential copies on Windows Server 2012

Posted on 2014-09-04
5
730 Views
Last Modified: 2014-09-15
I am currently on a project to transfer over our file shares on a Windows server to a new third party storage array.  We want to mirror all files and ACL information to the new storage array.  The shares we're trying to migrate are as low as 20 GB and at max 20 TB.  We have tried to copy over the files using Robocopy with the following switches:  

/mir /XO /ETA /MT:64 /zb  /r:1 /w:1

Unfortunately even though this copies over the files that have been modified, the ACLs have not copied over correctly.  We tried to then use the /SEC /SECFIX switches and would get the ACLs of the files, but it would "Modify" every file even if the destination and source ACL match.

We also tried EMCopy and that seemed to be perfect, but found a big flaw.  If EMCopy is unable to access a source file, then it will delete it on the same file on the destination side immediately.  This does not help if we're trying to do differentials.  

Now finally the question.  I would like to know what is the best command line tool for Windows that will allow me to do the following:

Allows mirroring of the source files and ACL info to the destination side, and only copy the changes
Fast; we cannot have this running for more than 12 hours at a time
Command line so that we are able to schedule the job in off hours
0
Comment
Question by:nvr8981
  • 3
  • 2
5 Comments
 
LVL 13

Expert Comment

by:lciprianionut
ID: 40304674
Did you tried to use switch /COPYALL or /SEC on Robocopy.exe?
0
 

Author Comment

by:nvr8981
ID: 40304681
Yes.  Even though it copies the data and the file attributes over on the initial run, it will modify every file every time it's run.  Meaning, even if some files have not been changed in any way from the source, it will still be copied over once more to the destination.  I'm looking for a tool that can compare the files and copy over the files that are different only.  It should be able to compare the data/time modified, the ACL structure on both files, and the size of the files.

Has anyone ever worked with RichCopy?  Does it have these features?
0
 
LVL 13

Expert Comment

by:lciprianionut
ID: 40304703
You can try also TeraCopy and ultracopier.
0
 

Accepted Solution

by:
nvr8981 earned 0 total points
ID: 40315270
Seems that the best copy utility so far for file migration is EMCopy.  Transferring differentials for a 9.1 TB share with Robocopy takes around 22 hours, if you're using the /SEC /SECFIX switches.  EMCopy transfers the diffs in a little less than 3 hours for our share, including the ACL differences between the files.

Yes, it still deletes the files from the destination side if locked from the source,  However we have a window of 12 hours during our migration that all of the files will be free, and the remaining files that were missed can be copied over.
0
 

Author Closing Comment

by:nvr8981
ID: 40322673
Only solution that I found that allowed me to script out the copy jobs for scheduling, and transferring differential data better than robocopy.
0

Featured Post

Industry Leaders: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

You might have come across a situation when you have Exchange 2013 server in two different sites (Production and DR). After adding the Database copy in ECP console it displays Database copy status unknown for the DR exchange server. Issue is strange…
Each year, investment in cloud platforms grows more than 20% (https://www.immun.io/hubfs/Immunio_2016/Content/Marketing/Cloud-Security-Report-2016.pdf?submissionGuid=a8d80a00-6fee-4b85-81db-a4e28f681762) as an increasing number of companies begin to…
This video teaches viewers how to encrypt an external drive that requires a password to read and edit the drive. All tasks are done in Disk Utility. Plug in the external drive you wish to encrypt: Make sure all previous data on the drive has been …
This tutorial will walk an individual through the process of configuring basic necessities in order to use the 2010 version of Data Protection Manager. These include storage, agents, and protection jobs. Launch Data Protection Manager from the deskt…

679 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question