Solved

Which tool is the best for command line differential copies on Windows Server 2012

Posted on 2014-09-04
5
742 Views
Last Modified: 2014-09-15
I am currently on a project to transfer over our file shares on a Windows server to a new third party storage array.  We want to mirror all files and ACL information to the new storage array.  The shares we're trying to migrate are as low as 20 GB and at max 20 TB.  We have tried to copy over the files using Robocopy with the following switches:  

/mir /XO /ETA /MT:64 /zb  /r:1 /w:1

Unfortunately even though this copies over the files that have been modified, the ACLs have not copied over correctly.  We tried to then use the /SEC /SECFIX switches and would get the ACLs of the files, but it would "Modify" every file even if the destination and source ACL match.

We also tried EMCopy and that seemed to be perfect, but found a big flaw.  If EMCopy is unable to access a source file, then it will delete it on the same file on the destination side immediately.  This does not help if we're trying to do differentials.  

Now finally the question.  I would like to know what is the best command line tool for Windows that will allow me to do the following:

Allows mirroring of the source files and ACL info to the destination side, and only copy the changes
Fast; we cannot have this running for more than 12 hours at a time
Command line so that we are able to schedule the job in off hours
0
Comment
Question by:nvr8981
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
  • 2
5 Comments
 
LVL 13

Expert Comment

by:lciprianionut
ID: 40304674
Did you tried to use switch /COPYALL or /SEC on Robocopy.exe?
0
 

Author Comment

by:nvr8981
ID: 40304681
Yes.  Even though it copies the data and the file attributes over on the initial run, it will modify every file every time it's run.  Meaning, even if some files have not been changed in any way from the source, it will still be copied over once more to the destination.  I'm looking for a tool that can compare the files and copy over the files that are different only.  It should be able to compare the data/time modified, the ACL structure on both files, and the size of the files.

Has anyone ever worked with RichCopy?  Does it have these features?
0
 
LVL 13

Expert Comment

by:lciprianionut
ID: 40304703
You can try also TeraCopy and ultracopier.
0
 

Accepted Solution

by:
nvr8981 earned 0 total points
ID: 40315270
Seems that the best copy utility so far for file migration is EMCopy.  Transferring differentials for a 9.1 TB share with Robocopy takes around 22 hours, if you're using the /SEC /SECFIX switches.  EMCopy transfers the diffs in a little less than 3 hours for our share, including the ACL differences between the files.

Yes, it still deletes the files from the destination side if locked from the source,  However we have a window of 12 hours during our migration that all of the files will be free, and the remaining files that were missed can be copied over.
0
 

Author Closing Comment

by:nvr8981
ID: 40322673
Only solution that I found that allowed me to script out the copy jobs for scheduling, and transferring differential data better than robocopy.
0

Featured Post

Independent Software Vendors: We Want Your Opinion

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

OfficeMate Freezes on login or does not load after login credentials are input.
Restoring deleted objects in Active Directory has been a standard feature in Active Directory for many years, yet some admins may not know what is available.
This tutorial will walk an individual through the process of configuring basic necessities in order to use the 2010 version of Data Protection Manager. These include storage, agents, and protection jobs. Launch Data Protection Manager from the deskt…
This tutorial will walk an individual through the process of installing of Data Protection Manager on a server running Windows Server 2012 R2, including the prerequisites. Microsoft .Net 3.5 is required. To install this feature, go to Server Manager…

734 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question