?
Solved

Which tool is the best for command line differential copies on Windows Server 2012

Posted on 2014-09-04
5
Medium Priority
?
781 Views
Last Modified: 2014-09-15
I am currently on a project to transfer over our file shares on a Windows server to a new third party storage array.  We want to mirror all files and ACL information to the new storage array.  The shares we're trying to migrate are as low as 20 GB and at max 20 TB.  We have tried to copy over the files using Robocopy with the following switches:  

/mir /XO /ETA /MT:64 /zb  /r:1 /w:1

Unfortunately even though this copies over the files that have been modified, the ACLs have not copied over correctly.  We tried to then use the /SEC /SECFIX switches and would get the ACLs of the files, but it would "Modify" every file even if the destination and source ACL match.

We also tried EMCopy and that seemed to be perfect, but found a big flaw.  If EMCopy is unable to access a source file, then it will delete it on the same file on the destination side immediately.  This does not help if we're trying to do differentials.  

Now finally the question.  I would like to know what is the best command line tool for Windows that will allow me to do the following:

Allows mirroring of the source files and ACL info to the destination side, and only copy the changes
Fast; we cannot have this running for more than 12 hours at a time
Command line so that we are able to schedule the job in off hours
0
Comment
Question by:nvr8981
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
  • 2
5 Comments
 
LVL 13

Expert Comment

by:lciprianionut
ID: 40304674
Did you tried to use switch /COPYALL or /SEC on Robocopy.exe?
0
 

Author Comment

by:nvr8981
ID: 40304681
Yes.  Even though it copies the data and the file attributes over on the initial run, it will modify every file every time it's run.  Meaning, even if some files have not been changed in any way from the source, it will still be copied over once more to the destination.  I'm looking for a tool that can compare the files and copy over the files that are different only.  It should be able to compare the data/time modified, the ACL structure on both files, and the size of the files.

Has anyone ever worked with RichCopy?  Does it have these features?
0
 
LVL 13

Expert Comment

by:lciprianionut
ID: 40304703
You can try also TeraCopy and ultracopier.
0
 

Accepted Solution

by:
nvr8981 earned 0 total points
ID: 40315270
Seems that the best copy utility so far for file migration is EMCopy.  Transferring differentials for a 9.1 TB share with Robocopy takes around 22 hours, if you're using the /SEC /SECFIX switches.  EMCopy transfers the diffs in a little less than 3 hours for our share, including the ACL differences between the files.

Yes, it still deletes the files from the destination side if locked from the source,  However we have a window of 12 hours during our migration that all of the files will be free, and the remaining files that were missed can be copied over.
0
 

Author Closing Comment

by:nvr8981
ID: 40322673
Only solution that I found that allowed me to script out the copy jobs for scheduling, and transferring differential data better than robocopy.
0

Featured Post

Veeam Disaster Recovery in Microsoft Azure

Veeam PN for Microsoft Azure is a FREE solution designed to simplify and automate the setup of a DR site in Microsoft Azure using lightweight software-defined networking. It reduces the complexity of VPN deployments and is designed for businesses of ALL sizes.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

The following article is comprised of the pearls we have garnered deploying virtualization solutions since Virtual Server 2005 and subsequent 2008 RTM+ Hyper-V in standalone and clustered environments.
Compliance and data security require steps be taken to prevent unauthorized users from copying data.  Here's one method to prevent data theft via USB drives (and writable optical media).
In this Micro Tutorial viewers will learn how to restore single file or folder from Bare Metal backup image of their system. Tutorial shows how to restore files and folders from system backup. Often it is not needed to restore entire system when onl…
This Micro Tutorial will teach you how to reformat your flash drive. Sometimes your flash drive may have issues carrying files so this will completely restore it to manufacturing settings. Make sure to backup all files before reformatting. This w…
Suggested Courses

765 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question