Solved

Fastest way to copy 3TB of data from server to server?

Posted on 2008-10-14
6
689 Views
Last Modified: 2013-12-01
I need to transfer all the data from our old file server to our new file server, on weekends, at night.  I need an efficient solution that will allow me to keep all NTFS permissions.  Set and forget solution would be preferred.  Any ideas?
0
Comment
Question by:BassBerry
  • 3
  • 2
6 Comments
 
LVL 2

Accepted Solution

by:
daviddriv earned 125 total points
ID: 22716233
Robocopy works great.  I have used it several times for this exact purpose.  As an added benefit, you can use it to keep both places in sync while you change mapped drives and user mount points.  You can get it from here:

http://www.microsoft.com/downloads/details.aspx?FamilyID=9D467A69-57FF-4AE7-96EE-B18C4790CFFD&displaylang=en

The syntax I use is:

robocpy <source> <destination> /E /COPYALL /ETA
0
 
LVL 2

Expert Comment

by:daviddriv
ID: 22716268
By the way, here is what the switches I specified do (it is available in the help file, but here you go anyways)

/E - Copies all directories, including empty ones
/COPYALL - copies all file attributes, including NTFS permissions
/ETA - gives you an estimated time to copy current file

Since you want a Ron Popeil solution (Set it and forget it), you may want to include the log switch:

/LOG:<filepath>
0
 

Author Comment

by:BassBerry
ID: 22716340
Is this faster or easier to use than backup/restoring or xcopy?
0
IT, Stop Being Called Into Every Meeting

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

 
LVL 2

Expert Comment

by:daviddriv
ID: 22717022
I am not sure it is any faster than xcopy, but it is very easy to use and has a lot of features that let you get it to do exactly what you want it to do.  Theoretically it is faster than a backup/restore, since you would have an intermediate step when you go to tape/disk.  

Actually, if you already have backups, you may be able to leverage your previous full backup and robocopy to minimize the impact to your production system.  So, basically, you would restore your most recent backup of your data to the new location and use robocopy to copy the deltas.  By default, robocopy will skip files that already exist.  When it is done, it will even give you a nice summary of how many files it copied/already existed, how big they were, how long it took, etc.  Using this method, you could really minimize your after hours work (I try to avoid that as much as possible, myself).  

I don't know how your data is being accessed/used, so I can't categorically say this will work for you, but I have actually used robocopy to move user directories live during normal business hours.  The way I did it was that I set robocopy to sync mode (/MOT:<timeinseconds>) along with the switch to exclude files that are older than the target (/XO).  Once the initial copy was done, I changed the Dfs mappings and let the sync complete.  Once I saw there were no remaining open files in the original directory, I stopped the sync and unshared the directory so the user couldn't get to the old location.

Of course, any method you use, you ought to test first with a small representative data set to make sure you get the expected behavior and all of the switches work.
0
 
LVL 19

Expert Comment

by:aissim
ID: 22717033
daviddriv is right - robocopy is your best bet. It certainly smashes xcopy performance wise....it's the next generation xcopy on steroids.

And personally, for what you are trying to do, I find robocopy much simpler to handle than a full on backup/restore operation.

(I also like to use the /MOVE switch which deletes files and directories from the source after copying)
0
 

Author Comment

by:BassBerry
ID: 22720699
Thanks all!  I will start testing this today.
0

Featured Post

Threat Intelligence Starter Resources

Integrating threat intelligence can be challenging, and not all companies are ready. These resources can help you build awareness and prepare for defense.

Join & Write a Comment

Are you looking to recover an email message or a contact you just deleted mistakenly? Or you are searching for a contact that you erased from your MS Outlook ‘Contacts’ folder and now realized that it was important.
ADCs have gained traction within the last decade, largely due to increased demand for legacy load balancing appliances to handle more advanced application delivery requirements and improve application performance.
This tutorial will walk an individual through the process of configuring basic necessities in order to use the 2010 version of Data Protection Manager. These include storage, agents, and protection jobs. Launch Data Protection Manager from the deskt…
This tutorial will show how to configure a new Backup Exec 2012 server and move an existing database to that server with the use of the BEUtility. Install Backup Exec 2012 on the new server and apply all of the latest hotfixes and service packs. The…

747 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now