What is the fastest way to copy large amounts of data across a WAN

mgbooker
mgbooker used Ask the Experts™
on
Would like to know the fastest method to copy many files across a WAN?  Just using copy and paste is very slow when copying 2gb of data across the WAN. I have a DS3 connection from my location that links to a MPLS cloud which intern links to a data center. Please provide any detail on how you would copy data to the destination.
Comment
Watch Question

Do more with

Expert Office
EXPERT OFFICE® is a registered trademark of EXPERTS EXCHANGE®
robocopy is my favorite! It's a copy on steroids.

robocopy <source> <destination> /MIR /R:0
Anuradha GoliSystems Development / Support Specialist

Commented:

Commented:
fastest to my experience is to
1) reduce files to copy (zip in multple volumes)
2) set up a web server and host the zip files on the server
3) use a download manager (eg orbitdownloader) to transfer the files

I have been using this to transfer files from europe to asia over the public internet and the speeds are great compared to normal copy operations
Commented:
So far the robocopy is the fastest by far. The RichCopy is a bit buggy causing errors after a few hours of continues copying. Right no the amout of data that I have coppied has been over 100GB and took about 14 hours to complete.
-------------------------------------------------------------------------------
   ROBOCOPY     ::     Robust File Copy for Windows                              
-------------------------------------------------------------------------------

  Started : Thu Apr 19 08:47:21 2012

   Source : \\ASERVERNAME\SOURCE$\Source\
     Dest : F:\Dest\

    Files : *.*
          
  Options : *.* /S /E /COPYALL /NP /MT:8 /R:1 /W:1

------------------------------------------------------------------------------

               Total    Copied   Skipped  Mismatch    FAILED    Extras
    Dirs :      8129      8128         1         0         0         0
   Files :    144535    144525         0         0        10         0
   Bytes : 114.117 g 114.115 g         0         0    1.95 m         0
   Times : 121:17:36  12:01:31                       0:00:00   1:30:39

   Ended : Thu Apr 19 22:19:32 2012

Commented:
that's 8Gb/hr which is very fast for a WAN,
what type of internet connections do you have (on both sides)?
Sigurdur HaraldssonSystem Administrator

Commented:
Go with Robocopy.

Author

Commented:
Robocopy gave the best results

Do more with

Expert Office
Submit tech questions to Ask the Experts™ at any time to receive solutions, advice, and new ideas from leading industry professionals.

Start 7-Day Free Trial