Solved

complex copy data around 18 terabytes

Posted on 2011-03-21
5
303 Views
Last Modified: 2012-05-11
Hi
I need to copy around 18 terabytes of data from SAN storage to windows share folder the maximum I can do is 3 terabytes which is fine however the big issue is this SAN is used by mac and some of filenames don't qualify for windows is there anyway the process of copying continuo however ignored file can remain at the end of the list
0
Comment
Question by:mattibutt
  • 2
  • 2
5 Comments
 
LVL 82

Accepted Solution

by:
oBdA earned 250 total points
Comment Utility
Use robocopy; I've used it without any problems for several migrations. If you're expecting problems, just set /r (retry) and /w (wait) to something like /r:1 /w:1.
Some other hints:
- robocopy will *by* *default* only copy files that aren't in the target already.
- If you want to do several sync runs, you can use /mir to delete files in the target that aren't in the source anymore.
- use /copyall to copy NTFS permissions as well.
- Check robocopy.doc in the ResKit installation folder (to run it, you actually only need robocopy.exe), it's a very useful documentation.
- You can safely use /nfl (no file list) and /ndl (no directory list) to reduce the log file size; errors will still be logged.
- Use /np if you're logging to a text file, otherwise the log will be filled with control characters.
- Since W2k8, robocopy is already included (but without robocopy.doc).

Windows Server 2003 Resource Kit Tools
http://www.microsoft.com/downloads/details.aspx?familyid=9d467a69-57ff-4ae7-96ee-b18c4790cffd&displaylang=en

GUI wrappers are available, too:
RoboCopy GUI 1.0.0.24
http://www.softpedia.com/get/System/OS-Enhancements/RoboCopy-GUI.shtml
0
 
LVL 11

Author Comment

by:mattibutt
Comment Utility
so if i get this correct this tool will enable me to copy and disregard the files which names do not qualify?
0
 
LVL 30

Assisted Solution

by:ded9
ded9 earned 250 total points
Comment Utility
I would recommend this software

http://www.codesector.com/teracopy.php


Ded9
0
 
LVL 82

Expert Comment

by:oBdA
Comment Utility
That's what you configure with the /r (retry) and /w (wait) arguments: how robocopy robocopy should react when it encounters files it can't copy, that is, how often it should retry the copy and how long it should wait between retries. In your case, these need to be low (default is 1000000 retries and 30 seconds pause, which would effectively stop the copy at the first file that can't be copied).
0
 
LVL 11

Author Closing Comment

by:mattibutt
Comment Utility
thanks guys
0

Featured Post

Why You Should Analyze Threat Actor TTPs

After years of analyzing threat actor behavior, it’s become clear that at any given time there are specific tactics, techniques, and procedures (TTPs) that are particularly prevalent. By analyzing and understanding these TTPs, you can dramatically enhance your security program.

Join & Write a Comment

Sometimes drives fill up and we don't know why.  If you don't understand the best way to use the tools available, you may end up being stumped as to why your drive says it's not full when you have no space left!  Here's how you can find out...
Join Greg Farro and Ethan Banks from Packet Pushers (http://packetpushers.net/podcast/podcasts/pq-show-93-smart-network-monitoring-paessler-sponsored/) and Greg Ross from Paessler (https://www.paessler.com/prtg) for a discussion about smart network …
Windows 8 comes with a dramatically different user interface known as Metro. Notably missing from the new interface is a Start button and Start Menu. Many users do not like it, much preferring the interface of earlier versions — Windows 7, Windows X…
With the advent of Windows 10, Microsoft is pushing a Get Windows 10 icon into the notification area (system tray) of qualifying computers. There are many reasons for wanting to remove this icon. This two-part Experts Exchange video Micro Tutorial s…

771 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

11 Experts available now in Live!

Get 1:1 Help Now