Solved

Moving very-dense data

Posted on 2009-07-08
11
180 Views
Last Modified: 2012-05-07
So somebody at work thought a NAS would be an ideal solution to their storage problems... except that the NAS itself is suspect to several security vulnerabilties.

Anyway, I'm trying to efficiently move data off the device to a VM.  Its not a lot of data (120Gb), however, its very dense.  In other words, there are hundreds of thousands, possibly a few millions, of files 1k or less in size.  The VM I'm moving it on to is a Windows Sever 2003 box.

The NAS was a cheapy, and so every once in awhile it disconnects, killing the copy job.  I can't tell you how frustrating this has become, because I've been copying data for over 24 hours now.

Does anyone have any ideas of how I can copy these over while expecting disconnects?  I'm just using copy and paste at the moment.
0
Comment
Question by:AMPLIFY_TS
11 Comments
 
LVL 5

Accepted Solution

by:
tljones00 earned 500 total points
ID: 24810628
Copy in smaller bits dude. I've gone through this crap before. Small chunks is the best bet. Remember where your last file was and resume from that point. Pain in the butt, but it works.
0
 
LVL 8

Expert Comment

by:Kavostylin
ID: 24810635
Meh...

Pull the drives outta the NAS and to a d2d copy :D
0
 
LVL 57

Expert Comment

by:giltjr
ID: 24810647
What NAS device is it?  Brand and model please.
0
The Eight Noble Truths of Backup and Recovery

How can IT departments tackle the challenges of a Big Data world? This white paper provides a roadmap to success and helps companies ensure that all their data is safe and secure, no matter if it resides on-premise with physical or virtual machines or in the cloud.

 
LVL 8

Expert Comment

by:Kavostylin
ID: 24810649
D2D do it... fast quick....
0
 
LVL 1

Author Comment

by:AMPLIFY_TS
ID: 24810711
I would love to do D2D, but I'm moving the data onto a Virtual Machine.  I can't really think of a clever way to physically attach disks :P
0
 
LVL 8

Expert Comment

by:Kavostylin
ID: 24810728
The VM has to be connected to server somewhere... pull the disk out put in in a enclosure and TRF it directly through the host OS....
0
 
LVL 1

Author Comment

by:AMPLIFY_TS
ID: 24810737
Ohyeah, for some reason that didn't dawn on me.  I'll have to double check the NAS when I'm back onsite tomorrow.  Crossing my fingers and hoping that the NAS isn't set up in a raid...
0
 
LVL 1

Author Comment

by:AMPLIFY_TS
ID: 24810801
Ohyeah, for some reason that didn't dawn on me.  I'll have to double check the NAS when I'm back onsite tomorrow.  Crossing my fingers and hoping that the NAS isn't set up in a raid...
0
 
LVL 8

Expert Comment

by:Kavostylin
ID: 24810818
If it is set up in a raid then. otherwise physically connected the NAS to the VM host and just assign local IPs. and do a direct transfer. probably need a crossover.
0
 
LVL 1

Author Comment

by:AMPLIFY_TS
ID: 24824010
So taking the disks out isn't an option - the user said she's not comfortable with me taking the NAS apart.  Looks like I've got to to do it by hand, in small chunks.  Sigh.
0
 
LVL 1

Author Closing Comment

by:AMPLIFY_TS
ID: 31602095
Unfortunately, this looks like this was the only option available to me.
0

Featured Post

Free Webinar: AWS Backup & DR

Join our upcoming webinar with experts from AWS, CloudBerry Lab, and the Town of Edgartown IT to discuss best practices for simplifying online backup management and cutting costs.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Every system administrator encounters once in while in a problem where the solution seems to be a needle in haystack.  My needle was an anti-virus version causing problems with my Exchange server. I have an HP DL350 with Windows Server 2008 Stand…
Problem Description: Actually I found the below issue with some customers after migration from SMS 2003 to SCCM 2007 and epically if they change site code, some clients may appear in the console with old site code, plus old sites still appearing …
A short tutorial showing how to set up an email signature in Outlook on the Web (previously known as OWA). For free email signatures designs, visit https://www.mail-signatures.com/articles/signature-templates/?sts=6651 If you want to manage em…

679 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question