We help IT Professionals succeed at work.

How to copy a 150 Gb database across the country?

Hi,

I need to find a way to copy a 150 Gb backup file from Sydney windows 2008 server to UK server windows 2008 over a VPN. What's the best method to do this?

I don't want to kill or saturate the ipsec vpn we have connected.

Can anyone make a suggestion?
Comment
Watch Question

Commented:
well there are some questions you need to consider before choosing the best way
1. what and how is the bandwidth/latency/stability on your VPN?
2. how frequently you want the data to be copied across the network?
3. the best time slot for sending and receiving the backup on the VPN
4. other way to fulfill your needs

For the first question, bandwidth is the main concern on sending such a large file. 150Gb on a 10Mb/s DIA is like more than 4 hours of non-interrupted connection. you have to make sure your bandwidth is stable enough to be online and also with a acceptable latency to keep the connection alive.

Secondly, a file this big may take a very long time to be sent and received. so sending the file takes too long may affect the backup schedule some time when the network loading is too heavy during the send/receive.

thirdly, the free time foryour network i.e. non office hour at sydney, may not be the best time for UK to receive the file and receiving such a file will consume a lot of network and hardware resources. (storage needs to handle read and write intensively when receiving/sending the file)

last, how about an offsite backup locally? or scheduled backup with courier to send the backup media to UK? example: take a half month backup and sent to UK whilst a daily/weekly backup to stored locally at other local offfice or even Bank/Storage company.

this is what you can do with your exisitng environment.

of cause you can always upgrade your DIA/VPN bandwidth for faster transmission rate but its not a good practice to send such a large size file across the network frequently.

Author

Commented:
Hi WH,

the vpn is an 8 meg link, I want to run it overnight and be able to manage the amount of Mbyte p/s and schedule it.

Was hoping there was some cool software tool where you could do that and use some sort of fastcoopy like scp maybe?

Just trying to get ideas
I think it is better to split your database to many small files (look at http://www.filesplitter.org/). In this case you will be less dependent from software used.
FTP protocol is a good choice for file transferring through internet.
W_H

Commented:
sure there is somethingyou can add to sort of increase the transmission rate in some way.

there are some network enhancement device, as what they caledl, WAN optimisation.
but they are quite expensive though.

FYI
http://www.f5.com/solutions/acceleration/wan-optimization/
W_H

Commented:
*called

typo
W_H

Commented:
for a 8 Mb/s link, a 150GB file in bit is 150 x 8  = around 1200Gb. 1200Gb / 8Mb = (1200 x 1024 / 8) /60(convert to mins)/60(convert to hours) = 42.67hours theorietically.
Please correct me if the calculation is wrong.

so its up to you to spend this much time to send a single/multiple files on the exisiting vpn connection.
W_H

Commented:
FYI, all data connection is calculated in Bits. so your 8 meg link should be 8Mb/s, not 8MByte/s.

Author

Commented:
Hey WH, yes its 8 MBits per second. I think I will try the splitter and upload in bit parts.
W_H

Commented:
sure hope you can do what you want :D

Author

Commented:
Thanks guys. The splitter worked fine.