• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 231
  • Last Modified:

Data Transfer - best way to shift 30G of data

I have a vpn between two 2M broadband connections. I want one of my sites to hold backup data but this means I need to move about 30G-50G of data. This will take hours/days I'm currently transfer a 30G file at a rate of 800bytes/sec and in 15hrs has transfers 1.7G. What is the best solution?

Thanks, Mike
1 Solution
The best solution would be:  a high-bandwidth private line between the 2 locations so that a VPN wouldn't be necessary. But if these locations are farther apart your choices are more limited.  If you have the budget, a pair of "WAN accelerator" appliances could increase your throughput significantly.  If possible, doing a daily differential backup would be much preferred - typical daily data changes might be as low as 3-5% of the total amount of data.

  If you have to work with your current 2M connections & must use VPN:
- What encryption are you using?  3DES can be extremely inefficient unless you're doing the encryption via fast hardware; AES would be preferred if this is an option, especially if done in hardware.
- Do daily differential backups + 1 weekly full backup, if feasible
- Consider buying a pair of WAN accelerators
- The actual transfer method can greatly affect your throughput.  eg, copying to/from Windows shares is extremely inefficent compared to an FTP or even HTTP transfer.
- In both the source & target systems, NICs with capabilities such as TCP offload would be much preferred.

micbbcAuthor Commented:
Good points raised. Will look into a couple of them particularly the WAN accelerators and diff backups.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

Join & Write a Comment

Featured Post

Get your problem seen by more experts

Be seen. Boost your question’s priority for more expert views and faster solutions

Tackle projects and never again get stuck behind a technical roadblock.
Join Now