Solved

Data Transfer - best way to shift 30G of data

Posted on 2006-07-19
2
212 Views
Last Modified: 2010-04-12

I have a vpn between two 2M broadband connections. I want one of my sites to hold backup data but this means I need to move about 30G-50G of data. This will take hours/days I'm currently transfer a 30G file at a rate of 800bytes/sec and in 15hrs has transfers 1.7G. What is the best solution?

Thanks, Mike
0
Comment
Question by:micbbc
2 Comments
 
LVL 20

Accepted Solution

by:
calvinetter earned 500 total points
Comment Utility
The best solution would be:  a high-bandwidth private line between the 2 locations so that a VPN wouldn't be necessary. But if these locations are farther apart your choices are more limited.  If you have the budget, a pair of "WAN accelerator" appliances could increase your throughput significantly.  If possible, doing a daily differential backup would be much preferred - typical daily data changes might be as low as 3-5% of the total amount of data.

  If you have to work with your current 2M connections & must use VPN:
- What encryption are you using?  3DES can be extremely inefficient unless you're doing the encryption via fast hardware; AES would be preferred if this is an option, especially if done in hardware.
- Do daily differential backups + 1 weekly full backup, if feasible
- Consider buying a pair of WAN accelerators
- The actual transfer method can greatly affect your throughput.  eg, copying to/from Windows shares is extremely inefficent compared to an FTP or even HTTP transfer.
- In both the source & target systems, NICs with capabilities such as TCP offload would be much preferred.

cheers
0
 

Author Comment

by:micbbc
Comment Utility
Good points raised. Will look into a couple of them particularly the WAN accelerators and diff backups.

Thanks
0

Featured Post

What Should I Do With This Threat Intelligence?

Are you wondering if you actually need threat intelligence? The answer is yes. We explain the basics for creating useful threat intelligence.

Join & Write a Comment

Preface Having the need * to contact many different companies with different infrastructures * do remote maintenance in their network required us to implement a more flexible routing solution. As RAS, PPTP, L2TP and VPN Client connections are no…
This is an article about my experiences with remote access to my clients (so that I may serve them) and eventually to my home office system via Radmin Remote Control. I have been using remote access for over 10 years and have been improving my metho…
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…

743 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

8 Experts available now in Live!

Get 1:1 Help Now