?
Solved

Data Transfer - best way to shift 30G of data

Posted on 2006-07-19
2
Medium Priority
?
226 Views
Last Modified: 2010-04-12

I have a vpn between two 2M broadband connections. I want one of my sites to hold backup data but this means I need to move about 30G-50G of data. This will take hours/days I'm currently transfer a 30G file at a rate of 800bytes/sec and in 15hrs has transfers 1.7G. What is the best solution?

Thanks, Mike
0
Comment
Question by:micbbc
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
2 Comments
 
LVL 20

Accepted Solution

by:
calvinetter earned 2000 total points
ID: 17144429
The best solution would be:  a high-bandwidth private line between the 2 locations so that a VPN wouldn't be necessary. But if these locations are farther apart your choices are more limited.  If you have the budget, a pair of "WAN accelerator" appliances could increase your throughput significantly.  If possible, doing a daily differential backup would be much preferred - typical daily data changes might be as low as 3-5% of the total amount of data.

  If you have to work with your current 2M connections & must use VPN:
- What encryption are you using?  3DES can be extremely inefficient unless you're doing the encryption via fast hardware; AES would be preferred if this is an option, especially if done in hardware.
- Do daily differential backups + 1 weekly full backup, if feasible
- Consider buying a pair of WAN accelerators
- The actual transfer method can greatly affect your throughput.  eg, copying to/from Windows shares is extremely inefficent compared to an FTP or even HTTP transfer.
- In both the source & target systems, NICs with capabilities such as TCP offload would be much preferred.

cheers
0
 

Author Comment

by:micbbc
ID: 17144832
Good points raised. Will look into a couple of them particularly the WAN accelerators and diff backups.

Thanks
0

Featured Post

ATEN's HDBaseT Presentation at InfoComm 2017

Hear ATEN Product Manager YT Liang review HDBaseT technology, highlighting ATEN’s latest solutions as they relate to real-world applications during her presentation at the HDBaseT booth at InfoComm 2017.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Preface Having the need * to contact many different companies with different infrastructures * do remote maintenance in their network required us to implement a more flexible routing solution. As RAS, PPTP, L2TP and VPN Client connections are no…
I've written this article to illustrate how we can implement a Dynamic Multipoint VPN (DMVPN) with both hub and spokes having a dynamically assigned non-broadcast multiple-access (NBMA) network IP (public IP). Here is the basic setup of DMVPN Pha…
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…

770 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question