Solved

Data Transfer - best way to shift 30G of data

Posted on 2006-07-19
2
217 Views
Last Modified: 2010-04-12

I have a vpn between two 2M broadband connections. I want one of my sites to hold backup data but this means I need to move about 30G-50G of data. This will take hours/days I'm currently transfer a 30G file at a rate of 800bytes/sec and in 15hrs has transfers 1.7G. What is the best solution?

Thanks, Mike
0
Comment
Question by:micbbc
2 Comments
 
LVL 20

Accepted Solution

by:
calvinetter earned 500 total points
ID: 17144429
The best solution would be:  a high-bandwidth private line between the 2 locations so that a VPN wouldn't be necessary. But if these locations are farther apart your choices are more limited.  If you have the budget, a pair of "WAN accelerator" appliances could increase your throughput significantly.  If possible, doing a daily differential backup would be much preferred - typical daily data changes might be as low as 3-5% of the total amount of data.

  If you have to work with your current 2M connections & must use VPN:
- What encryption are you using?  3DES can be extremely inefficient unless you're doing the encryption via fast hardware; AES would be preferred if this is an option, especially if done in hardware.
- Do daily differential backups + 1 weekly full backup, if feasible
- Consider buying a pair of WAN accelerators
- The actual transfer method can greatly affect your throughput.  eg, copying to/from Windows shares is extremely inefficent compared to an FTP or even HTTP transfer.
- In both the source & target systems, NICs with capabilities such as TCP offload would be much preferred.

cheers
0
 

Author Comment

by:micbbc
ID: 17144832
Good points raised. Will look into a couple of them particularly the WAN accelerators and diff backups.

Thanks
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Secure VPN Connection terminated locally by the Client.  Reason 442: Failed to enable Virtual Adapter. If you receive this error on Windows 8 or Windows 8.1 while trying to connect with the Cisco VPN Client then the solution is a simple registry f…
If you use NetMotion Mobility on your PC and plan to upgrade to Windows 10, it may not work unless you take these steps.
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…

863 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

21 Experts available now in Live!

Get 1:1 Help Now