Solved

Data Transfer - best way to shift 30G of data

Posted on 2006-07-19
2
225 Views
Last Modified: 2010-04-12

I have a vpn between two 2M broadband connections. I want one of my sites to hold backup data but this means I need to move about 30G-50G of data. This will take hours/days I'm currently transfer a 30G file at a rate of 800bytes/sec and in 15hrs has transfers 1.7G. What is the best solution?

Thanks, Mike
0
Comment
Question by:micbbc
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
2 Comments
 
LVL 20

Accepted Solution

by:
calvinetter earned 500 total points
ID: 17144429
The best solution would be:  a high-bandwidth private line between the 2 locations so that a VPN wouldn't be necessary. But if these locations are farther apart your choices are more limited.  If you have the budget, a pair of "WAN accelerator" appliances could increase your throughput significantly.  If possible, doing a daily differential backup would be much preferred - typical daily data changes might be as low as 3-5% of the total amount of data.

  If you have to work with your current 2M connections & must use VPN:
- What encryption are you using?  3DES can be extremely inefficient unless you're doing the encryption via fast hardware; AES would be preferred if this is an option, especially if done in hardware.
- Do daily differential backups + 1 weekly full backup, if feasible
- Consider buying a pair of WAN accelerators
- The actual transfer method can greatly affect your throughput.  eg, copying to/from Windows shares is extremely inefficent compared to an FTP or even HTTP transfer.
- In both the source & target systems, NICs with capabilities such as TCP offload would be much preferred.

cheers
0
 

Author Comment

by:micbbc
ID: 17144832
Good points raised. Will look into a couple of them particularly the WAN accelerators and diff backups.

Thanks
0

Featured Post

Retailers - Is your network secure?

With the prevalence of social media & networking tools, for retailers, reputation is critical. Have you considered the impact your network security could have in your customer's experience? Learn more in our Retail Security Resource Kit Today!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Do you have an old router lying around the house that you don’t know what to do with? Check the make and model, then refer to either of these links to see if its compatible. http://www.dd-wrt.com/site/support/router-database http://www.dd-wrt.c…
Like many others, when I created a Windows 2008 RRAS VPN server, I connected via PPTP, and still do, but there are problems that can arise from solely using PPTP.  One particular problem was that the CFO of the company used a Virgin Broadband Wirele…
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…
Windows 10 is mostly good. However the one thing that annoys me is how many clicks you have to do to dial a VPN connection. You have to go to settings from the start menu, (2 clicks), Network and Internet (1 click), Click VPN (another click) then fi…

726 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question