Solved

What would limit max bandwidth usage to 12M on a 1000M circuit

Posted on 2013-11-01
13
385 Views
Last Modified: 2013-11-12
We have a need to transfer about 50GB of data from a Windows 2003 server at a remote site across a gig WAN circuit to a Windows 2008 server at our data center.  When we try to send that traffic over the nearly-empty gig link, bandwidth use never exceeds about 12M or so.  We do use that link for database-syncing, and that process can use about 980Mbps, so the link is fully capable of carrying the traffic.  We suspect bandwidth-delay-product might factor in here, or perhaps some limit built into Windows 2003, but if somone can give us a definitive answer, we would be grateful.
Router hardware: Cisco 3945e on each end for the gig link.
0
Comment
Question by:hassarfj
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 6
  • 4
  • 2
  • +1
13 Comments
 
LVL 5

Expert Comment

by:alicain
ID: 39617968
A few thoughts :
- Are the NICs on the server correctly configured and not auto-detecting to 10Mb?
- Is the 2003 server SP2 with the post SP2 fixes for the Scalable Networking Pack, and the drivers up to date?
- Getting a trace with wireshark or netmon would be useful to see if there are any network issues in there.
- Do a tracert to check that there isn't any odd routing occurring.


Regards,
Alastair.
0
 

Author Comment

by:hassarfj
ID: 39618176
Good questions...
We believe the NICs are OK - but will check again
I believe the server is up to date.  Checking that again also.
I have a packet trace file, but need to figure out how to rename it so I can upload it
The routing is fine - tracert hits all the right hop points.

We tried using a 100M backup link, provided by a different carrier, but got the same result, so we ruled out service-providor config issues.
0
 
LVL 57

Expert Comment

by:giltjr
ID: 39618257
How are you transferring the files?  Have you tried used ftp?

What is the latency between the two sites?
0
Why Off-Site Backups Are The Only Way To Go

You are probably backing up your data—but how and where? Ransomware is on the rise and there are variants that specifically target backups. Read on to discover why off-site is the way to go.

 
LVL 17

Expert Comment

by:surbabu140977
ID: 39618947
You might need to check the 3945 for any probable QoS which might police your traffic at 12meg.......
0
 

Author Comment

by:hassarfj
ID: 39622501
Problem as initially reported relates to CIFS file transfers.  
We still get "slow" performance using FTP, but better than CIFS. (Perhaps as much as 30Mbps)
RTT Latency is about 68ms from Sacramento to Hawaii
We checked QoS - no drops reported
0
 
LVL 5

Assisted Solution

by:alicain
alicain earned 200 total points
ID: 39622835
Do you have a Windows 2008 or Windows 7 machine at the location where the 2003 server is, if so how does that perform?  SMB is so much less chatty in later versions, that you could well see a significant increase in throughput.  

That'd also help with identifying if it's any of the 2003 SNP related issues.  You could disable Task Offloading, which I should have mentioned in the the earlier email :
http://support.microsoft.com/kb/904946
You experience intermittent communication failure between computers that are running Windows XP or Windows Server 2003

Regards,
Alastair.
0
 
LVL 57

Expert Comment

by:giltjr
ID: 39623211
O.K, you said you have "50GB of data."  Does that mean you have a few large files or a lot of little files?

If you have a lot of little files, say under 100MB, then you will not get the full bandwidth if you are doing one file at a time.  You need to either zip the files into a single large file or start multiple ftp connections and ftp multiple files at once.  If you use an ftp client like Filezille you can set how many transfers at one time you do.
0
 

Author Comment

by:hassarfj
ID: 39625699
Files are large - maybe 25GB to maybe 40+GB
Questions remains: why can't we send the big file across the big pipe simply, in a single TCP session, without having to break it up with some app like filezilla?
0
 
LVL 57

Expert Comment

by:giltjr
ID: 39626095
You don't have to break it up.  I think you misunderstood the point I was trying to make.  I was not suggesting that you break it up.  You originally said you had about 50GB of data to transfer.    I was trying to see if it was one big file, or a lot of little files.

When transferring a lot of little files you can fill the pipe.  

I would try and leave it as a single big file.

What FTP client did you use?

What FTP server are you using?

If you are using the Windows supplied FTP client you may want to try using the following command to start it:

ftp -w:524140
0
 
LVL 57

Accepted Solution

by:
giltjr earned 300 total points
ID: 39626106
Doing a little calculating to fill a 1 Gb pipe with 70ms latency you would need a window size of 8MB.

I'm not sure what the max. window size ftp client supports (the -w: parameter) you may want to try larger numbers.  The value you sepcify for -w: should be a multiple if 1460, assuming that 1460 is your MSS.

You may want to try -w:3500000
0
 
LVL 57

Expert Comment

by:giltjr
ID: 39641537
Thank you.  What buffer size did you test with and what were the results?
0
 

Author Comment

by:hassarfj
ID: 39642914
we gave  up on Win 2003, moved the file to a WIN 2008 unit and copied the 50 GB file to the cdata center using Filezilla, which multi-threaded the transfer.  We are seriously looking into a product called FileCatalyst which can replace ftp and transfer at line speed up to 10G
0
 
LVL 57

Expert Comment

by:giltjr
ID: 39642932
filezilla uses a larger window size.  However multi threaded would only help if you had more than one file.  Earlier you implied you had a single large file not a lot of smaller files.
0

Featured Post

Technology Partners: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

When you try to share a printer , you may receive one of the following error messages. Error message when you use the Add Printer Wizard to share a printer: Windows could not share your printer. Operation could not be completed (Error 0x000006…
In this article, I am going to show you how to simulate a multi-site Lab environment on a single Hyper-V host. I use this method successfully in my own lab to simulate three fully routed global AD Sites on a Windows 10 Hyper-V host.
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…
There's a multitude of different network monitoring solutions out there, and you're probably wondering what makes NetCrunch so special. It's completely agentless, but does let you create an agent, if you desire. It offers powerful scalability …

688 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question