Want to win a PS4? Go Premium and enter to win our High-Tech Treats giveaway. Enter to Win

x
?
Solved

What would limit max bandwidth usage to 12M on a 1000M circuit

Posted on 2013-11-01
13
Medium Priority
?
389 Views
Last Modified: 2013-11-12
We have a need to transfer about 50GB of data from a Windows 2003 server at a remote site across a gig WAN circuit to a Windows 2008 server at our data center.  When we try to send that traffic over the nearly-empty gig link, bandwidth use never exceeds about 12M or so.  We do use that link for database-syncing, and that process can use about 980Mbps, so the link is fully capable of carrying the traffic.  We suspect bandwidth-delay-product might factor in here, or perhaps some limit built into Windows 2003, but if somone can give us a definitive answer, we would be grateful.
Router hardware: Cisco 3945e on each end for the gig link.
0
Comment
Question by:hassarfj
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 6
  • 4
  • 2
  • +1
13 Comments
 
LVL 5

Expert Comment

by:alicain
ID: 39617968
A few thoughts :
- Are the NICs on the server correctly configured and not auto-detecting to 10Mb?
- Is the 2003 server SP2 with the post SP2 fixes for the Scalable Networking Pack, and the drivers up to date?
- Getting a trace with wireshark or netmon would be useful to see if there are any network issues in there.
- Do a tracert to check that there isn't any odd routing occurring.


Regards,
Alastair.
0
 

Author Comment

by:hassarfj
ID: 39618176
Good questions...
We believe the NICs are OK - but will check again
I believe the server is up to date.  Checking that again also.
I have a packet trace file, but need to figure out how to rename it so I can upload it
The routing is fine - tracert hits all the right hop points.

We tried using a 100M backup link, provided by a different carrier, but got the same result, so we ruled out service-providor config issues.
0
 
LVL 57

Expert Comment

by:giltjr
ID: 39618257
How are you transferring the files?  Have you tried used ftp?

What is the latency between the two sites?
0
Understanding Web Applications

Without even knowing it, most of us are using web applications on a daily basis. Gmail and Yahoo email, Twitter, Facebook, and eBay are used by most of us daily—and they are web applications. We often confuse these web applications tools for websites.  So, what is the difference?

 
LVL 17

Expert Comment

by:surbabu140977
ID: 39618947
You might need to check the 3945 for any probable QoS which might police your traffic at 12meg.......
0
 

Author Comment

by:hassarfj
ID: 39622501
Problem as initially reported relates to CIFS file transfers.  
We still get "slow" performance using FTP, but better than CIFS. (Perhaps as much as 30Mbps)
RTT Latency is about 68ms from Sacramento to Hawaii
We checked QoS - no drops reported
0
 
LVL 5

Assisted Solution

by:alicain
alicain earned 600 total points
ID: 39622835
Do you have a Windows 2008 or Windows 7 machine at the location where the 2003 server is, if so how does that perform?  SMB is so much less chatty in later versions, that you could well see a significant increase in throughput.  

That'd also help with identifying if it's any of the 2003 SNP related issues.  You could disable Task Offloading, which I should have mentioned in the the earlier email :
http://support.microsoft.com/kb/904946
You experience intermittent communication failure between computers that are running Windows XP or Windows Server 2003

Regards,
Alastair.
0
 
LVL 57

Expert Comment

by:giltjr
ID: 39623211
O.K, you said you have "50GB of data."  Does that mean you have a few large files or a lot of little files?

If you have a lot of little files, say under 100MB, then you will not get the full bandwidth if you are doing one file at a time.  You need to either zip the files into a single large file or start multiple ftp connections and ftp multiple files at once.  If you use an ftp client like Filezille you can set how many transfers at one time you do.
0
 

Author Comment

by:hassarfj
ID: 39625699
Files are large - maybe 25GB to maybe 40+GB
Questions remains: why can't we send the big file across the big pipe simply, in a single TCP session, without having to break it up with some app like filezilla?
0
 
LVL 57

Expert Comment

by:giltjr
ID: 39626095
You don't have to break it up.  I think you misunderstood the point I was trying to make.  I was not suggesting that you break it up.  You originally said you had about 50GB of data to transfer.    I was trying to see if it was one big file, or a lot of little files.

When transferring a lot of little files you can fill the pipe.  

I would try and leave it as a single big file.

What FTP client did you use?

What FTP server are you using?

If you are using the Windows supplied FTP client you may want to try using the following command to start it:

ftp -w:524140
0
 
LVL 57

Accepted Solution

by:
giltjr earned 900 total points
ID: 39626106
Doing a little calculating to fill a 1 Gb pipe with 70ms latency you would need a window size of 8MB.

I'm not sure what the max. window size ftp client supports (the -w: parameter) you may want to try larger numbers.  The value you sepcify for -w: should be a multiple if 1460, assuming that 1460 is your MSS.

You may want to try -w:3500000
0
 
LVL 57

Expert Comment

by:giltjr
ID: 39641537
Thank you.  What buffer size did you test with and what were the results?
0
 

Author Comment

by:hassarfj
ID: 39642914
we gave  up on Win 2003, moved the file to a WIN 2008 unit and copied the 50 GB file to the cdata center using Filezilla, which multi-threaded the transfer.  We are seriously looking into a product called FileCatalyst which can replace ftp and transfer at line speed up to 10G
0
 
LVL 57

Expert Comment

by:giltjr
ID: 39642932
filezilla uses a larger window size.  However multi threaded would only help if you had more than one file.  Earlier you implied you had a single large file not a lot of smaller files.
0

Featured Post

Free Tool: Path Explorer

An intuitive utility to help find the CSS path to UI elements on a webpage. These paths are used frequently in a variety of front-end development and QA automation tasks.

One of a set of tools we're offering as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This program is used to assist in finding and resolving common problems with wireless connections.
Why do some people recommend buying business VoIP from an ISP? What are the benefits to my company? What are the costs?
In this tutorial you'll learn about bandwidth monitoring with flows and packet sniffing with our network monitoring solution PRTG Network Monitor (https://www.paessler.com/prtg). If you're interested in additional methods for monitoring bandwidt…
If you're a developer or IT admin, you’re probably tasked with managing multiple websites, servers, applications, and levels of security on a daily basis. While this can be extremely time consuming, it can also be frustrating when systems aren't wor…

609 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question