Solved

multiple concurrent connections

Posted on 2011-09-21
6
345 Views
Last Modified: 2012-05-12
When transferring with the ftp protocol, why is downloading multiple files, faster than downloading a singe file. What is this limitation called and is it possible to change it? Is it caused by TCP windowing?

Example:

Downloading one 4.7GB file transfers at 1.2MB per second

Downloading twenty 40 meg files transfers at 48MB per second
0
Comment
Question by:stratech
6 Comments
 
LVL 4

Expert Comment

by:AnthonyHamon
ID: 36574277
I experienced a similar problem, which was caused by an incorrect speed/duplex setting between the FTP server and the switchport it connects to OR the FTP client and the switchport it connects to.  I suggest that you check this first.
0
 
LVL 16

Accepted Solution

by:
AlexPace earned 250 total points
ID: 36574325
Some FTP clients will automatically spawn additional FTP sessions when you initiate a multi-file download.  This is great if the bandwidth of each single connection is throttled and also if the remote server is configured to support it.

These clients may report the aggregate data transferred as a single large rate instead of 20 smaller rates.  Also, if the client is using inline compression, remember that some types of files are more compressible than others... for example image formats that are already compressed won't compress as well as plain text log files.  The FTP client will almost certainly claim the rate of the inflated file rather than the number of compressed bytes actually transferred over the wire.
0
 
LVL 12

Expert Comment

by:Rant32
ID: 36574351
Sounds to me like per-connection rate limiting at the end of the FTP server (or even a client setting, if you're using a graphical FTP client).

If your connection can handle 48 MB/s then there is no other obvious reason for a single transfer to be that much slower.
0
New My Cloud Pro Series - organize everything!

With space to keep virtually everything, the My Cloud Pro Series offers your team the network storage to edit, save and share production files from anywhere with an internet connection. Compatible with both Mac and PC, you're able to protect your content regardless of OS.

 

Author Comment

by:stratech
ID: 36574813
Both endpoints have no firewall. The switching has no QOS enabled. Do most ISP's use rate limiting to control saturation? This is something I've observed in every situation were I have allot of bandwidth.
0
 
LVL 16

Expert Comment

by:AlexPace
ID: 36576613
Some ISPs promote the "peak" bandwidth but that is only available for short bursts and long transfers are throttled.  If you really MUST know what is happing and your FTP client software does not produce a sufficient log file then you could use a packet sniffer like WireShark to see if the FTP client is actually opening multiple parallel sessions.
0
 

Author Comment

by:stratech
ID: 36583782
I know what is happening to my FTP client... Its being rate limited per connection. If I use an FTP client that makes multiple connections it bypasses the rate limiting... I am interested in not being rate limited. Would MPLS help me with this situation (If I own both endpoints?)
0

Featured Post

Maximize Your Threat Intelligence Reporting

Reporting is one of the most important and least talked about aspects of a world-class threat intelligence program. Here’s how to do it right.

Join & Write a Comment

This article is in response to a question (http://www.experts-exchange.com/Networking/Network_Management/Network_Analysis/Q_28230497.html) here at Experts Exchange. The Original Poster (OP) requires a utility that will accept a list of IP addresses …
Is your computer hacked? learn how to detect and delete malware in your PC
Here's a very brief overview of the methods PRTG Network Monitor (https://www.paessler.com/prtg) offers for monitoring bandwidth, to help you decide which methods you´d like to investigate in more detail.  The methods are covered in more detail in o…
This video gives you a great overview about bandwidth monitoring with SNMP and WMI with our network monitoring solution PRTG Network Monitor (https://www.paessler.com/prtg). If you're looking for how to monitor bandwidth using netflow or packet s…

747 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now