multiple concurrent connections

When transferring with the ftp protocol, why is downloading multiple files, faster than downloading a singe file. What is this limitation called and is it possible to change it? Is it caused by TCP windowing?

Example:

Downloading one 4.7GB file transfers at 1.2MB per second

Downloading twenty 40 meg files transfers at 48MB per second
stratechAsked:
Who is Participating?
 
AlexPaceConnect With a Mentor Commented:
Some FTP clients will automatically spawn additional FTP sessions when you initiate a multi-file download.  This is great if the bandwidth of each single connection is throttled and also if the remote server is configured to support it.

These clients may report the aggregate data transferred as a single large rate instead of 20 smaller rates.  Also, if the client is using inline compression, remember that some types of files are more compressible than others... for example image formats that are already compressed won't compress as well as plain text log files.  The FTP client will almost certainly claim the rate of the inflated file rather than the number of compressed bytes actually transferred over the wire.
0
 
AnthonyHamonCommented:
I experienced a similar problem, which was caused by an incorrect speed/duplex setting between the FTP server and the switchport it connects to OR the FTP client and the switchport it connects to.  I suggest that you check this first.
0
 
Rant32Commented:
Sounds to me like per-connection rate limiting at the end of the FTP server (or even a client setting, if you're using a graphical FTP client).

If your connection can handle 48 MB/s then there is no other obvious reason for a single transfer to be that much slower.
0
Improve Your Query Performance Tuning

In this FREE six-day email course, you'll learn from Janis Griffin, Database Performance Evangelist. She'll teach 12 steps that you can use to optimize your queries as much as possible and see measurable results in your work. Get started today!

 
stratechAuthor Commented:
Both endpoints have no firewall. The switching has no QOS enabled. Do most ISP's use rate limiting to control saturation? This is something I've observed in every situation were I have allot of bandwidth.
0
 
AlexPaceCommented:
Some ISPs promote the "peak" bandwidth but that is only available for short bursts and long transfers are throttled.  If you really MUST know what is happing and your FTP client software does not produce a sufficient log file then you could use a packet sniffer like WireShark to see if the FTP client is actually opening multiple parallel sessions.
0
 
stratechAuthor Commented:
I know what is happening to my FTP client... Its being rate limited per connection. If I use an FTP client that makes multiple connections it bypasses the rate limiting... I am interested in not being rate limited. Would MPLS help me with this situation (If I own both endpoints?)
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.