Solved

multiple concurrent connections

Posted on 2011-09-21
6
351 Views
Last Modified: 2012-05-12
When transferring with the ftp protocol, why is downloading multiple files, faster than downloading a singe file. What is this limitation called and is it possible to change it? Is it caused by TCP windowing?

Example:

Downloading one 4.7GB file transfers at 1.2MB per second

Downloading twenty 40 meg files transfers at 48MB per second
0
Comment
Question by:stratech
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
6 Comments
 
LVL 4

Expert Comment

by:AnthonyHamon
ID: 36574277
I experienced a similar problem, which was caused by an incorrect speed/duplex setting between the FTP server and the switchport it connects to OR the FTP client and the switchport it connects to.  I suggest that you check this first.
0
 
LVL 16

Accepted Solution

by:
AlexPace earned 250 total points
ID: 36574325
Some FTP clients will automatically spawn additional FTP sessions when you initiate a multi-file download.  This is great if the bandwidth of each single connection is throttled and also if the remote server is configured to support it.

These clients may report the aggregate data transferred as a single large rate instead of 20 smaller rates.  Also, if the client is using inline compression, remember that some types of files are more compressible than others... for example image formats that are already compressed won't compress as well as plain text log files.  The FTP client will almost certainly claim the rate of the inflated file rather than the number of compressed bytes actually transferred over the wire.
0
 
LVL 12

Expert Comment

by:Rant32
ID: 36574351
Sounds to me like per-connection rate limiting at the end of the FTP server (or even a client setting, if you're using a graphical FTP client).

If your connection can handle 48 MB/s then there is no other obvious reason for a single transfer to be that much slower.
0
 Database Backup and Recovery Best Practices

Join Percona’s, Architect, Manjot Singh as he presents Database Backup and Recovery Best Practices (with a Focus on MySQL) on Thursday, July 27, 2017 at 11:00 am PDT / 2:00 pm EDT (UTC-7). In the case of a failure, do you know how long it will take to restore your database?

 

Author Comment

by:stratech
ID: 36574813
Both endpoints have no firewall. The switching has no QOS enabled. Do most ISP's use rate limiting to control saturation? This is something I've observed in every situation were I have allot of bandwidth.
0
 
LVL 16

Expert Comment

by:AlexPace
ID: 36576613
Some ISPs promote the "peak" bandwidth but that is only available for short bursts and long transfers are throttled.  If you really MUST know what is happing and your FTP client software does not produce a sufficient log file then you could use a packet sniffer like WireShark to see if the FTP client is actually opening multiple parallel sessions.
0
 

Author Comment

by:stratech
ID: 36583782
I know what is happening to my FTP client... Its being rate limited per connection. If I use an FTP client that makes multiple connections it bypasses the rate limiting... I am interested in not being rate limited. Would MPLS help me with this situation (If I own both endpoints?)
0

Featured Post

Instantly Create Instructional Tutorials

Contextual Guidance at the moment of need helps your employees adopt to new software or processes instantly. Boost knowledge retention and employee engagement step-by-step with one easy solution.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Sometimes you have to pull out old tricks to get a new firewall to work… While we were installing a new Sonicwall at a customers site we found that sites they were able to visit before were not working.  It seemed random and we could not understa…
Quality of Service (QoS) options are nearly endless when it comes to networks today. This article is merely one example of how it can be handled in a hub-n-spoke design using a 3-tier configuration.
In this brief tutorial Pawel from AdRem Software explains how you can quickly find out which services are running on your network, or what are the IP addresses of servers responsible for each service. Software used is freeware NetCrunch Tools (https…
Monitoring a network: how to monitor network services and why? Michael Kulchisky, MCSE, MCSA, MCP, VTSP, VSP, CCSP outlines the philosophy behind service monitoring and why a handshake validation is critical in network monitoring. Software utilized …

615 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question