Solved

multiple concurrent connections

Posted on 2011-09-21
6
347 Views
Last Modified: 2012-05-12
When transferring with the ftp protocol, why is downloading multiple files, faster than downloading a singe file. What is this limitation called and is it possible to change it? Is it caused by TCP windowing?

Example:

Downloading one 4.7GB file transfers at 1.2MB per second

Downloading twenty 40 meg files transfers at 48MB per second
0
Comment
Question by:stratech
6 Comments
 
LVL 4

Expert Comment

by:AnthonyHamon
ID: 36574277
I experienced a similar problem, which was caused by an incorrect speed/duplex setting between the FTP server and the switchport it connects to OR the FTP client and the switchport it connects to.  I suggest that you check this first.
0
 
LVL 16

Accepted Solution

by:
AlexPace earned 250 total points
ID: 36574325
Some FTP clients will automatically spawn additional FTP sessions when you initiate a multi-file download.  This is great if the bandwidth of each single connection is throttled and also if the remote server is configured to support it.

These clients may report the aggregate data transferred as a single large rate instead of 20 smaller rates.  Also, if the client is using inline compression, remember that some types of files are more compressible than others... for example image formats that are already compressed won't compress as well as plain text log files.  The FTP client will almost certainly claim the rate of the inflated file rather than the number of compressed bytes actually transferred over the wire.
0
 
LVL 12

Expert Comment

by:Rant32
ID: 36574351
Sounds to me like per-connection rate limiting at the end of the FTP server (or even a client setting, if you're using a graphical FTP client).

If your connection can handle 48 MB/s then there is no other obvious reason for a single transfer to be that much slower.
0
PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

 

Author Comment

by:stratech
ID: 36574813
Both endpoints have no firewall. The switching has no QOS enabled. Do most ISP's use rate limiting to control saturation? This is something I've observed in every situation were I have allot of bandwidth.
0
 
LVL 16

Expert Comment

by:AlexPace
ID: 36576613
Some ISPs promote the "peak" bandwidth but that is only available for short bursts and long transfers are throttled.  If you really MUST know what is happing and your FTP client software does not produce a sufficient log file then you could use a packet sniffer like WireShark to see if the FTP client is actually opening multiple parallel sessions.
0
 

Author Comment

by:stratech
ID: 36583782
I know what is happening to my FTP client... Its being rate limited per connection. If I use an FTP client that makes multiple connections it bypasses the rate limiting... I am interested in not being rate limited. Would MPLS help me with this situation (If I own both endpoints?)
0

Featured Post

DevOps Toolchain Recommendations

Read this Gartner Research Note and discover how your IT organization can automate and optimize DevOps processes using a toolchain architecture.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Stuck in INIT/DROTHER 2 23
extend vlan through a layer 3 connection 31 145
Layer 2 versus layer 3 10 87
IP cameras - are they always consuming bandwidth? 3 82
Join Greg Farro and Ethan Banks from Packet Pushers (http://packetpushers.net/podcast/podcasts/pq-show-93-smart-network-monitoring-paessler-sponsored/) and Greg Ross from Paessler (https://www.paessler.com/prtg) for a discussion about smart network …
PRTG Network Monitor lets you monitor your bandwidth usage, so you know who is using up your bandwidth, and what they're using it for.
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…

770 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question