Solved

multiple concurrent connections

Posted on 2011-09-21
6
346 Views
Last Modified: 2012-05-12
When transferring with the ftp protocol, why is downloading multiple files, faster than downloading a singe file. What is this limitation called and is it possible to change it? Is it caused by TCP windowing?

Example:

Downloading one 4.7GB file transfers at 1.2MB per second

Downloading twenty 40 meg files transfers at 48MB per second
0
Comment
Question by:stratech
6 Comments
 
LVL 4

Expert Comment

by:AnthonyHamon
ID: 36574277
I experienced a similar problem, which was caused by an incorrect speed/duplex setting between the FTP server and the switchport it connects to OR the FTP client and the switchport it connects to.  I suggest that you check this first.
0
 
LVL 16

Accepted Solution

by:
AlexPace earned 250 total points
ID: 36574325
Some FTP clients will automatically spawn additional FTP sessions when you initiate a multi-file download.  This is great if the bandwidth of each single connection is throttled and also if the remote server is configured to support it.

These clients may report the aggregate data transferred as a single large rate instead of 20 smaller rates.  Also, if the client is using inline compression, remember that some types of files are more compressible than others... for example image formats that are already compressed won't compress as well as plain text log files.  The FTP client will almost certainly claim the rate of the inflated file rather than the number of compressed bytes actually transferred over the wire.
0
 
LVL 12

Expert Comment

by:Rant32
ID: 36574351
Sounds to me like per-connection rate limiting at the end of the FTP server (or even a client setting, if you're using a graphical FTP client).

If your connection can handle 48 MB/s then there is no other obvious reason for a single transfer to be that much slower.
0
New My Cloud Pro Series - organize everything!

With space to keep virtually everything, the My Cloud Pro Series offers your team the network storage to edit, save and share production files from anywhere with an internet connection. Compatible with both Mac and PC, you're able to protect your content regardless of OS.

 

Author Comment

by:stratech
ID: 36574813
Both endpoints have no firewall. The switching has no QOS enabled. Do most ISP's use rate limiting to control saturation? This is something I've observed in every situation were I have allot of bandwidth.
0
 
LVL 16

Expert Comment

by:AlexPace
ID: 36576613
Some ISPs promote the "peak" bandwidth but that is only available for short bursts and long transfers are throttled.  If you really MUST know what is happing and your FTP client software does not produce a sufficient log file then you could use a packet sniffer like WireShark to see if the FTP client is actually opening multiple parallel sessions.
0
 

Author Comment

by:stratech
ID: 36583782
I know what is happening to my FTP client... Its being rate limited per connection. If I use an FTP client that makes multiple connections it bypasses the rate limiting... I am interested in not being rate limited. Would MPLS help me with this situation (If I own both endpoints?)
0

Featured Post

Network it in WD Red

There's an industry-leading WD Red drive for every compatible NAS system to help fulfill your data storage needs. With drives up to 8TB, WD Red offers a wide array of solutions for customers looking to build the biggest, best-performing NAS storage solution.  

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

So, you're experiencing issues on your network and you've decided that you need to perform some tests to determine whether your cabling is good.  You're likely thinking that you may need to spend money which you probably don't have on hiring/purchas…
Creating an OSPF network that automatically (dynamically) reroutes network traffic over other connections to prevent network downtime.
Viewers will learn how to properly install and use Secure Shell (SSH) to work on projects or homework remotely. Download Secure Shell: Follow basic installation instructions: Open Secure Shell and use "Quick Connect" to enter credentials includi…
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…

920 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

13 Experts available now in Live!

Get 1:1 Help Now