How to restrict download bandwidth by host

Posted on 2014-12-15
Medium Priority
Last Modified: 2014-12-23
I have a Linux host that is used as a remote backup computer. The connection has a 25mbps download bandwidth. The problem is that the remote download is using up the whole bandwidth and no one else in the office can use the Internet. The remote Linux computer is doing rsync with -bwlimit=8000, but that appears to not always work. Also, if more than one backup is downloading from that same host, the bwlimit ends up being the aggregate.

Is there a way on the receiving end to limit bandwidth from remote hosts? I'll consider a hardware solution, but since we're about to put a Linux/iptables firewall in front of all LAN hosts, a Linux software solution would be preferable.

In any case, it would be nice to have this tunable so that bandwidth could be unlimited during weekends and non-business hours, but throttled to under 10mbps during the day.
Question by:jmarkfoley
  • 2
  • 2
LVL 32

Expert Comment

ID: 40502602
Have you tried kicking off the backups during the off hours?

What type of network equipment is deployed at both sites? Vendor, model?

harbor235 ;}
LVL 39

Assisted Solution

by:Aaron Tomosky
Aaron Tomosky earned 2000 total points
ID: 40503493
trickle will do what you are asking for

That said, the better way to do this is traffic shaping. Depending on your routing gear, this is basically done by applying a low priority to either rsync traffic, or any traffic to that host. Sometimes this can be done with a minimum guaranteed bandwidth and a maximum bandwidth. That way the rsync traffic can use the full pipe if it's not being used for anything else, but it will slow down when other traffic is going on.

Accepted Solution

jmarkfoley earned 0 total points
ID: 40507793
harbor235: > Have you tried kicking off the backups during the off hours?

Unfortunately, the backups can actually run several days.

Aaron Tomosky: > trickle will do what you are asking for

Trickle looks interesting, but it works on the program, in my case rsync on the source computer. That doesn't really help because if more than one of these programs are running the bandwidth is aggregated. rsync does have a -bwlimit parameter, but if I set that to e.g. 8000, and 2 of these programs start running, the effective upload rate becomes 1600. However, that trickle link let me to a link for wondershaper http://www.hecticgeek.com/2012/02/simple-traffic-shaping-ubuntu-linux/ which uses `tc`. I am using tc now and it is working, sort of. Now I'm getting too much restriction. If anyone what's to look at that issue I've posted a new question: http://www.experts-exchange.com/Networking/Linux_Networking/Q_28583249.html

Author Closing Comment

ID: 40514558
Thanks for the link that led to the link that led to solution
LVL 39

Expert Comment

by:Aaron Tomosky
ID: 40515014
Do you have smart or managed switches? If so, try setting the qos on the port the backup server is on.

Featured Post

Turn Raw Data into a Real Career

There’s a growing demand for qualified analysts who can make sense of Big Data. With an MS in Data Analytics, you can become the data mining, management, mapping, and munging expert that today’s leading corporations desperately need.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

Join & Write a Comment

During and after that shift to cloud, one area that still poses a struggle for many organizations is what to do with their department file shares.
This article will show how Aten was able to supply easy management and control for Artear's video walls and wide range display configurations of their newsroom.
In this tutorial you'll learn about bandwidth monitoring with flows and packet sniffing with our network monitoring solution PRTG Network Monitor (https://www.paessler.com/prtg). If you're interested in additional methods for monitoring bandwidt…
Michael from AdRem Software explains how to view the most utilized and worst performing nodes in your network, by accessing the Top Charts view in NetCrunch network monitor (https://www.adremsoft.com/). Top Charts is a view in which you can set seve…

597 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question