Solved

Need to reduce CPU load when running rdiff on Linux

Posted on 2008-10-08
5
398 Views
Last Modified: 2013-12-16
Hi All:

I have two high end server one running web and another running database server.

It is a high traffic web site and with high disk usage contents e.g. video etc.

When rdiff runs the web server stalls and database server also stalls.

Top command shows high CPU and memory usage. I guess the problem is with rdiff.

Please advise as to how I can resolve this problem and have web site running while backup is done through rdiff.

Thanks for your help.

Regards

-sunnybrad
0
Comment
Question by:sunnybrad
5 Comments
 
LVL 4

Accepted Solution

by:
tjilp earned 500 total points
ID: 22667117
Hello,

Did you consider giving the process a lower priority with nice ?

Tjilp
0
 

Author Comment

by:sunnybrad
ID: 22669820
Hi:

I'll try that. Please let me know ways to backup without being CPU intensive on the server side.

Regards

-Gyan
0
 
LVL 40

Expert Comment

by:noci
ID: 22673794
The problem is you trade CPU time for Bandwith,
In stead of using checksums you might wan't to disable calculating checksums
Then only the files mtime/and size difference will cause it to be transferred.

The checksumming is MORE precise as it is content based, but the
mtime/size check might be sufficient.
0
 
LVL 40

Expert Comment

by:noci
ID: 22673916
hm.. didn't actualy read the rdiff, it seems rather limited.
using gzip might increase speed and decrease cpu load, as bzip2 is more heavy weight.

using rsync to transfer the backup to some other place and only mode the data changed might be faster by excluding the checksumming  (not include -c option, just time and /or size).
0
 
LVL 6

Expert Comment

by:Mehuge
ID: 22710029
Are you using rdiff-backup?

Limiting the bandwidth used would reduce the load on both servers. However it will increase the time it takes to complete the backup.

http://www.nongnu.org/rdiff-backup/FAQ.html#bwlimit

0

Featured Post

Enterprise Mobility and BYOD For Dummies

Like “For Dummies” books, you can read this in whatever order you choose and learn about mobility and BYOD; and how to put a competitive mobile infrastructure in place. Developed for SMBs and large enterprises alike, you will find helpful use cases, planning, and implementation.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Linux users are sometimes dumbfounded by the severe lack of documentation on a topic. Sometimes, the documentation is copious, but other times, you end up with some obscure "it varies depending on your distribution" over and over when searching for …
Fine Tune your automatic Updates for Ubuntu / Debian
Learn several ways to interact with files and get file information from the bash shell. ls lists the contents of a directory: Using the -a flag displays hidden files: Using the -l flag formats the output in a long list: The file command gives us mor…
Connecting to an Amazon Linux EC2 Instance from Windows Using PuTTY.

809 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question