Solved

Need to reduce CPU load when running rdiff on Linux

Posted on 2008-10-08
5
395 Views
Last Modified: 2013-12-16
Hi All:

I have two high end server one running web and another running database server.

It is a high traffic web site and with high disk usage contents e.g. video etc.

When rdiff runs the web server stalls and database server also stalls.

Top command shows high CPU and memory usage. I guess the problem is with rdiff.

Please advise as to how I can resolve this problem and have web site running while backup is done through rdiff.

Thanks for your help.

Regards

-sunnybrad
0
Comment
Question by:sunnybrad
5 Comments
 
LVL 4

Accepted Solution

by:
tjilp earned 500 total points
ID: 22667117
Hello,

Did you consider giving the process a lower priority with nice ?

Tjilp
0
 

Author Comment

by:sunnybrad
ID: 22669820
Hi:

I'll try that. Please let me know ways to backup without being CPU intensive on the server side.

Regards

-Gyan
0
 
LVL 40

Expert Comment

by:noci
ID: 22673794
The problem is you trade CPU time for Bandwith,
In stead of using checksums you might wan't to disable calculating checksums
Then only the files mtime/and size difference will cause it to be transferred.

The checksumming is MORE precise as it is content based, but the
mtime/size check might be sufficient.
0
 
LVL 40

Expert Comment

by:noci
ID: 22673916
hm.. didn't actualy read the rdiff, it seems rather limited.
using gzip might increase speed and decrease cpu load, as bzip2 is more heavy weight.

using rsync to transfer the backup to some other place and only mode the data changed might be faster by excluding the checksumming  (not include -c option, just time and /or size).
0
 
LVL 6

Expert Comment

by:Mehuge
ID: 22710029
Are you using rdiff-backup?

Limiting the bandwidth used would reduce the load on both servers. However it will increase the time it takes to complete the backup.

http://www.nongnu.org/rdiff-backup/FAQ.html#bwlimit

0

Featured Post

Control application downtime with dependency maps

Visualize the interdependencies between application components better with Applications Manager's automated application discovery and dependency mapping feature. Resolve performance issues faster by quickly isolating problematic components.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

In Solr 4.0 it is possible to atomically (or partially) update individual fields in a document. This article will show the operations possible for atomic updating as well as setting up your Solr instance to be able to perform the actions. One major …
Introduction This article explores the design of a cache system that can improve the performance of a web site or web application.  The assumption is that the web site has many more “read” operations than “write” operations (this is commonly the ca…
Learn how to navigate the file tree with the shell. Use pwd to print the current working directory: Use ls to list a directory's contents: Use cd to change to a new directory: Use wildcards instead of typing out long directory names: Use ../ to move…
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.

929 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

8 Experts available now in Live!

Get 1:1 Help Now