Solved

Need to reduce CPU load when running rdiff on Linux

Posted on 2008-10-08
5
408 Views
Last Modified: 2013-12-16
Hi All:

I have two high end server one running web and another running database server.

It is a high traffic web site and with high disk usage contents e.g. video etc.

When rdiff runs the web server stalls and database server also stalls.

Top command shows high CPU and memory usage. I guess the problem is with rdiff.

Please advise as to how I can resolve this problem and have web site running while backup is done through rdiff.

Thanks for your help.

Regards

-sunnybrad
0
Comment
Question by:sunnybrad
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
5 Comments
 
LVL 4

Accepted Solution

by:
tjilp earned 500 total points
ID: 22667117
Hello,

Did you consider giving the process a lower priority with nice ?

Tjilp
0
 

Author Comment

by:sunnybrad
ID: 22669820
Hi:

I'll try that. Please let me know ways to backup without being CPU intensive on the server side.

Regards

-Gyan
0
 
LVL 40

Expert Comment

by:noci
ID: 22673794
The problem is you trade CPU time for Bandwith,
In stead of using checksums you might wan't to disable calculating checksums
Then only the files mtime/and size difference will cause it to be transferred.

The checksumming is MORE precise as it is content based, but the
mtime/size check might be sufficient.
0
 
LVL 40

Expert Comment

by:noci
ID: 22673916
hm.. didn't actualy read the rdiff, it seems rather limited.
using gzip might increase speed and decrease cpu load, as bzip2 is more heavy weight.

using rsync to transfer the backup to some other place and only mode the data changed might be faster by excluding the checksumming  (not include -c option, just time and /or size).
0
 
LVL 6

Expert Comment

by:Mehuge
ID: 22710029
Are you using rdiff-backup?

Limiting the bandwidth used would reduce the load on both servers. However it will increase the time it takes to complete the backup.

http://www.nongnu.org/rdiff-backup/FAQ.html#bwlimit

0

Featured Post

Moving data to the cloud? Find out if you’re ready

Before moving to the cloud, it is important to carefully define your db needs, plan for the migration & understand prod. environment. This wp explains how to define what you need from a cloud provider, plan for the migration & what putting a cloud solution into practice entails.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

When it comes to showing a 404 error page to your visitors, you do not want that generic page to show, and you especially do not want your hosting provider’s ad error page to show either. In this article, I will show you how to enable the custom 40…
In part one, we reviewed the prerequisites required for installing SQL Server vNext. In this part we will explore how to install Microsoft's SQL Server on Ubuntu 16.04.
Connecting to an Amazon Linux EC2 Instance from Windows Using PuTTY.
This demo shows you how to set up the containerized NetScaler CPX with NetScaler Management and Analytics System in a non-routable Mesos/Marathon environment for use with Micro-Services applications.
Suggested Courses

630 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question