Advertisement

02.18.2008 at 05:59AM PST, ID: 23171257
[x]
Attachment Details

RSYNC causing high load on remote server, how can I reduce this?

Asked by intechfs in Linux Administration, Linux Programming, Linux Networking

Tags: , ,

We have a number of servers using rsync 2.6.6 to send data to a remote location.  We use the following cmd to execute the sync:
rsync -avzW --progress --stats --delete -e "ssh -i /root/rsync/rsync-key" /home/* xx@xxx.xxx.xxx.xxx:/home/1/

When we have 10+ running at the same time load begins to get very high (11.49, 10.75, 9.12)

The local data we are syncing is static and is output in a time/date format, so rsync is possibly overkill for our needs, as we do not need the deltablock xfer.
I have heard that other methods of transfer  can be used with rsync (RCP?) to reduce load.

Could anyone offer some advice as to how i might do this?

thanks in advance!Start Free Trial
 
Keywords: RSYNC causing high load on remote se…
Title
1 Rsync problem
2 Using Rsync for Automated Backups …
3 RSYNC
4 Need a script to continuously sync file…
5 RSYNC exclude option problem
6 delta copy for rsync
 
Loading Advertisement...
 
[+][-]02.18.2008 at 07:20AM PST, ID: 20920547

At Experts Exchange, members can ask their questions to thousands of technology professionals, also known as Experts. Experts compete and collaborate to answer those questions by leaving comments like this one.

Start your 7-day free trial to view this Expert Comment or ask the Experts your question.

 
[+][-]02.18.2008 at 07:39AM PST, ID: 20920748

Often, when Experts are collaborating with members who have asked questions, they will request additional information about the problem. Askers respond with an author comment like this one.

Start your 7-day free trial to view this Author Comment or ask the Experts your question.

 
[+][-]02.18.2008 at 02:32PM PST, ID: 20924161

View this solution now by starting your 7-day free trial. Setting up your free trial is quick, easy, and secure. We will return you to this solution, unlocked, when you're done.

 

About this solution

Zones: Linux Administration, Linux Programming, Linux Networking
Tags: suse 10, rsync, 2.6.6
Sign Up Now!
Solution Provided By: rokov
Participating Experts: 2
Solution Grade: A
 
 
[+][-]02.18.2008 at 05:27PM PST, ID: 20924975

At Experts Exchange, members can ask their questions to thousands of technology professionals, also known as Experts. Experts compete and collaborate to answer those questions by leaving comments like this one.

Start your 7-day free trial to view this Expert Comment or ask the Experts your question.

 
 
Loading Advertisement...
20080716-EE-VQP-32 / EE_QW_2_20070628