rsync

I think i'm doing something wrong with rsync - i wanted to run rsync to do a full backup then just backup the files that have changed - i found that rsync -av wasn't working for me so i tried rsync -rlpt last night, then tried it again but it's taking as long as yesterday. which can't be right, i did a ls -alt on the directory i'm backing up before i ran rsync and only a few files and directories changed since yesterday, so the backup should be much faster. is there some other way to run rsync
LVL 1
JeffBeallAsked:
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

x
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

wesly_chenCommented:
I use -auv
-u skip files that are newer on the receiver

By the way, -a include -l and -t, so -alt is the same as -a.
0
farzanjCommented:
Also use -z to compress the tranmission

rsync -auz
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
JeffBeallAuthor Commented:
i looked at the man page for rsync and -a is like -rlptgoD but i can't use oD, so shouldn't
rsync -rlptguz
do essitially the same as
rsync -auz
without the oD of course
one other thing that seems strange is i'm doing a du -s on the target pc and the directory got larger for a bit, then shrank.
another thing i just thought i should mention i'm backing up from a hpux box to a linux box - would that affect rsync?
0
Protecting & Securing Your Critical Data

Considering 93 percent of companies file for bankruptcy within 12 months of a disaster that blocked access to their data for 10 days or more, planning for the worst is just smart business. Learn how Acronis Backup integrates security at every stage

TintinCommented:
Run it again with

rsync -av --stats .....

The --stats option gives you useful information as to the number of files transferred, the amount of data etc.
0
wesly_chenCommented:
do not use -z unless you have very slow network between two hosts (over the internet).
It will slow down the process..
0
JeffBeallAuthor Commented:
ok, I CAN'T use rsync -av - I have to use rsync -rlpt , i did also run --stat and this is what it came up with

number of files: 15921
number of files transfered: 398
total file size 16650797862 bytes
total transferred file size: 10579788509 bytes
literal data: 10579793629 bytes
matched data: 0 bytes
file list size: 325233
files list generation time: 0.001 seconds
files list transfer time: 0.000 seconds
total bytes sent: 10581427274
total bytes received: 7952

sent 10581427247 bytes  received 7952  2582412.50 bytes/sec
total size is 16650797862  speedup is 1.57

from the stats i get the impression that rsync spends a lot of time analyzing files, looking at the status - would there be a way to speed up rsync? i think it takes about an hour and 1/2 to run.  when i did a ls of the directory i'm backing up, not a lot of files are changing, so i thought the backup would be like 20 minutes.
0
wesly_chenCommented:
Well. you have 1/4 of files be rsynced (398/15921). But the transfered file size is 2/3 (10.5GB/16GB).
In other words, there are a lot of modified files are big-sized files. aren't they?
Transfer speed is 2.58Mb/s is not bad.

If you use NFS mount HPUX disk on Linux, please post the NFS mount option?
mount
0
mccrackyCommented:
@wesly_chen - actually it's not 1/4, but 1/40 (.025) as the number of files, but it just reinforces your statement that it is the size of the changed files and not the number of files.

I've seen some speedup in other situations when we use the rsync client/server setup rather than nfs.  See: http://everythinglinux.org/rsync/
0
JeffBeallAuthor Commented:
thank you.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Linux

From novice to tech pro — start learning today.