Sync / backup large data over private network

We have a VPN connection to our other facility and need to be able to transfer differential data over the link.
Right now we're using Rsync, but I would like a method that would eliminate the encryption of the transfer so we can speed this up a bit.
Right now we're using the arcfour encryption and getting slightly faster results then we were with blowfish.

How can I eliminate this all together, but still have the sweet advantages of Rsync?
Both hosts are linux based.
spiz79Asked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

IanThCommented:
do you still want encription ?
0
legolasthehansyCommented:
Try this
rsync -rvlpogt /host /destination --progress

-r - recursive
v - verbose
l - copy symlinks
p - preserve permissions
o - preserve owner name
g - preserve group name
t - preserve time stamp
0
spiz79Author Commented:
No I still do not want encryption. This is over a private network (VPN) so encryption isn't needed.

right now this is what I'm doing

rsync -ae "ssh -c arcfour" root@192.168.1.2:/backup/VM /backup --progress -z
0
Ultimate Tool Kit for Technology Solution Provider

Broken down into practical pointers and step-by-step instructions, the IT Service Excellence Tool Kit delivers expert advice for technology solution providers. Get your free copy now.

legolasthehansyCommented:
Remove the -z
This speeds up the transfer in most cases.
0
ChrisCommented:
have a look at that - silly to encrypt over a VPN that is already encrypted

Secure Network Transfers

Set the -e option of rsync to use ssh instead of rsh when copying to a remote system. Modern versions of rsync use ssh by default. While ssh is slower than rsh, the data being transfered will be encrypted, and therefore less likely to be maliciously read or altered, or randomly corrupted in transit.

$ rsync -e 'ssh -ax' -avz example.org:/tmp .

If speed is a concern, use a weaker encryption option to ssh.

$ rsync -e 'ssh -ax -c blowfish' -avz example.org:/tmp .

The -ax options to ssh disable Secure Shell (SSH) agent and X11 forwarding, which are not needed by rsync. Also consider setting -o ClearAllForwardings to ssh, to prevent possible automatic port forwards. For more information on options to OpenSSH, peruse ssh(1) and ssh_config(5).

taken from http://72.14.189.113/howto/rsync/
0
spiz79Author Commented:
So rsync over RSH? how?
0
ChrisCommented:
by either using -e to specifiy no encryption or forcing rsh

http://okbanlon.com/notes/rsync.html - see halfway down for examples
0
spiz79Author Commented:
thanks for the reply..
this is what I'm currently using..I have -ae ..is that enough?

rsync -ae "ssh -c arcfour" root@192.168.1.2:/backup/VM /backup --progress -z
0
ChrisCommented:
try taking the e and ssh config element out of it - in that command you are specifying ssh and an algorithm
0
spiz79Author Commented:
rsync -a root@192.168.1.2:/backup/VM /backup --progress

That's what I'm using now and it actually appears to be moving slower.
0
ChrisCommented:
that is odd rsh should be faster than ssh
0
Aaron TomoskySD-WAN SimplifiedCommented:
You also dropped the compression which could be helping on a wan link. Add the -z back on and see if that helps
0
1ly4meCommented:
mount the remote backup folder locally (you can use samba or NFS) and take backup using tar.
You no need any encryption, Just tar the backup files and copy it to locally mounted backup location
0
spiz79Author Commented:
1ly4me
Would this have the same DIFF capabilities of rsync?
0
1ly4meCommented:
Do you mean differential backup?
Yes it works well.
To backup,
#rsync -trv /local/location  /mounted/location  > /mounted/location/rsync.log

Open in new window

for differential backup
#rsync -trv /local/location  /mounted/location  > /mounted/location/rsync_diff.log
You no need to specify any encryption option.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
spiz79Author Commented:
so ultimately your saying NFS / Samba will be faster then RSH?

thanks
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Linux Networking

From novice to tech pro — start learning today.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.