Solved

Rsync local then move dataset offsite.

Posted on 2010-09-06
7
431 Views
Last Modified: 2012-05-10
Hello experts,

Not sure I worded the title correctly but here's what I'm looking to do.

I need to Rsync a couple of our offices back to our main office. All of the offices are running a mixture of windows server 2003/2008.

However the satellite offices house upwards of 100+gigs each, and would take far too long to do over the internet.

How would I rsync to a local USB drive onsite then take it back to our main office to copy to the nas and then set the remote offices to do incremental backups nightly?
0
Comment
Question by:kinetik20
7 Comments
 
LVL 77

Accepted Solution

by:
arnold earned 167 total points
ID: 33614051
Does the 100+GIG at each satellite location mean that there are duplicate files  or these 100+Gig unique?

The amount of data makes things complicated.  You could run a full backup to an external USB drive and then configure the incremental to the main office.
The main difficulty would be that while you have the backup on remote, the restore from remote will take a long time.

Are all the 100 GB active or are some of the files are archived.

0
 
LVL 4

Author Comment

by:kinetik20
ID: 33614356
They're all unique CAD drawings at each office. Restore time is not a problem as I can just drive the backup to them.

In my mind I see this happening like this.

For the initial backup I drive to the remote offices and do backup onsite an external hard drive.

I bring the hard drive back to the main office and dump it into the NAS.

The remote office is then setup to Rsync over SSH to the NAS incrementally nightly. Maybe 50-100MB of changes nightly.

I've got everything figured out with the exception of how to do the dump onsite at the remote office. Does Rsync need some kind of file list or can I just copy/paste the files to the external drive and rsync will just recognize the data when it goes to do its first backup?
0
 
LVL 4

Author Comment

by:kinetik20
ID: 33614362
I forgot to mention that a lot of the data is archived / or just used for reference so the data being added/changed nightly is small.
0
VMware Disaster Recovery and Data Protection

In this expert guide, you’ll learn about the components of a Modern Data Center. You will use cases for the value-added capabilities of Veeam®, including combining backup and replication for VMware disaster recovery and using replication for data center migration.

 
LVL 21

Assisted Solution

by:robocat
robocat earned 166 total points
ID: 33615574

>Does Rsync need some kind of file list or can I just copy/paste the files to the external drive and rsync will just recognize the data when it goes to do its first backup?

Rsync is kind of stupid at this, it has no concept of a backup database. It builds the full file list from the source and destination directories each time it is run.

So if you rsync A -> B and B->C, then A->C will work without any extra configuration.
0
 
LVL 77

Expert Comment

by:arnold
ID: 33617228

http://samba.anu.edu.au/rsync/how-rsync-works.html

Have you looked at/considered setting up a DFS/with DFS replication (requires win2k3 R2 or newer) share such that newly added documents at the satelite will automatically be sent up to the main office in a HUB/spoke central record.  You could also configure the push of those files to the the other locations. i.e. Office A adds a document and gets pushed up to Main office and then pushed down to the other offices b,c,d,e,etc.


0
 
LVL 12

Assisted Solution

by:mccracky
mccracky earned 167 total points
ID: 33631616
It will work without any problems.  Just as robocat said.

1. Copy the files to the external disk.
2. Copy from the external disk to the NAS (using the same tree/folder structure thoughout)
3. Rsync the remote office using the base directory of that office on the NAS.
0
 
LVL 4

Author Closing Comment

by:kinetik20
ID: 33931312
Thank you all for your help on this!
0

Featured Post

Zoho SalesIQ

Hassle-free live chat software re-imagined for business growth. 2 users, always free.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

How to update Firmware and Bios in Dell Equalogic PS6000 Arrays and Hard Disks firmware update.
Microservice architecture adoption brings many advantages, but can add intricacy. Selecting the right orchestration tool is most important for business specific needs.
Learn how to find files with the shell using the find and locate commands. Use locate to find a needle in a haystack.: With locate, check if the file still exists.: Use find to get the actual location of the file.:
This tutorial will walk an individual through setting the global and backup job media overwrite and protection periods in Backup Exec 2012. Log onto the Backup Exec Central Administration Server. Examine the services. If all or most of them are stop…

895 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

15 Experts available now in Live!

Get 1:1 Help Now