Solved

Rsync local then move dataset offsite.

Posted on 2010-09-06
7
439 Views
Last Modified: 2012-05-10
Hello experts,

Not sure I worded the title correctly but here's what I'm looking to do.

I need to Rsync a couple of our offices back to our main office. All of the offices are running a mixture of windows server 2003/2008.

However the satellite offices house upwards of 100+gigs each, and would take far too long to do over the internet.

How would I rsync to a local USB drive onsite then take it back to our main office to copy to the nas and then set the remote offices to do incremental backups nightly?
0
Comment
Question by:kinetik20
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
7 Comments
 
LVL 78

Accepted Solution

by:
arnold earned 167 total points
ID: 33614051
Does the 100+GIG at each satellite location mean that there are duplicate files  or these 100+Gig unique?

The amount of data makes things complicated.  You could run a full backup to an external USB drive and then configure the incremental to the main office.
The main difficulty would be that while you have the backup on remote, the restore from remote will take a long time.

Are all the 100 GB active or are some of the files are archived.

0
 
LVL 4

Author Comment

by:kinetik20
ID: 33614356
They're all unique CAD drawings at each office. Restore time is not a problem as I can just drive the backup to them.

In my mind I see this happening like this.

For the initial backup I drive to the remote offices and do backup onsite an external hard drive.

I bring the hard drive back to the main office and dump it into the NAS.

The remote office is then setup to Rsync over SSH to the NAS incrementally nightly. Maybe 50-100MB of changes nightly.

I've got everything figured out with the exception of how to do the dump onsite at the remote office. Does Rsync need some kind of file list or can I just copy/paste the files to the external drive and rsync will just recognize the data when it goes to do its first backup?
0
 
LVL 4

Author Comment

by:kinetik20
ID: 33614362
I forgot to mention that a lot of the data is archived / or just used for reference so the data being added/changed nightly is small.
0
DevOps Toolchain Recommendations

Read this Gartner Research Note and discover how your IT organization can automate and optimize DevOps processes using a toolchain architecture.

 
LVL 21

Assisted Solution

by:robocat
robocat earned 166 total points
ID: 33615574

>Does Rsync need some kind of file list or can I just copy/paste the files to the external drive and rsync will just recognize the data when it goes to do its first backup?

Rsync is kind of stupid at this, it has no concept of a backup database. It builds the full file list from the source and destination directories each time it is run.

So if you rsync A -> B and B->C, then A->C will work without any extra configuration.
0
 
LVL 78

Expert Comment

by:arnold
ID: 33617228

http://samba.anu.edu.au/rsync/how-rsync-works.html

Have you looked at/considered setting up a DFS/with DFS replication (requires win2k3 R2 or newer) share such that newly added documents at the satelite will automatically be sent up to the main office in a HUB/spoke central record.  You could also configure the push of those files to the the other locations. i.e. Office A adds a document and gets pushed up to Main office and then pushed down to the other offices b,c,d,e,etc.


0
 
LVL 12

Assisted Solution

by:mccracky
mccracky earned 167 total points
ID: 33631616
It will work without any problems.  Just as robocat said.

1. Copy the files to the external disk.
2. Copy from the external disk to the NAS (using the same tree/folder structure thoughout)
3. Rsync the remote office using the base directory of that office on the NAS.
0
 
LVL 4

Author Closing Comment

by:kinetik20
ID: 33931312
Thank you all for your help on this!
0

Featured Post

Ransomware: The New Cyber Threat & How to Stop It

This infographic explains ransomware, type of malware that blocks access to your files or your systems and holds them hostage until a ransom is paid. It also examines the different types of ransomware and explains what you can do to thwart this sinister online threat.  

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
How to set IPSec under Server 2008 R2 and Server 2012 R2 3 60
what do I need to host my own web sites? 13 67
Disabling security updates Ubuntu 3 46
RPM creation 6 23
This article is an update and follow-up of my previous article:   Storage 101: common concepts in the IT enterprise storage This time, I expand on more frequently used storage concepts.
Restoring deleted objects in Active Directory has been a standard feature in Active Directory for many years, yet some admins may not know what is available.
This tutorial will show how to configure a new Backup Exec 2012 server and move an existing database to that server with the use of the BEUtility. Install Backup Exec 2012 on the new server and apply all of the latest hotfixes and service packs. Theā€¦
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.

726 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question