budget archiving and backup with NAS

Posted on 2011-04-29
Medium Priority
Last Modified: 2012-05-11
I have a windows 2003 file server, Exchange 2003 server, SQL Servers all being backed up on tape.
The 500gb file server has reached its max. 4 Gen HP hardware, so there is no room to improve.
I also have a very limited buget.
I was thinking of adding a 8TB Iomega StorCenter Pro ix4-200d NAS to the network in the premise of archiving as much as possible from the file server and keep the file server for day to day operations.
I also have a problem of tape backups as they are currently taking two days, as they require two tapes. So I was also planning to back up the exchange server and sql servers onto that NAS too.
So i then have the problem of backing up the NAS itself . I have a premises about 500metres away which i am going to link to our main office network and I was going to add a 2nd 8TB NAS box for business continuity.
Is this a feasible scenario?  Has anyone done anything similar?
How would I rsync the two NAS boxes? Is there a best practice?
Thanks for any guidance.
Question by:seancoffey

Assisted Solution

Piloute earned 450 total points
ID: 35490651

Here's my grain of sand...

Used to work on networks where servers are tens or hundreds of km away from each other. So distance is not an issue as long as your hardware is made for it (check always the network support) and your network is reliable... In theory a 10 Base-5 segment can be 500 meters long.

I don't know that Iomega product you are talking about, but if it is a linux box, like most similar harware out there, you can happily go for a rsync of the two (I'd be surprized they don't implement such a useful tool).

So, yes, it is clearly feasible. And rsync is a powerful tool, allowing, amongst others, incremental syncs... Based on the amount of data you want to sync, you can use a chron job or some other scheduling tool to trigger a regular incremetal sync.


Expert Comment

ID: 35490675
Oh, and another point : what if your equipment is stolen ? Since your two offices are in the same location (500m is the same address for me), I'd make a really 'external' copy of my data, like a copy I can carry around (bring it home when you leave) or a sync with a distant location (other offices, an online storage provider, etc).

NEW Veeam Agent for Microsoft Windows

Backup and recover physical and cloud-based servers and workstations, as well as endpoint devices that belong to remote users. Avoid downtime and data loss quickly and easily for Windows-based physical or public cloud-based workloads!


Author Comment

ID: 35491240
thanks for that Piloute
I am reassured i am on right track but still need to know if anyone successfully tried it with these 8TB iomega nas boxes. I have one IOMEGA 1.4 TB NAS which allows "NAS server" to be enabled but I would need the process of safely setting the rsync up between the two 8TB Iomega NAS boxes(which i am thinking about getting).


Expert Comment

ID: 35492118
LVL 25

Accepted Solution

madunix earned 600 total points
ID: 35498209
NAS replication/mirroring/backup.   It depends a little on how 'real-time' you needs this versus if it is more for having a backup.

It will somewhat depend on your network and whose data it is. If it is the same companies data and there is a secure connection already and the data is not private then the data can be directly
backed up.

On non-private networks: VPN point to point is what I would suggest or ssh-agent tunnel

For the NAS method of backup/replication, it may depend on your NAS, which may have tools to auto-sync/replication or simple backup the other disk.

It sounds like you already have the NAS installed in both locations, so what are the manufacturer/models, some have built-in the ability.
The Unix way would be: rsync - more of a backup route over a tunnel (can simply use SSH with key setup)
      DRBD - http://www.drbd.org/

And Free NAS solutions:
      FreeNAS - http://freenas.org/FreeNAS (BSD based)
      OpenVault - http://blog.openmediavault.org (Debian based)
      OpenFiler - http://www.linux-mag.com/id/7785
I do sync task between 2xnas http://www.synology.com/us/products/DS411+II/index.php
I did the ssh keys for root users on both servers like this
mkdir ~/.ssh
chmod 755 ~/.ssh
/usr/bin/ssh-keygen -t rsa
/usr/bin/ssh-keygen -t dsa
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
ssh root@node2 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
ssh root@node2 cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
chmod 644 ~/.ssh/authorized_keys
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
ssh root@node1 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
ssh root@node1 cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
chmod 644 ~/.ssh/authorized_keys

$ ssh node2 date
$ ssh node1 date

#  [created  by madunix]
#  This script uses Rsync the backup files
#  to a remote server. To use this script
#  you first have to setup ssh to use keys.
#  This elimates the need for a password but
#  still provides security I have ssh on
#  a non standard port so I had to specify
#  the port (ssh -p 2998).
#  Simply change the variables list below
#  to match your specifications.
#  The Script also logs the transfer time.
#  For automated backup add script to crontab.
# Setup Variables
#The user you created with ssh_keys
STARTTIME=$(date +"%s")
# Verfiy the last rsync is not still running
if [ -f $LOCKFILE ]; then
ERRORTIME=$(date +"%d/%b/%Y:%H:%M:%S %Z")
echo "[$ERRORTIME] WARNING rsyncbackup.lock exists, aborting..." >> $LOGFILE
exit 1
# If it finished, create a new lock file
# The rsync command (for explanation type rsync --help)
rsync -a --delete --bwlimit=512 --rsh='ssh -p 2998' $SOURCEPATH $DESTUSER@$DESTHOST:$DESTPATH 2>&1 >> $LOGFILE
# Log when the script was run
DONE=$(date +"%d/%b/%Y:%H:%M:%S %Z")
# Log how long it took the script to run
STOPTIME=$(date +"%s")
echo "[$DONE]finished: - Tranfer took:$(((SECONDS/60)/60)) hours $(((SECONDS/60)%60)) minutes $((SECONDS%60)) seconds" >> $LOGFILE
# Remove lock file

Open in new window

LVL 21

Assisted Solution

SelfGovern earned 450 total points
ID: 35498941
Just a few things to think about --
1) the concept of "budget" and "archive" and "disk" are a "pick any two" kind of thing.  Archiving (true long-term storage) to disk is expensive.   Archive is well-suited to tape, not disk.  
2) I agree with another poster to be careful of how reliant you are on two sites only 500m apart.   A natural disaster (earthquake, tornado, flood) can render both of those sites kaput at the same time.
3) Of the data you have, how much is fairly unchanging, and how much changes often?   A solution like HP Data Protector or IBM TSM can perform a full backup just once, and then incremental backups forever, creating occasional "synthetic full backups" that give you fixed recovery points in case of disaster, but also the ability to restore from disk recently backed up files.  This kind of product works very well for situations when your backups are taking so long because of many small files that change rarely.   See http://www.hp.com/go/dataprotector

Perhaps you can use the NAS for your backups, and tape for the archives.  Or perhaps the synthetic full strategy meets your needs and covers both backup and archive.

Author Closing Comment

ID: 35775704
Maybe my question was too exact to have the two iomega drives and their o2 systems backing up using rsync. i will try madunix script but my knowledge of unix is rudimentary. May also ask iomega directly to provide instructions. Thanks to all who answered

Featured Post

Concerto Cloud for Software Providers & ISVs

Can Concerto Cloud Services help you focus on evolving your application offerings, while delivering the best cloud experience to your customers? From DevOps to revenue models and customer support, the answer is yes!

Learn how Concerto can help you.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In this article we will learn how to backup a VMware farm using Nakivo Backup & Replication. In this tutorial we will install the software on a Windows 2012 R2 Server.
Here in this article, you will get a step by step guidance on how to restore an Exchange database to a recovery database. Get a brief on Recovery Database and how it can be used to restore Exchange database in this section!
In this Micro Tutorial viewers will learn how to restore single file or folder from Bare Metal backup image of their system. Tutorial shows how to restore files and folders from system backup. Often it is not needed to restore entire system when onl…
This tutorial will walk an individual through the steps necessary to enable the VMware\Hyper-V licensed feature of Backup Exec 2012. In addition, how to add a VMware server and configure a backup job. The first step is to acquire the necessary licen…
Suggested Courses

864 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question