Solved

Backing up massive amounts of data - best practice?

Posted on 2010-11-17
6
464 Views
Last Modified: 2012-05-10
I’m looking for suggestions for backing up a company with 3-4 TB of data and growing.
Much of it is static with minor changes made daily, but once in a while there is a flurry of activity and a hundred gigs or even more can change overnight.  There are about 12 servers and 3 workstations that need to be backed up.

Right now we’re using LTO-4 tapes with one drive in a tape library and Backup Exec 12.5.  That seemed adequate when we had just over 1 TB of data, but lately has been a problem.  

I’ve split the jobs up so a few critical servers get full backups every day, but most get a full backup once a week and differentials in between.  That’s fine, except, there are always backups running and we frequently miss scheduled backups because they take longer and longer to complete as the data grows.  

At the moment there is no off-site rotation of the tapes.  The tapes are getting old and need to be replaced, but when you look at the cost of disk drives vs. tapes and consider the speed and a few other factors, I have to doubt the wisdom of continuing to use tapes as the primary backup.  There’s got to be a better way to do this backup and get a copy off-site.
Here are some scenarios I’ve considered...

1.)      Add a USB 3.0 card to the backup server and use a dozen or so 2TB drives in rotation, taking some offsite, but using multiple drives online so that multiple jobs can run simultaneously.
2.)      Get something like a Drobo and use it as a backup device, then replicate it off-site
3.)      Get a Drobo with replication built-in and use it as the main data repository – replicate the data to a second Drobo across a WAN and then make tape backups infrequently just for point in time snapshots.

In scenario 1, we constantly have to deal with the drives.  With scenario two, I wonder if there is enough bandwidth for replication of backups every day, and scenario 3 doesn’t give us much protection against accidental deletion.  

Can anyone recommend a better solution for this backup problem?
0
Comment
Question by:technoid-usa
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
6 Comments
 
LVL 2

Expert Comment

by:volcer35
ID: 34156663
NAS is always a possibility
0
 
LVL 5

Assisted Solution

by:dacasey
dacasey earned 50 total points
ID: 34156738
I like your DRobo solution.  Do you have the funds to pickup a couple or three of NAS boxes, DRobo or other.  Just rotate the DRobo's, one offsite, one for current backup one ready to go.

This way you simply take the whole DRobo offsite.

0
 
LVL 13

Accepted Solution

by:
marine7275 earned 250 total points
ID: 34156757
I use a combination of solutions.

Right now we use Backup Exec with both tapes and disks. We backup to disk first and then for important stuff we write to tape for offisite storage. We have Dell MD3000i's in our Corp Data Center and use Drobo Pros in the Branches.

We are moving to CommVault now to take advantage of Dedupe, compression, and offiste DR replication purposes.

You are on the right track. I would suggest you classify your data first and seprate into backup groups. Sev 1 could include email, accounting data, and dbase data that need to be replicated and/or stored offsite. Sev 2 could be data that changes weekly or monthly that may or may not need to be stored offiste. Sev 3 could be Tier 2/older data that may just need to be backed up tot disk. By doing this, you will save $$ on bandwidth needed for replication, tapes needed for offsite purposes, etc.

Hope this helps.
0
Webinar: Aligning, Automating, Winning

Join Dan Russo, Senior Manager of Operations Intelligence, for an in-depth discussion on how Dealertrack, leading provider of integrated digital solutions for the automotive industry, transformed their DevOps processes to increase collaboration and move with greater velocity.

 

Author Comment

by:technoid-usa
ID: 34165274
marine7275 -
Can you clarify just a little for me and make sure I understand?  You use the MD3000i's and Drobos as the backup target, right?  

The Dell and Drobos are all connected with iSCSI?  Do you think the Drobo Pro FS would be fast enough?  It's an ethernet (NAS) device.

I think your suggestion on prioritizing data and making backup schedules accordingly is probably what's going to do it for us.

Also - thanks dacasey - I was thinking of duplication over the wire or maybe even swapping out disks, but hadn't thought of taking the whole unit off-site.  It gives me something to think about.

The bottom line, is that backups are increasingly problematic for many of my clients.  I wish I could find a cookie cutter solution that works without breaking the bank, but I don't think that's going to be possible.

0
 

Author Closing Comment

by:technoid-usa
ID: 34165312
This is a best practices question and the opinions offered are very valuable, however there is no "right" answer.
0
 
LVL 13

Expert Comment

by:marine7275
ID: 34165648
Can you clarify just a little for me and make sure I understand?  You use the MD3000i's and Drobos as the backup target, right?  
Yes

The Dell and Drobos are all connected with iSCSI?
MD3000i is iSCSI but the Drobos are connected eSata

 Do you think the Drobo Pro FS would be fast enough?
Yes
0

Featured Post

Three Reasons Why Backup is Strategic

Backup is strategic to your business because your data is strategic to your business. Without backup, your business will fail. This white paper explains why it is vital for you to design and immediately execute a backup strategy to protect 100 percent of your data.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

VM backup deduplication is a method of reducing the amount of storage space needed to save VM backups. In most organizations, VMs contain many duplicate copies of data, such as VMs deployed from the same template, VMs with the same OS, or VMs that h…
Many businesses neglect disaster recovery and treat it as an after-thought. I can tell you first hand that data will be lost, hard drives die, servers will be hacked, and careless (or malicious) employees can ruin your data.
In this Micro Tutorial viewers will learn how they can get their files copied out from their unbootable system without need to use recovery services. As an example non-bootable Windows 2012R2 installation is used which has boot problems.
In this Micro Tutorial viewers will learn how to restore single file or folder from Bare Metal backup image of their system. Tutorial shows how to restore files and folders from system backup. Often it is not needed to restore entire system when onl…

738 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question