Backup Solution for Large Files and Limited Space

I might accept a position with a company that has very large video files on Drobo units (not sure if ip or usb)  and as far as I know none on tape or any other local disk.  One user advised me (in my job interview) he has 16 TB on a Drobo at his workstation.  (This may also be total storage and not total space used.)
Sine these are large video files I do not believe they have any server room storage to duplicate the files.  I have not seen the size of the files.

Since most of these files would not need to be restored often my thoughts were to have some kind of agent running locally that could back them up to a place such as Amazon, Iron Mountain, etc...  (Just to get them safely backed up off site.)

I do not know their data circuit speed, but they may have 400mb up and down next month.

I had a few concerns such as which provider may be best, and if the files are eventually centralized on a server with attached storage would we lose any from our initial backups.  Some places have "lifetime storage" and some delete your file in the cloud 30 days after it is removed from your original (local) backup location.

In the future I would also like to be able to restore folders and keep folder permissions in tact.  Restores may also pose problems since there may not be much space unless overwriting the original path.  I think if it is just a few files the local hard drive will be fine until they verify to use the recovered file.

My initial thought was local disk (server) ---> cloud (deduped)  (But I don't think they will be buying the server, backup software, or storage.)

As a safety net I thought we could go to cloud and then move the Drobo files to local disk once that solution is in place.

My guess is this will be one of my first projects and I want some opinions.  At the time they do not have any IT staff.

Thanks in advance
LVL 3
ConfigtermAsked:
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

x
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

David Johnson, CD, MVPOwnerCommented:
Better and faster to ship disks unless you want the initial backup to finish in 2017. How many other Drobo's are floating around?

AWS has the snowball service $200/job + shipping and handling (48hour) comes with a 10Ge port . $15/day surcharge over 10 free days. If I got my math right it would be $112/month for Glacier Storage of 16TB ($0.007 per GB)
This shipping of disks to an offsite provider is only the 1 (being offsite) of the 3 copies / 2 Media / 1 Offsite.
Thomas Zucker-ScharffSolution GuideCommented:
Druva's inSync software is an excellent solution. It can be configured for each desktop.  We authenticate with our Active Directory. You can use a local solution or the cloud. Code42's Crashplan is also a good solution,  local and cloud.  CP also is free for local backup (home).

Check out this article on why I changed cloud backup providers.

http://www.experts-exchange.com/articles/17402/Cloud-Backup-Why-I-changed-providers.html
Gerald ConnollyCommented:
A 400Mbit circuit is nowhere fast enough to put the kind of data volumes you are talking about up on the cloud (@7 hours per TB min more probably 10-14 hours/TB)
SolarWinds® Network Configuration Manager (NCM)

SolarWinds® Network Configuration Manager brings structure and peace of mind to configuration management. Bulk config deployment, automatic backups, change detection, vulnerability assessments, and config change templates reduce the time needed for repetitive tasks.

Thomas Zucker-ScharffSolution GuideCommented:
CP gives you the option to send in disks for your initial backup.
Gerald ConnollyCommented:
Thomas, we haven't even started talking about initial seeding and restore issues with a slow speed line, but if we are talking video files then they are usually big

The OP doesn't gives us any real details of the total data volume, the daily rate of change or confirmation of the link speed. On top of that we don't know the RPO/RTO either
Thomas Zucker-ScharffSolution GuideCommented:
True. And I admit I am used a T3 line. Although at home I have 75/75 maps FIOS.  For our purposes,  seeding was the most important part,  as the change in files on a daily basis was not a big deal.  For home,  I didn't really care how long it took,  so I tried just letting it upload continuously until 3tb had been backed up to the cloud servers.  It took about a week for an old Dell inspiron D850  (upgraded from XP to win 10 and from 2gb to 4gb).
nappy_dThere are a 1000 ways to skin the technology cat.Commented:
I would like to suggest you stage locally to a large disk array with a backup solution that supports deduplication. By using deduplication, you begin to backup data at the block level and only data blocks that change gets backed up. This is significantly faster than backups at the file level.

The caveat to this is that the first backup WILL take the longest. I have backed up 20TB but it took nearly 3 days to complete but now subsequent dedupe backups takes only hours not days.

For large amounts of backup data as you are surmising your potential new employer may have, a local server and disk dedupe with tape migration may be your best solution.

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
ConfigtermAuthor Commented:
I ended up accepting a position at another company, but the options here were very educational.
- Thanks
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Storage Software

From novice to tech pro — start learning today.