Advertisement

12.18.2006 at 02:39PM PST, ID: 22097254
[x]
Attachment Details
[x]
The Solution Rating System

With so many solutions, how can you tell which solutions are most likely to help you and which ones are not? To provide you with a tool to use, we rate our solutions based on various elements that most accurately determine if a solution is a quality solution. To explain what factors affect the solution rating, here are the elements we take into consideration when formulating our solution rating.

  • The Grade of the Solution
  • The Zone Rank of the Expert Providing the Solution
  • The Number of Author and Expert Comments
  • The Number of Experts Contributing
  • The Feedback of the Community

Your Input Matters
Because of the way the system is set up, the most important variable in this equation is you. As a member of Experts Exchange, you are able to cast your vote on the quality of the solutions in regard to how complete, accurate, helpful and easy to understand each solution is. When you provide your feedback, each rating is adjusted accordingly. So, if you see a solution that has a poor rating that you think is a good solution, let us know by rating it. As you do, the rating will be adjusted and will become more accurate for other members of our site.

If you have any suggestions that you would like to make for our rating system, please ask a question in the Suggestions Zone of Community Support.

Thank you!

Massive Hard Drive Requirements

Tags: hard, drive, requirements
  I am looking for some feedback. I have a customer running a Windows 2003 Server. One department wants to start recording MP3 files to the server to the tune of 30GB per year and another departments wants to start scanning documents to the server to the tune of 30GB per year. Everything must be on-line 100% of the time and nothing is to ever be removed. EVER!

   That is 60GB per year. So in a five year time period they will have accumulated 300GB of data. How are people backing this kind of data up? 1) Very few tape drives will hold this amount of data 2) The ones that will cost a million dollars and 3) Will take a day to back it up!

   How do you handle this situation? 300GB is just for five years. How are people adding this kind of capacity to a server and how are they backing it up? Is there a standard? Thanks!
Start your free trial to view this solution
Question Stats
Zone: Storage
Question Asked By: jimbecher
Solution Provided By: pgm554
Participating Experts: 14
Solution Grade: A
Views: 313
Translate:
Loading Advertisement...
12.18.2006 at 02:49PM PST, ID: 18162408

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
12.18.2006 at 02:54PM PST, ID: 18162457

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
12.18.2006 at 03:34PM PST, ID: 18162689

Rank: Master

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
12.18.2006 at 03:43PM PST, ID: 18162733

Rank: Master

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
12.18.2006 at 03:47PM PST, ID: 18162749

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
12.18.2006 at 09:38PM PST, ID: 18163893

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
12.19.2006 at 02:36AM PST, ID: 18164641

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
12.19.2006 at 02:50AM PST, ID: 18164712

Rank: Sage

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
02.19.2007 at 07:29PM PST, ID: 18568136

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
 
Loading Advertisement...
Microsoft
  • Internet Protocols
  • Applications
  • Development
  • OS
  • Hardware
  • Windows Security
Apple
  • Operating Systems
  • Hardware
  • Programming
  • Networking
  • Software
Internet
  • Search Engines
  • File Sharing
  • WebTrends / Stats
  • Spy / Ad Blockers
  • Web Browsers
  • New Net Users
  • Web Development
  • Chat / IM
  • Anti Spam
  • Web Servers
  • Anti-Virus
  • Email Clients
Gamers
  • Tips
  • Online / MMORPG
  • Puzzle
  • Emulators
  • Action / Adventure
  • Role Playing
  • Consoles
  • Game Programming
  • Strategy
  • Sports
  • Misc
  • Computer Games
Digital Living
  • Hardware
  • New Net Users
  • New Users
  • Software
  • Digital Music
  • Gaming World
  • Home Security
  • Apple
  • Networking Hardware
Virus & Spyware
  • Vulnerabilities
  • IDS
  • Encryption
  • Anti-Virus
  • Operating Systems Security
  • Software Firewalls
  • WebApplications
  • Cell Phones
  • Operating Systems
  • Internet
  • Hardware Firewalls
Hardware
  • Handhelds / PDAs
  • Displays / Monitors
  • Components
  • Networking Hardware
  • Peripherals
  • Laptops/Notebooks
  • Storage
  • Servers
  • Desktops
  • New Users
  • Misc
  • Apple
Software
  • System Utilities
  • Industry Specific
  • Network Management
  • Photos / Graphics
  • Page Layout
  • VMWare
  • Misc
  • Web Development
  • OS
  • CYGWIN
  • Voice Recognition
  • Message Queue
  • Quality Assurance
  • Security
  • Firewalls
  • MultiMedia Applications
  • Development
  • Database
  • Office / Productivity
  • Business Management
  • OS/2 Apps
  • Server Software
  • Internet / Email
ITPro
  • OS
  • Storage
  • Encryption
  • Operating Systems Security
  • Apple Hardware
  • Laptops & Notebooks
  • Servers
  • Networking Hardware
  • Peripherals
  • Devices
  • Displays / Monitors
  • WebTrends / Stats
  • Search Engines
  • Firewalls
  • WebApplications
  • IDS
  • Vulnerabilities
  • Email Clients
  • File Sharing
  • Spy / Ad Blockers
  • Web Browsers
  • Web Servers
  • Networking
  • Anti-Virus
  • Chat / IM
  • Anti Spam
Developer
  • Web Servers
  • Web Browsers
  • Game Programming
  • Dev Tools
  • Industry Specific
  • Office / Productivity
  • Database
  • CYGWIN
  • Web Development
  • Search Engines
  • File Sharing
  • WebTrends / Stats
  • Programming
  • Content Management
  • Application Servers
  • Protocols
Storage
  • Removable Backup Media
  • Storage Technology
  • Servers
  • Grid
  • Remote Access
  • Backup / Restore
  • Misc
  • Hard Drives
OS
  • Miscellaneous
  • Security
  • Development
  • Linux
  • VMWare
  • MainFrame OS
  • Unix
  • Apple
  • OS / 2
  • AS / 400
  • BeOS
  • Microsoft
  • VMS / OpenVMS
Database
  • Oracle
  • Miscellaneous
  • MySQL
  • Software
  • Sybase
  • Contact Management
  • PostgreSQL
  • Data Manipulation
  • Clarion
  • InterSystems Cache
  • Siebel
  • MUMPS
  • OLAP
  • SQLBase
  • SAS
  • GIS & GPS
  • 4GL
  • Berkeley DB
  • DB2
  • Informix
  • Interbase / Firebird
  • FoxPro
  • Reporting
  • LDAP
  • Filemaker Pro
  • MS SQL Server
  • dBase
  • MS Access
Security
  • Misc
  • Web Browsers
  • Software Firewalls
  • Operating Systems Security
  • File Sharing
  • Spy / Ad Blockers
  • Vulnerabilities
  • WebApplications
  • IDS
  • Anti-Virus
  • Encryption
  • Anti Spam
  • Email Clients
  • VPN
  • Chat / IM
Programming
  • Editors IDEs
  • Installation
  • Handhelds / PDAs
  • Multimedia Programming
  • System / Kernel
  • Algorithms
  • Game
  • Signal Processing
  • Project Management
  • Open Source
  • Database
  • Misc
  • Languages
  • Processor Platforms
  • Theory
Web Development
  • Scripting
  • Blogs
  • Web Servers
  • Software
  • Search Engines
  • Web Graphics
  • Images
  • Internet Marketing
  • Images and Photos
  • Components
  • Document Imaging
  • Web Languages/Standards
  • Illustration
  • WebApplications
  • Fonts
  • WebTrends / Stats
  • Authoring
  • Digital Camera Software
  • Miscellaneous
Networking
  • Protocols
  • Apple Networking
  • Network Management
  • Message Queue
  • Application Servers
  • Content Management
  • File Servers
  • Email Servers
  • Misc
  • Java Editors & IDEs
  • Wireless
  • Networking Hardware
  • Backup / Restore
  • System Utilities
  • ISPs & Hosting
  • Web Servers
  • Storage Technology
  • Removable Backup Media
  • Servers
  • Broadband
  • Grid
  • OS / 2
  • Novell Netware
  • Unix Networking
  • Windows Networking
  • Security
  • Telecommunications
  • Operating Systems
  • Linux Networking
Other
  • Community Advisor
  • Lounge
  • Community Support
  • New Net Users
  • Philosophy / Religion
  • Math / Science
  • Miscellaneous
  • URLs
  • Expert Lounge
  • Politics
  • Puzzles / Riddles
Community Support
  • Suggestions
  • New to EE
  • New Topics
  • Community Advisor
  • CleanUp
  • Announcements
  • General
  • Feedback
  • Input
  • EE Bugs
 
12.18.2006 at 02:49PM PST, ID: 18162408
this is standart situation
here, read this through.
http://www.wisegeek.com/what-are-the-different-ways-to-backup-data.htm

honestly speaking i don't think 60gb per year is really difficult to backup
generally, i use external HDD for large amount of data (more than 60gb).
U will need to buy once a year 60 gb HDD
is it problem for u?
 
12.18.2006 at 02:54PM PST, ID: 18162457
  Not at all but .... At the end of five years there are 300GB of data on the server. How do you back up 300GB of data on a nightly basis? I'm really just taking any feedback I can get. Are you suggesting getting five 300GB external hard drives and using a different one every night?
 
12.18.2006 at 03:34PM PST, ID: 18162689

Rank: Master

You don't need to backup 300 gb on a nightly basis.

From your description,the data should be static for the most part.

You run a differential nightly and a full once a week.

If yhey have the money ,you set up a disk to disk to tape backup using something like Backup Exec 11d.

750 gig drives RAIDed set up as iSCIi targets are cheap these days and the use of eSATA is another method of cheap, fast, efficent backup to disk.
Accepted Solution
 
12.18.2006 at 03:43PM PST, ID: 18162733

Rank: Master

AIT 300 gb tape drives start at about $3K,so I don't know where you got the million buck figure.
 
12.18.2006 at 03:47PM PST, ID: 18162749
I AM hearing you say customer, but I think you should try saying no in a yes sort of a way. If you can make them responsible for burning these files to double layer DVD ROMs BEFORE uploading them then you could archive these files on a large drive that is NOT part of your backup routine. The ROMs would be very cheap on their budget as would be the time spent burning and labeling. This way you could just backup the drive every once a year or two. If you are politic about it you can try to make them think this is their idea. If they are resistant, then I guess I will weigh in with moral support for you. It sounds as if both of these projects are archiving in nature. Nightly backups should deal with working data and system data in the framework of current real time needs. Maybe you can try the microfiche analogy to get them to see this. If this fails and they claim they want to access the data all the time how about giving them an archive drive that they know will not be backed up but create for them another drive that they can also save to at the same time. Just stick a big 500 GB drive in one of their machines and make a little mini server out of it. If they are too lazy or forgetful to save twice then maybe write a little script that saves to both simultaneously or use a cheap little shareware backup utility to mirror them from time to time. Just a little out of the box thinking: Good luck.
 
12.18.2006 at 09:38PM PST, ID: 18163893
I would get 4, 500G HDD set them up in a stripped set (that would make a total storage space of 2TB. Thats enough room for 33years of storage without having to delete anything at all.

To back up this amount of data to a tape would cost thousands and the time taken would be countless hours/days. So for backup purposes i would build another server with the exact same specs as teh orignal server (HDD wise) and just backup to a secondary server.

In the worst case scenario, you can just switch over the servers and be up and running in minutes, and in the meantime you can work with the server thats damaged to repair it, with very little downtime

 
12.19.2006 at 02:36AM PST, ID: 18164641
pgm554 has already answered ur question.
I just 'd like to suggest another backup software (if u don't have yet)
http://www.acronis.com/enterprise/products/ATICW/
 
12.19.2006 at 02:50AM PST, ID: 18164712

Rank: Sage

I used to mend 14" winchesters, they were quite massive ;)

Seriously though as everyone says it is a small amount of data you're dealing with, if you're looking for long term storage then you need to use tape and you won't get compression with mp3s and unlikely with scanned docs because the scanning software probably compresses but it's still only one or two tapes per night. LTO4 is about to come out with 800GB native, that should last a few years although by the sounds of it you won't have enough source disks to feed LTO4 fast enough, an LTO2 autoloader would make more sense.
 
02.19.2007 at 07:29PM PST, ID: 18568136
Unaccepted and reaccepted to reflect the correct answer.

Netminder
Site Admin
 
 
10.24.2007 at 01:01AM PDT, ID: 20137012
depending on you budget, I'd recommend something like a HP 1U server with an external SCSI drive array. The good thing about these are that you can put up to 14 drives in the ext array so that should cover you for a while. However, if you do start running out of space you can daisy chain another array off the back of the first. Hopefully that will give you sufficient growth space without having to look into huge internal storage or DFS-ing data across multiple servers.
 
 
11.13.2007 at 11:09PM PST, ID: 20278093
Check out a program called Backup Assist. It's inexpensive, uses Windows 2003 Server's built in Backup program, and can go to a variety of media.

In the server, I'd just toss in 2-4 1TB drives, they're certainly cheap enough and fast enough.

For backup you can just get a set of external drives and do incremental backups as much of the data will be static. Then have some of those external drives taken offsite weekly/monthly/etc for safety and redundancy.

It should work out to be a relatively inexpensive solution (when compared with just buying a tape drive alone).
 
 
12.06.2007 at 02:19PM PST, ID: 20423922
SO many solutions out there for this kind of thing...

I will add ROBOCOPY to the mix.


and...

Buffalo Terastations w/ Hot Swappable 750 GB HDDs (x4) ... 2 of those... will give you 6 TB of space, 3 for storage and 3 TB to split in groups of 4 750 GB HDDs for different backup set types.

Robocopy will handle all that for you, unless you want to jump to a compression backup system but for files like music and video... compression doesn't help all that much... it will help your file space though for items like docs and excel sheets... database tables... etc.

My company's final product is digital video and we probably rack up about .5TB per year with 12 % growth.  With this set up it works like this:

4 750gb HDDs... (again I have the same set up for simple storage)
each year, until we go over .75 TB per year of video gets copied to one of the 4 and then i take that HDD OUT and buy a single to replace it... then the one i took out gets put into a public storage place.

This set up works great because I can easily buy say 8 smaller HDDs to run revolving weekly backups on non-video files too and 4 stay in and 4 come out and go to the storage location.

it takes one not-that-modern pc to run it....

both terastations would be plugged directly into the PC, unless you have them separated of on their own gigabit switch running Cat6s into a high end network card. blah blah blah...

but this works and allows for growth, I think.

 
 
12.15.2007 at 12:45AM PST, ID: 20476630
Cheapest solution these days is using hard drives as the backujp media. 60G/Year is not a lot.. a .5TB drive raided and then mirrored and copying the files to a NAS or backup computer and if you want take the hdd's and store them offsite.. both fast and you are reasonably certain that later on down the road you will be able to use the backup media.. juar try and buy a qic-80 drive these days..
 
 
03.01.2008 at 03:58PM PST, ID: 21024276
mr_crust, they want backups,   not speed, making a raid 0 array for 2TB, one drive dies they lose everything..... not a great advice for long term storage.

if anything a raid 5 with hot spare and think, with 60G a year, in 5 years, you dont think storage mediums will have grown :) but others have already given the best advice and options.


 
 
03.05.2008 at 02:03AM PST, ID: 21048981
Run Microsoft DPM Server on another server.
 
 
03.26.2008 at 10:42AM PDT, ID: 21214281
We use a tivoli system from IBM currently.  We backup approx 600GB per night using three LTO1 drives.  Our system is going to be replaced with a newer system and will likely go to a disk - disk - tape system.  

We would keep our current tivoli and change the setup slightly and then go with LTO3 drives.  

We currently run about 5.5 TB on line at all times.  We try to take a snapshot of our system weekly but so far it has worked less than 20% of the time.  Our users are usually keeping files open which is why the snapshot fails.  
 
 
05.28.2008 at 07:53PM PDT, ID: 21665990
The range of suggestions here are varied.

What is your budget?
Does the client have multiple sites?

There are two problems here:
(1) Build a scalable storage solution that is reliable and fast.
(2) Back up the data on the proposed solution.

Proposal:
(a) Contact Storevault (a preferred vendor in my book).  Look into getting a couple Storevault SANs with four (4) 500GB disks to start.  Configure these as RAID10 for 1TB of initial storage.  The setup and purchase cost of 1TB is the "sweet spot" that will hold you for a considerable amount of time and give you the best speed for the dollars spent.

(b) Implement the RAID10 Storevault SAN using iSCSI and two LUNS.  Each department should be allocated a single LUN.  The StoreVault will have four (4) NICs.  Configure the NICs as two pair of teamed interfaces.  Each department can then access the SAN through one team while the second team can be set aside for replication between the first StoreVault device and the second device.

(c) Configure a second storevault device identically to the first.  The second device should replicate from the first on an hourly basis.  This second device should be (preferrably) kept off site.  At a minimum, the second SAN should be placed offsite and allowed to replicate once per day.  In the event of disaster, the company can operate (albeit slowly) off the offsite SAN.

Please let me know if you have any questions.
 
 
06.19.2008 at 07:16PM PDT, ID: 21827975
I agree with SamCaldwell that the StoreVault filers are a solid solution and cost effective.  A correction or two may be in order, however.  The devices in question are NetApp technology.  StoreVault is a division, or rather, was a division of NetApp.  NetApp has since eliminated the division, and StoreVault will henceforth be a product line within the NetApp family of products.  

There are two products in the NetApp StoreVault product line - the S300 and the S550.  The S300 will scale to 8 - 500 GB SATA drives.  The S550 will scale to 12 - 1 TB drives.  StoreVault only supports RAID4 and RAID DP (a modified form of RAID 6).  Both products come with iSCSI SAN and NAS capability.  Replication is optional.  But, all features are extremely easy to use.  And, the products are extremely reliable.  All drives must be identical, a RAID 4 limitation.  250 GB, 500 GB, 750 TB and 1 TB drives are available.

Entry level price for a 1 TB S300 is $2995.  Email or call if you want to know more.
 
 
 
20080236-EE-VQP-29