Archiving

tommym121
tommym121 used Ask the Experts™
on
I have a server that collects and logs data onto its hard disk. It is important that the information should not be lost.  In addition,  I need to keep the data for 10 years.  However,  I need to make the 2 years data readily available for the user to use.  Anyone can give me some recommendation?  What is the best way to archive this information save.  

How should I keep minimum performance impact to this server since it continuously collecting and logging data.  

How often should I archive?

I am looking at 2 TB per year for the size of the archive.


Can anyone share their archive policy and scheme? Thanks.
Comment
Watch Question

Do more with

Expert Office
EXPERT OFFICE® is a registered trademark of EXPERTS EXCHANGE®
Top Expert 2007

Commented:
Principal Software Engineer
Commented:
2 TB per year x 10 years is only 20 TB.  This could be readily kept online and instantly accessible as RAID sets.

One 9-drive RAID set of 1 TB drives with redundancy will deliver 8 TB usable storage.  Three such sets will deliver 24 TB storage.  These are commercially available products.  If the data in question is important, I would not recommend a build-your-own approach.

I would also not recommend using the new 1.5 TB or 2 TB drives in such an application.  The specifications and anecdotal evidence from the field indicates that these drives are prone to magnetic domain fading, and must be refreshed every few months to prevent data loss.

Author

Commented:
What type of RAID should I be using to ensure robust, no loss in data and easy to maintain in case of hard drive failure.
Dr. KlahnPrincipal Software Engineer

Commented:
Sorry, I did not see your earlier reply.  I would recommend RAID 5 or higher so that at least one drive can fail without losing data.

Do more with

Expert Office
Submit tech questions to Ask the Experts™ at any time to receive solutions, advice, and new ideas from leading industry professionals.

Start 7-Day Free Trial