How to store, serve, and back up 100 TB of PDF files?
My organization currently stores, serves, and backs up about 4 TB of data. Now, out of necessity, we are converting all of our microfilm to PDF files. A vendor is doing that part, and they estimate that once converted, there will be 100TB of PDF files. I don't even know where to begin with managing that much data.
The backup medium should have a long shelf life. Otherwise, we'll be constantly re-backing up the data as the expected shelf life of the media approaches.
The backup medium should have a long shelf life. Otherwise, we'll be constantly re-backing up the data as the expected shelf life of the media approaches.
ASKER
The CMS is being provided by the vendor.
you mean the storage vendor or provider?
ASKER
The vendor who is scanning the microfiche is providing a software content management system, but no hardware or backup solution.
An obvious starting point is LTO tape, it's got easy portability, robust and longevity
ASKER
Since PDF's are already compressed that would require about 40 tapes, which doesn't seem viable.
> The vendor who is scanning themicrofiche is providing a software content management system
did they provide you the hardware spec or requirements of the storage which is compatible to their software? e.g. RAID, NAS, SAN, or specific tape systems?
did they provide you the hardware spec or requirements of the storage which is compatible to their software? e.g. RAID, NAS, SAN, or specific tape systems?
HP E7W30A plus Smart Array P822 would do for about 120TB usable with 35 * 4TB nearline 7.2K SAS (about $40k), but as Gerald Connolly says you still need an LTO library to back it up onto and a midrange server to act as fileserver.
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
once a right CMS is selected, you may design its storage back-end accordingly.