Link to home
Start Free TrialLog in
Avatar of davyberroho
davyberroho

asked on

How archiving lots of files? (tera bytes)

Hello,

I'm looking for the best way to archive documents (of any type). The documents must be stocked on a server. The client pcs must be able to consult those archived documents. (By using for exemple a webservice)


I already found 2 solutions :

- Save the files into database blobs...
Problems :
       * I've to archive tera bytes of files --> database will probably slow down.
       * We only have one large database file --> not easy for backuping and transfering to another server or several servers.


- Save lots of files each after the other into a large file till we reached a certain size. Once reached the maximum size we can create another large-file. By stocking the offset and the length of each files we will be able to consult the right files.




If someone has a better solution, please let me know.

Any ideas are welcome!!!



Thanks
Avatar of Duncan Meyers
Duncan Meyers
Flag of Australia image

An ATA SAN disk array would fit the bill. An EMC CX300 with 3 racks of ATA disk (and one of fibre channel) could offer potential 14.4TB raw storage (that is; 45 discs by 320GB - no allowances for parity discs, RAID type etc have been made). That is a lot by any strandard...

http://www.emc.com/products/systems/clariion_cx300.jsp

Backing it all up will be a challenge, though. Unfortunately, backup technology lags behind storage technology... LTO-3 tape drives are about as good as it gets at the moment.

If you have a need for true archival storage then have a look at this: http://www.emc.com/products/systems/centera.jsp?openfolder=platform 
ASKER CERTIFIED SOLUTION
Avatar of gpriceee
gpriceee

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of gpriceee
gpriceee

Hi.  Have you narrowed your choices yet?