Link to home
Start Free TrialLog in
Avatar of mcrmg
mcrmg

asked on

Storage Option

hi,

We just upgraded our file server to 7T of space. It holds nothing but pdf files, currectly, we have about 800G of pdf files, my question is, is there a solution for this kind of problem, because we are going to run out of sapce in a few month.....thx
Avatar of blamethenetwork
blamethenetwork
Flag of United States of America image

can you zip and archive older files?
Avatar of mcrmg
mcrmg

ASKER

zipping pdf files is not going to shrink much, plus, we still need to access those files...thx
Avatar of Duncan Meyers
An archiving prodcut such as Symantec Enterprise Vault: (http://www.symantec.com/business/enterprise-vault), CommVault Archive (http://www.commvault.com/products/archive.asp) Zantaz archiving (http://www.zantaz.com/products/archiving/index.htm) and many others allow you to automatically move move data from primary storage to secondary based on policies that you define. The advantages are that you only need back up your archive store after an archive run - say, once a week, and that can massively reduce the amount of data you need to back up on a daily basis.

Other things to look at include EMC's Centera platform, NetApp's FAS range of filers for on-array data de-duplication, and Data Domain and Quantum's de-duplication appliances.
Avatar of mcrmg

ASKER

i will look more into this, here is a little bit background on how we deal the those files, we have a online app, while new files keep coming in, we still ned to access those pdf via this app online, doing archive, I still need to increase hdd size on the archive side, correct?  thx
Avatar of mcrmg

ASKER

what would be the best way to have a scalable storage system..?thx
Yes, although de-duplication will almost certainly help with that as it will reduce the amount of raw storage you'll need.

For a scalable storage system, Network Appliance (NetApp) offers a NAS/SAN array that includes de-duplication out of the box which sounds perfect for you. http://www.netapp.com - take a look at the FAS 2020 as an entry level appliance.
Avatar of mcrmg

ASKER

I read the pages briefly, the main point is de-duplication , each of our file is unique, do u think it will still help us?  thx
ASKER CERTIFIED SOLUTION
Avatar of Duncan Meyers
Duncan Meyers
Flag of Australia image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of mcrmg

ASKER

9t to 550g........wow

now, let's say I have this Quantum DXi de-dupe appliance, will I be still access those files real time?
because those files still active in our app...thx
Yes - but slower than if they came off fast disc.

Remember that the Quantum DXi is primarily intended as a backup appliance, but it has NAS functionality built-in with CIFS/Windows file shares. You'd really need to test it in this application to see if it's suitable. Speak to these guys: http://www.cmsperipherals.com/, (Tel: +353 (0) 94 937 4000), the Irish distributors  of Quantum kit to see if they can arrange a demo unit for you
Wouldn't it be cheaper to just add an enclosure of SATA disks to the server? It sounds like you don't need high performance/throughput.
Avatar of mcrmg

ASKER

it is cheaper just adding hdd to it, but we have 800G data now and is growing daily
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
I do not agree that you need a SAN or NAS.  For online app-accessible storage, there are many options, most of which will fit in the cabinet.  800g is not that much really, you just have to get your head around it.  Use fibre for the app-database; use hdd or scsi for the pdf files (hopefully linked from the db).  That's where you run into the big decision: independent file-organiser with de-dupe xor db-linked access path.  It is not just about where and how to store the images; it is about when and how you want to access them.  Get a db that can handle 800gb to 7tb with ease, xor maintain the link but not the image itself in the db.  Also consider backup requirements: since the PDFs do not change, you do not need to keep backing them up.
I must agee about no need for a SAN at any stage. Considering you can put multiple RAID controllers in servers and hang a more than a hundred disks on each of them now we have SAS disks and enclosures the capacity and performance of DAS is enough for any application except when you need to share the storage between more than on computer. Take www.tpc.org/results/FDR/TPCC/HP_ProLiant_DL580G5_2.67GHz_fdr.pdf for example, over 1000 disks and not a SAN in sight.