Solved

SAN - 450 Tb of repeated data. How to reduce to unique data?

Posted on 2008-06-18
2
386 Views
Last Modified: 2013-11-16
We have an HP XP12000 SAN with 450 Tb of data, with multiple types of RAID config. We want to reduce the size of the SAN, which we see as happening in two ways: a. Reduce RAID 5 to a lower but still resilient level and b. Trawl through the data remove duplicates etc. Two questions - a. What is an optimal resilience level? and b. What tools (SW etc) are available to manage and control data? FYI - we use SAP R/3 and BW with CRM coming soon. We also have an very active web site.
0
Comment
Question by:peter2407
  • 2
2 Comments
 
LVL 30

Accepted Solution

by:
Duncan Meyers earned 500 total points
ID: 21819857
> a. What is an optimal resilience level?
Depends on your business requirements. RAID 1/0 may be perfect for some, RAID 5 or RAID 6 for others.

>b. What tools (SW etc) are available to manage and control data?
Double Killer is a nifty piece of software that will find duplicate files: http://www.bigbangenterprises.de/en/doublekiller/

But it sounds like Data De-duplication might be what you're after, given that you've got a mix of structured and unstructured data. StorNext from Quantum (http://www.quantum.com/Products/Software/StorNext/Index.aspx) might be just the ticket. It handles HSM tasks as well as de-duplication.

Alternatively, you could wait until HP releases de-dupe for the XP series of arrays.
0
 
LVL 30

Expert Comment

by:Duncan Meyers
ID: 21881675
Thanks! Glad I could help.

Now - to your other question: http://www.experts-exchange.com/Storage/Storage_Technology/Q_23520840.html. I'm a bit concerned about what you've got in mind...
0

Featured Post

PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Finding original email is quite difficult due to their duplicates. From this article, you will come to know why multiple duplicates of same emails appear and how to delete duplicate emails from Outlook securely and instantly while vital emails remai…
This article aims to explain the working of CircularLogArchiver. This tool was designed to solve the buildup of log file in cases where systems do not support circular logging or where circular logging is not enabled
This video teaches viewers how to encrypt an external drive that requires a password to read and edit the drive. All tasks are done in Disk Utility. Plug in the external drive you wish to encrypt: Make sure all previous data on the drive has been …
This Micro Tutorial will teach you how to reformat your flash drive. Sometimes your flash drive may have issues carrying files so this will completely restore it to manufacturing settings. Make sure to backup all files before reformatting. This w…

856 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question