Solved

Virtual drive for manage short and long term storage

Posted on 2014-03-21
6
610 Views
Last Modified: 2014-04-10
Hi,

How can I manage as virtual drive or similar in a windows system, a bundle of drives (SATA and SSD) works as only one drive that internally sort the files directly short-term storage in a SSD disk and after some weeks move to big SATA disk in transparent mode (In fact, the path for the files can't be changed)

The question is that we have a windwows application that works with files, and we want to improve the performance using as short term storage for the new files will be saved into the SSD disk and after some weeks move to a long term storage into  SATA disks array, but using always a unique virtual drive (Because the windows application store the path of each file and can't be changed)

Any suggestion?

Regards
0
Comment
Question by:lnrivera
6 Comments
 
LVL 38

Expert Comment

by:Aaron Tomosky
ID: 39947635
Many San/nas appliances have these features but most of them are $$$. How much storage do you need and what kind of budget do you have?
0
 

Author Comment

by:lnrivera
ID: 39947909
We want to have a SSD 256 GB for short-term and RAID about 6TB for long term

The budget will always a problem, but I want to know more about this technology.

Thanks
0
 
LVL 20

Accepted Solution

by:
SelfGovern earned 150 total points
ID: 39947919
There may be no pre-built solution that I'd call inexpensive.

There are some great solutions built for enterprises that do this automatically -- systems like HP;s 3PAR, for instance, that can manage movement of "hot" blocks of data to and from SSD automatically.... but you're talking significant money.

If you want something on the cheap -- you might be surprised to find out that if you got a bunch of fast SAS drives in a RAID 10 setup and short-stroked them (i.e. set up a partition so that you were only using the outer, faster regions of the disks), you'd get performance equal to what you would on an SSD.

Failing that -- what you're really looking for is a hierarchical file system.  There's an open source project you can read up on at http://ohsm.sourceforge.net/  or another option at http://www.mjay.me/hierarchical-storage-management-the-open-source-way/  

The cnallenge is that these are Linux-based -- and if you present them as NAS to a Window's box, you might lose most or all of the performance you hoped to get from the SSD.

There are also commercial software solutions for tiering data -- Quantum's StorNext, and HP's got an Autonomy product, for instance -- but I think these are designed to deal with tens of terrabytes of data.  If you're talking about less than 10TB in a Windows environment, it's probably cheaper to do the RAID 10/short stroke thing, or just buy all SSD for the short term.
0
Top 6 Sources for Identifying Threat Actor TTPs

Understanding your enemy is essential. These six sources will help you identify the most popular threat actor tactics, techniques, and procedures (TTPs).

 
LVL 38

Assisted Solution

by:Aaron Tomosky
Aaron Tomosky earned 250 total points
ID: 39947944
At that capacity, id suggest single tier of storage that's sata/sas based with an ssd cache. Zfs would be my first suggestion, personally I use zfsguru, but nexenta is free at that capacity and can be easier to GUI manage. Remember to get a second one to clone to or backup some other way as raid is not a backup
0
 
LVL 55

Assisted Solution

by:andyalder
andyalder earned 100 total points
ID: 39948572
I suspect this is a business so Nexenta Community Edition can't be legally used.

I don't know how good the inbuilt tiering that is ni 2012 R2 but it's worth a try - http://blogs.technet.com/b/keithmayer/archive/2013/09/13/step-by-step-build-an-automated-storage-tiers-lab-with-windows-server-2012-r2-and-powershell.aspx#.Uy7kT4XPzKc
0
 
LVL 38

Assisted Solution

by:Aaron Tomosky
Aaron Tomosky earned 250 total points
ID: 39948828
Really my main point is that at 6tb you're not going to justify tiering. Depending on your iops needs, 4x3tb spinning drives in a raid 10 might be fast enough to saturate gigabit. That's the real question: what's the minimum you can get away with iops wise to still saturate your network. Storage faster than that is a waste.
0

Featured Post

Top 6 Sources for Identifying Threat Actor TTPs

Understanding your enemy is essential. These six sources will help you identify the most popular threat actor tactics, techniques, and procedures (TTPs).

Join & Write a Comment

Having issues meeting security compliance criteria because of those pesky USB drives? Then I can help you! This article will explain how to disable USB Mass Storage devices in Windows Server 2008 R2.
Lets start to have a small explanation what is VAAI(vStorage API for Array Integration ) and what are the benefits using it. VAAI is an API framework in VMware that enable some Storage tasks. It first presented in ESXi 4.1, but only after 5.x sup…
This video Micro Tutorial explains how to clone a hard drive using a commercial software product for Windows systems called Casper from Future Systems Solutions (FSS). Cloning makes an exact, complete copy of one hard disk drive (HDD) onto another d…
This tutorial will walk an individual through the process of installing the necessary services and then configuring a Windows Server 2012 system as an iSCSI target. To install the necessary roles, go to Server Manager, and select Add Roles and Featu…

759 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

20 Experts available now in Live!

Get 1:1 Help Now