Solved

Virtual drive for manage short and long term storage

Posted on 2014-03-21
6
614 Views
Last Modified: 2014-04-10
Hi,

How can I manage as virtual drive or similar in a windows system, a bundle of drives (SATA and SSD) works as only one drive that internally sort the files directly short-term storage in a SSD disk and after some weeks move to big SATA disk in transparent mode (In fact, the path for the files can't be changed)

The question is that we have a windwows application that works with files, and we want to improve the performance using as short term storage for the new files will be saved into the SSD disk and after some weeks move to a long term storage into  SATA disks array, but using always a unique virtual drive (Because the windows application store the path of each file and can't be changed)

Any suggestion?

Regards
0
Comment
Question by:lnrivera
6 Comments
 
LVL 38

Expert Comment

by:Aaron Tomosky
ID: 39947635
Many San/nas appliances have these features but most of them are $$$. How much storage do you need and what kind of budget do you have?
0
 

Author Comment

by:lnrivera
ID: 39947909
We want to have a SSD 256 GB for short-term and RAID about 6TB for long term

The budget will always a problem, but I want to know more about this technology.

Thanks
0
 
LVL 20

Accepted Solution

by:
SelfGovern earned 150 total points
ID: 39947919
There may be no pre-built solution that I'd call inexpensive.

There are some great solutions built for enterprises that do this automatically -- systems like HP;s 3PAR, for instance, that can manage movement of "hot" blocks of data to and from SSD automatically.... but you're talking significant money.

If you want something on the cheap -- you might be surprised to find out that if you got a bunch of fast SAS drives in a RAID 10 setup and short-stroked them (i.e. set up a partition so that you were only using the outer, faster regions of the disks), you'd get performance equal to what you would on an SSD.

Failing that -- what you're really looking for is a hierarchical file system.  There's an open source project you can read up on at http://ohsm.sourceforge.net/  or another option at http://www.mjay.me/hierarchical-storage-management-the-open-source-way/ 

The cnallenge is that these are Linux-based -- and if you present them as NAS to a Window's box, you might lose most or all of the performance you hoped to get from the SSD.

There are also commercial software solutions for tiering data -- Quantum's StorNext, and HP's got an Autonomy product, for instance -- but I think these are designed to deal with tens of terrabytes of data.  If you're talking about less than 10TB in a Windows environment, it's probably cheaper to do the RAID 10/short stroke thing, or just buy all SSD for the short term.
0
PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

 
LVL 38

Assisted Solution

by:Aaron Tomosky
Aaron Tomosky earned 250 total points
ID: 39947944
At that capacity, id suggest single tier of storage that's sata/sas based with an ssd cache. Zfs would be my first suggestion, personally I use zfsguru, but nexenta is free at that capacity and can be easier to GUI manage. Remember to get a second one to clone to or backup some other way as raid is not a backup
0
 
LVL 55

Assisted Solution

by:andyalder
andyalder earned 100 total points
ID: 39948572
I suspect this is a business so Nexenta Community Edition can't be legally used.

I don't know how good the inbuilt tiering that is ni 2012 R2 but it's worth a try - http://blogs.technet.com/b/keithmayer/archive/2013/09/13/step-by-step-build-an-automated-storage-tiers-lab-with-windows-server-2012-r2-and-powershell.aspx#.Uy7kT4XPzKc
0
 
LVL 38

Assisted Solution

by:Aaron Tomosky
Aaron Tomosky earned 250 total points
ID: 39948828
Really my main point is that at 6tb you're not going to justify tiering. Depending on your iops needs, 4x3tb spinning drives in a raid 10 might be fast enough to saturate gigabit. That's the real question: what's the minimum you can get away with iops wise to still saturate your network. Storage faster than that is a waste.
0

Featured Post

Network it in WD Red

There's an industry-leading WD Red drive for every compatible NAS system to help fulfill your data storage needs. With drives up to 8TB, WD Red offers a wide array of solutions for customers looking to build the biggest, best-performing NAS storage solution.  

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article is an update and follow-up of my previous article:   Storage 101: common concepts in the IT enterprise storage This time, I expand on more frequently used storage concepts.
Create your own, high-performance VM backup appliance by installing NAKIVO Backup & Replication directly onto a Synology NAS!
This Micro Tutorial will teach you how to reformat your flash drive. Sometimes your flash drive may have issues carrying files so this will completely restore it to manufacturing settings. Make sure to backup all files before reformatting. This w…
Sending a Secure fax is easy with eFax Corporate (http://www.enterprise.efax.com). First, just open a new email message. In the To field, type your recipient's fax number @efaxsend.com. You can even send a secure international fax — just include t…

910 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

23 Experts available now in Live!

Get 1:1 Help Now