Solved

Virtual drive for manage short and long term storage

Posted on 2014-03-21
6
615 Views
Last Modified: 2014-04-10
Hi,

How can I manage as virtual drive or similar in a windows system, a bundle of drives (SATA and SSD) works as only one drive that internally sort the files directly short-term storage in a SSD disk and after some weeks move to big SATA disk in transparent mode (In fact, the path for the files can't be changed)

The question is that we have a windwows application that works with files, and we want to improve the performance using as short term storage for the new files will be saved into the SSD disk and after some weeks move to a long term storage into  SATA disks array, but using always a unique virtual drive (Because the windows application store the path of each file and can't be changed)

Any suggestion?

Regards
0
Comment
Question by:lnrivera
6 Comments
 
LVL 38

Expert Comment

by:Aaron Tomosky
ID: 39947635
Many San/nas appliances have these features but most of them are $$$. How much storage do you need and what kind of budget do you have?
0
 

Author Comment

by:lnrivera
ID: 39947909
We want to have a SSD 256 GB for short-term and RAID about 6TB for long term

The budget will always a problem, but I want to know more about this technology.

Thanks
0
 
LVL 20

Accepted Solution

by:
SelfGovern earned 150 total points
ID: 39947919
There may be no pre-built solution that I'd call inexpensive.

There are some great solutions built for enterprises that do this automatically -- systems like HP;s 3PAR, for instance, that can manage movement of "hot" blocks of data to and from SSD automatically.... but you're talking significant money.

If you want something on the cheap -- you might be surprised to find out that if you got a bunch of fast SAS drives in a RAID 10 setup and short-stroked them (i.e. set up a partition so that you were only using the outer, faster regions of the disks), you'd get performance equal to what you would on an SSD.

Failing that -- what you're really looking for is a hierarchical file system.  There's an open source project you can read up on at http://ohsm.sourceforge.net/  or another option at http://www.mjay.me/hierarchical-storage-management-the-open-source-way/ 

The cnallenge is that these are Linux-based -- and if you present them as NAS to a Window's box, you might lose most or all of the performance you hoped to get from the SSD.

There are also commercial software solutions for tiering data -- Quantum's StorNext, and HP's got an Autonomy product, for instance -- but I think these are designed to deal with tens of terrabytes of data.  If you're talking about less than 10TB in a Windows environment, it's probably cheaper to do the RAID 10/short stroke thing, or just buy all SSD for the short term.
0
Simplifying Server Workload Migrations

This use case outlines the migration challenges that organizations face and how the Acronis AnyData Engine supports physical-to-physical (P2P), physical-to-virtual (P2V), virtual to physical (V2P), and cross-virtual (V2V) migration scenarios to address these challenges.

 
LVL 38

Assisted Solution

by:Aaron Tomosky
Aaron Tomosky earned 250 total points
ID: 39947944
At that capacity, id suggest single tier of storage that's sata/sas based with an ssd cache. Zfs would be my first suggestion, personally I use zfsguru, but nexenta is free at that capacity and can be easier to GUI manage. Remember to get a second one to clone to or backup some other way as raid is not a backup
0
 
LVL 55

Assisted Solution

by:andyalder
andyalder earned 100 total points
ID: 39948572
I suspect this is a business so Nexenta Community Edition can't be legally used.

I don't know how good the inbuilt tiering that is ni 2012 R2 but it's worth a try - http://blogs.technet.com/b/keithmayer/archive/2013/09/13/step-by-step-build-an-automated-storage-tiers-lab-with-windows-server-2012-r2-and-powershell.aspx#.Uy7kT4XPzKc
0
 
LVL 38

Assisted Solution

by:Aaron Tomosky
Aaron Tomosky earned 250 total points
ID: 39948828
Really my main point is that at 6tb you're not going to justify tiering. Depending on your iops needs, 4x3tb spinning drives in a raid 10 might be fast enough to saturate gigabit. That's the real question: what's the minimum you can get away with iops wise to still saturate your network. Storage faster than that is a waste.
0

Featured Post

Gigs: Get Your Project Delivered by an Expert

Select from freelancers specializing in everything from database administration to programming, who have proven themselves as experts in their field. Hire the best, collaborate easily, pay securely and get projects done right.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article is an update and follow-up of my previous article:   Storage 101: common concepts in the IT enterprise storage This time, I expand on more frequently used storage concepts.
Outsource Your Fax Infrastructure to the Cloud (And come out looking like an IT Hero!) Relative to the many demands on today’s IT teams, spending capital, time and resources to maintain physical fax servers and infrastructure is not a high priority.
This Micro Tutorial will teach you how to reformat your flash drive. Sometimes your flash drive may have issues carrying files so this will completely restore it to manufacturing settings. Make sure to backup all files before reformatting. This w…
Internet Business Fax to Email Made Easy - With eFax Corporate (http://www.enterprise.efax.com), you'll receive a dedicated online fax number, which is used the same way as a typical analog fax number. You'll receive secure faxes in your email, fr…

776 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question