Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people, just like you, are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
Solved

Distributed storage space across multiple computers

Posted on 2009-07-02
9
566 Views
Last Modified: 2013-11-14
Ok,  so I have like 42 windows XP machines that have at least a 250gb primary hard drive,  these machines basically just sit there and process information and send it back to the network,  so all there is ever going to be on those 250gb drives is Windows XP.  So each of these computers has about 230gb of free space,  when you total that up its like 9.6TB of wasted space.

Is there a way to somehow utilize this storage capacity in a meaningful way without having to use each drive as a separate shared storage drive?  It would be awesome to somehow tie all this free space together across all these systems and create some type of virtural drive that any system on the network can use.
0
Comment
Question by:kfstout
  • 3
  • 2
  • 2
  • +1
9 Comments
 
LVL 18

Accepted Solution

by:
BigSchmuh earned 84 total points
ID: 24771205
I consider the following points:
-Your 42 pc are standard XP client that are not reliable (Their user may shutdown it at any time)
-You need at least 3 copy per file saved
==> You are not wasting 9.6TB...but only 3.2TB usable and redunded.

A 2TB drive is $240, so you are "loosing" at most $960 (4TB RAID 10)

I think the cost to deploy a Distributed parallel fault tolerant file systems would be a lot more than $1k !

Anyway, please see this list to check for this usage
http://en.wikipedia.org/wiki/List_of_file_systems#Distributed_parallel_fault_tolerant_file_systems
0
 

Author Comment

by:kfstout
ID: 24771253
Yeah,  I know this is pretty out there,  and generally isn't a very good idea.  Just figured I'd see if anyone had any bright ideas. I control all these PC's personally,  there is no other user interaction. Reliable?  not always.  

I already have multiple RAID 5 arrays,  just thought I'd see if there were any practical ways to utilize "wasted" space like that.  I'll check out that link.
0
 
LVL 5

Assisted Solution

by:QEMS
QEMS earned 41 total points
ID: 24771286
There is also the performance issue to consider - would that kind of setup give you the kind of performance you would want/need from a storage array?

You may also need to consider the impact on network traffic that may be generated by spreading data around the system like that.

If you want a use for that space, maybe you could consider partitioning the drives and storing a local image of the workstation. At least that way, in the event of a failure, virus outbreak, dodgy update, user breaking the system in some way or whatever you have a locally stored image of a working system that could get your machines up and running again very quickly.
0
Complete VMware vSphere® ESX(i) & Hyper-V Backup

Capture your entire system, including the host, with patented disk imaging integrated with VMware VADP / Microsoft VSS and RCT. RTOs is as low as 15 seconds with Acronis Active Restore™. You can enjoy unlimited P2V/V2V migrations from any source (even from a different hypervisor)

 
LVL 18

Assisted Solution

by:BigSchmuh
BigSchmuh earned 84 total points
ID: 24771450
I won't try to use those wasted space.
I would rather try :
-to move to an OS with no local drive needs
-create a network bootstrap for it
-order new pc without any drives (and at least 1 USB)
0
 
LVL 30

Expert Comment

by:Duncan Meyers
ID: 24775563
SANMelody from DataCore will do exactly what you want: http://www.datacore.com/products/prod_SANmelody.asp

0
 
LVL 5

Expert Comment

by:QEMS
ID: 24776618
Thats not quite what he wants meyersd.

The datacore site quotes "A much more cost-effective solution is available from DataCore. Our SANmelody" shrink-wrap package turns a general-purpose server into an expansion "disk server" from which other systems can draw capacity."

He's not talking about using a general purpose server, he's talking about attempting to use surplus desktop storage capacity. I certainly wouldn't want to farm out critical data from my servers out on to the rest of the network! That product appears to be more about storage consolidation where as kfstout is effectively asking for the opposite of that.

Feel free to correct me if there is a feature that I've missed, but that product seems to be aiming in a slightly different direction.
0
 
LVL 30

Expert Comment

by:Duncan Meyers
ID: 24779066
The "general purpose disk server" draws its storage from the disks in other systems - not just disk that is directly attached to the storage server. Datacore used to pitch their product (a couple of years ago) as being able to use spare space from desktop PCs and although they no longer use that sort of marketing, the principle remains the same. It's a nifty idea.

Having said that, their website is a cherishable exercise in obfuscation and bewilderment...  :-)
0
 
LVL 5

Expert Comment

by:QEMS
ID: 24783408
Yes nice idea, we have quite a few terabytes of unused storage on desktop PCs here but I wouldn't want to risk that data being compromised/lost or risk a large impact on network performance from that kind of solution.

I can see the benefit of the main examples they use on the site and I've just found the following on there!
"Also, please download the White Paper entitled, 'SANmelody Software Converts PCs into Powerful Network Disk Servers'"

The other thing I would consider is the cost of that software compared to the cost of a nice 4TB (or more) NAS. How much dedicated storage could you purchase for the same cost as that software? And how much space do you expect to gain from the PCs around the network? Take into account that the useable space will drop from the total amount "available" as you will need some kind of fault tolerance.

Answering those questions should get you a good idea of whether it is worth pursuing this idea or whether it would be better to spend time and money on dedicated storage.
0

Featured Post

Free Tool: Path Explorer

An intuitive utility to help find the CSS path to UI elements on a webpage. These paths are used frequently in a variety of front-end development and QA automation tasks.

One of a set of tools we're offering as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

When we purchase storage, we typically are advertised storage of 500GB, 1TB, 2TB and so on. However, when you actually install it into your computer, your 500GB HDD will actually show up as 465GB. Why? It has to do with the way people and computers…
The business world is becoming increasingly integrated with tech. It’s not just for a select few anymore — but what about if you have a small business? It may be easier than you think to integrate technology into your small business, and it’s likely…
This video Micro Tutorial explains how to clone a hard drive using a commercial software product for Windows systems called Casper from Future Systems Solutions (FSS). Cloning makes an exact, complete copy of one hard disk drive (HDD) onto another d…
This video teaches viewers how to encrypt an external drive that requires a password to read and edit the drive. All tasks are done in Disk Utility. Plug in the external drive you wish to encrypt: Make sure all previous data on the drive has been …

808 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question