Solved

Workstations capable of taking in data to disk or ram from a 10Ge connection without any waits

Posted on 2009-05-15
2
181 Views
Last Modified: 2012-05-07
We are taking images from computers attached to microscopes which acquire images in many different formats and in many different ways.  Some of these will be high-speed time lapse images which could come in to the  microscope computers at 100 plus frames per second.  Stacks of these images could be as large as 10s or even 100 GBytes in size.  When experiments are done these images will be dumped to a server over cat5e gige connections.  The workstations that we are talking about are going in a room for image processing visualization and analysis off line.  There will be a variety of software packages which will be used for this.  Each workstation will have at least 1 cat5e gigabit ethernet connection (we are hoping that we can boost this to 10G but that does not seem to be probable right now).  We would want to have the workstations capable of taking in data to disk or ram from a 10Ge connection without any waits.  This should be a bit under 100Mbytes per second and should not be a problem with the Motherboard and cpus we specified. We will also have a lot of computationally intensive tasks to be performed on these images which is why we want the new i7 core cpus with the on-chip memory controller.  These computations have been clocked at 10 to 15 min on dual 4 core xeons with 16G of ram, so the number crunching is substantial.  We don't want to have these images stored on the workstations but left on the server so that they can be accessed from any of the workstations.

We would want to know the best way too retrieve them,  We also would want to have the workstations capable of taking in data to disk or ram from a 10Ge connection without any waits?


0
Comment
Question by:ftravaline
2 Comments
 
LVL 69

Accepted Solution

by:
Callandor earned 500 total points
ID: 24398074
It sounds like you're going to have to go with some kind of RAID array - individual drives can only transfer data at a maximum of 100Mbytes/sec under ideal conditions, and if you want high write speed as well as high read speed, a RAID 10 array with 15,000 rpm SAS drives may be necessary.  You can implement this on both ends of the network, in both the workstations and the servers.
0
 
LVL 10

Expert Comment

by:elf_bin
ID: 24410831
I'm a little confused with your question, Are you concerned that a workstation will not be able to read data from a 10GB link fast enough?
If you're worried about storage speed, then solid state disks (SSD) offer the best available read speeds at the moment, but cost a lot of money.

Please clarify your question.

0

Featured Post

Highfive Gives IT Their Time Back

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

Join & Write a Comment

How can this article save you time AND money?  In just a few minutes you may discover something you didn't know existed that is easy enough for you to fix yourself!
Before I go to far, let's explain HA (High Availability) and why you should consider it.  High availability is the mechanism used to provide redundancy to any service at the same site and appears as a single service to the users of that service.  As…
The viewer will learn how to successfully create a multiboot device using the SARDU utility on Windows 7. Start the SARDU utility: Change the image directory to wherever you store your ISOs, this will prevent you from having 2 copies of an ISO wit…
The viewer will learn how to successfully download and install the SARDU utility on Windows 8, without downloading adware.

708 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

16 Experts available now in Live!

Get 1:1 Help Now