Workstations capable of taking in data to disk or ram from a 10Ge connection without any waits

Posted on 2009-05-15
Last Modified: 2012-05-07
We are taking images from computers attached to microscopes which acquire images in many different formats and in many different ways.  Some of these will be high-speed time lapse images which could come in to the  microscope computers at 100 plus frames per second.  Stacks of these images could be as large as 10s or even 100 GBytes in size.  When experiments are done these images will be dumped to a server over cat5e gige connections.  The workstations that we are talking about are going in a room for image processing visualization and analysis off line.  There will be a variety of software packages which will be used for this.  Each workstation will have at least 1 cat5e gigabit ethernet connection (we are hoping that we can boost this to 10G but that does not seem to be probable right now).  We would want to have the workstations capable of taking in data to disk or ram from a 10Ge connection without any waits.  This should be a bit under 100Mbytes per second and should not be a problem with the Motherboard and cpus we specified. We will also have a lot of computationally intensive tasks to be performed on these images which is why we want the new i7 core cpus with the on-chip memory controller.  These computations have been clocked at 10 to 15 min on dual 4 core xeons with 16G of ram, so the number crunching is substantial.  We don't want to have these images stored on the workstations but left on the server so that they can be accessed from any of the workstations.

We would want to know the best way too retrieve them,  We also would want to have the workstations capable of taking in data to disk or ram from a 10Ge connection without any waits?

Question by:ftravaline
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
LVL 69

Accepted Solution

Callandor earned 500 total points
ID: 24398074
It sounds like you're going to have to go with some kind of RAID array - individual drives can only transfer data at a maximum of 100Mbytes/sec under ideal conditions, and if you want high write speed as well as high read speed, a RAID 10 array with 15,000 rpm SAS drives may be necessary.  You can implement this on both ends of the network, in both the workstations and the servers.
LVL 10

Expert Comment

ID: 24410831
I'm a little confused with your question, Are you concerned that a workstation will not be able to read data from a 10GB link fast enough?
If you're worried about storage speed, then solid state disks (SSD) offer the best available read speeds at the moment, but cost a lot of money.

Please clarify your question.


Featured Post

Are You Headed to Black Hat USA 2017?

Getting ready for Black Hat next week? Kick things off with the WatchGuard Badge Challenge and test your puzzle and cipher skills. Do you have what it takes to earn our limited edition Firebox Badge? Get started today -

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

I don't know if many of you have made the great mistake of using the Cisco Thin Client model with the management software VXC. If you have then you are probably more then familiar with the incredibly clunky interface, the numerous work arounds, and …
Or at least that’s the word according to a new blog from Tech Target on AWS’s new Managed Services (MS) offering. According to the blog, AWS is launching their AWS MS program to expedite the adoption of cloud by Fortune 1000 and Global 2000 companie…
The viewer will learn how to successfully create a multiboot device using the SARDU utility on Windows 7. Start the SARDU utility: Change the image directory to wherever you store your ISOs, this will prevent you from having 2 copies of an ISO wit…
The viewer will learn how to successfully download and install the SARDU utility on Windows 8, without downloading adware.
Suggested Courses

617 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question