Building a cluster

CMILLER
CMILLER used Ask the Experts™
on
Currently I have a copy of Redhat 9 basic, I need to build a 33 node cluster,
(1 master and 32 slave nodes) for one of the professor's that works in my department.

They want to be able to do some parallel processing.

What is the best way to do this, so that upgrades and some fault tol would be built in.

I need some explanation on how to install the master and client nodes.

Thanks
Comment
Watch Question

Do more with

Expert Office
EXPERT OFFICE® is a registered trademark of EXPERTS EXCHANGE®
Have a check on both url to see this can help

http://openmosixview.com./
http://lartc.org/howto/index.html
You definitly want to try out openmosix.  It is a kernel addition that makes clustering very easy.  The website is http://openmosix.sf.net.  paullamhkg already provided a link to openmosixview.com, which is a site that provides a great gui cluster management suite.  (openmosix.sf.net also has documentation on how to set up a cluster, but if you want more you can go to http://www.ibiblio.org/pub/Linux/docs/HOWTO/other-formats/html_single/Beowulf-HOWTO.html to get the Beowulf howto)
take a look at clusterknoppix http://bofh.be/clusterknoppix/  might help
Should you be charging more for IT Services?

Do you wonder if your IT business is truly profitable or if you should raise your prices? Learn how to calculate your overhead burden using our free interactive tool and use it to determine the right price for your IT services. Start calculating Now!

If you are trying to build the cluster by booting to CD look tat the grendelsbane disribution: http://nwst.de/.

Commented:
What type of parallel processing are you going to be doing?  Mosix only works with threaded programs, and has limitations.  We really need more information before we can help.

Author

Commented:
They will be using Fortran 95

Commented:
This question interested me since I am thinking of doing the same thing for the computational biophysics group at Manchester University.  
I was going to use NFS, NIS and NQS to form the cluster.  However it appears there is far better/easier ways.  

If anyone has any suggestions/comments on my method I will be most grateful.

Gavin

Commented:
the latest issue of Linux Magazine has lots of good articles on High Availability clusters...of course u mentioned that you are looking for parallel processing clusters so thats a totally different story.

Commented:
u said u are using red hat 9 basic. i dont think you will want to continue to use it as rh's end of life occurs in april 2004

u said u want built in upgrading ability. maybe u should consider the latest Suse.

Author

Commented:
rh's end of life occurs in april 2004

What do you mean?
Red Hat, Inc. has announced that it is discontinuing the Red Hat product line.  They are continuing selling their Red Hat Enterprise software though (I don't know if that is free).  However, even though they are ending Red Hat, they will merge their current work with the Fedora project and continue distributing that without charge, though the support will not be as good as you would get if you got enterprise.
Red Hat realy give us many topic to discuss, and I don't think there is/are problem on RH ending their support, as long as the RH linux distro you are now using is secured, and running fine will be good enough right.

Commented:
I also am concerned about rhl's moves.  I am affraid when things are running well the software will migrate to enterprise leaving fedora users stuck.  AND if say at the univ where we need remote login on clusters we will need AS which will prove too expensive.  It all seems a mess and I may change to debian or free-bsd if I cannot solve these probs.

Also for parallel work we use mpich have a look at

http://www.lfbs.rwth-aachen.de/mp-mpich/



Gavin.
Well we did provide some good suggestions but not to the asker request, I have no objection on close this TA as PAQ and refund.
Commented:
Question points reduced (250) and question PAQed by expert recommendation.

Do more with

Expert Office
Submit tech questions to Ask the Experts™ at any time to receive solutions, advice, and new ideas from leading industry professionals.

Start 7-Day Free Trial