Building a cluster

Currently I have a copy of Redhat 9 basic, I need to build a 33 node cluster,
(1 master and 32 slave nodes) for one of the professor's that works in my department.

They want to be able to do some parallel processing.

What is the best way to do this, so that upgrades and some fault tol would be built in.

I need some explanation on how to install the master and client nodes.

Thanks
CMILLERAsked:
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

x
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

paullamhkgCommented:
Have a check on both url to see this can help

http://openmosixview.com./
http://lartc.org/howto/index.html
0
AgelmarJagadCommented:
You definitly want to try out openmosix.  It is a kernel addition that makes clustering very easy.  The website is http://openmosix.sf.net.  paullamhkg already provided a link to openmosixview.com, which is a site that provides a great gui cluster management suite.  (openmosix.sf.net also has documentation on how to set up a cluster, but if you want more you can go to http://www.ibiblio.org/pub/Linux/docs/HOWTO/other-formats/html_single/Beowulf-HOWTO.html to get the Beowulf howto)
0
darkpaddenCommented:
take a look at clusterknoppix http://bofh.be/clusterknoppix/  might help
0
The 7 Worst Nightmares of a Sysadmin

Fear not! To defend your business’ IT systems we’re going to shine a light on the seven most sinister terrors that haunt sysadmins. That way you can be sure there’s nothing in your stack waiting to go bump in the night.

AgelmarJagadCommented:
If you are trying to build the cluster by booting to CD look tat the grendelsbane disribution: http://nwst.de/.
0
learathCommented:
What type of parallel processing are you going to be doing?  Mosix only works with threaded programs, and has limitations.  We really need more information before we can help.
0
CMILLERAuthor Commented:
They will be using Fortran 95
0
mbpssgmsCommented:
This question interested me since I am thinking of doing the same thing for the computational biophysics group at Manchester University.  
I was going to use NFS, NIS and NQS to form the cluster.  However it appears there is far better/easier ways.  

If anyone has any suggestions/comments on my method I will be most grateful.

Gavin
0
sq4youCommented:
the latest issue of Linux Magazine has lots of good articles on High Availability clusters...of course u mentioned that you are looking for parallel processing clusters so thats a totally different story.
0
sq4youCommented:
u said u are using red hat 9 basic. i dont think you will want to continue to use it as rh's end of life occurs in april 2004

u said u want built in upgrading ability. maybe u should consider the latest Suse.
0
CMILLERAuthor Commented:
rh's end of life occurs in april 2004

What do you mean?
0
AgelmarJagadCommented:
Red Hat, Inc. has announced that it is discontinuing the Red Hat product line.  They are continuing selling their Red Hat Enterprise software though (I don't know if that is free).  However, even though they are ending Red Hat, they will merge their current work with the Fedora project and continue distributing that without charge, though the support will not be as good as you would get if you got enterprise.
0
paullamhkgCommented:
Red Hat realy give us many topic to discuss, and I don't think there is/are problem on RH ending their support, as long as the RH linux distro you are now using is secured, and running fine will be good enough right.
0
mbpssgmsCommented:
I also am concerned about rhl's moves.  I am affraid when things are running well the software will migrate to enterprise leaving fedora users stuck.  AND if say at the univ where we need remote login on clusters we will need AS which will prove too expensive.  It all seems a mess and I may change to debian or free-bsd if I cannot solve these probs.

Also for parallel work we use mpich have a look at

http://www.lfbs.rwth-aachen.de/mp-mpich/



Gavin.
0
paullamhkgCommented:
Well we did provide some good suggestions but not to the asker request, I have no objection on close this TA as PAQ and refund.
0
LunchyCommented:
Question points reduced (250) and question PAQed by expert recommendation.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Linux Distributions

From novice to tech pro — start learning today.