Solved

Building a cluster

Posted on 2003-10-28
16
564 Views
Last Modified: 2013-12-06
Currently I have a copy of Redhat 9 basic, I need to build a 33 node cluster,
(1 master and 32 slave nodes) for one of the professor's that works in my department.

They want to be able to do some parallel processing.

What is the best way to do this, so that upgrades and some fault tol would be built in.

I need some explanation on how to install the master and client nodes.

Thanks
0
Comment
Question by:CMILLER
  • 3
  • 3
  • 2
  • +5
16 Comments
 
LVL 12

Expert Comment

by:paullamhkg
ID: 9638968
Have a check on both url to see this can help

http://openmosixview.com./
http://lartc.org/howto/index.html
0
 
LVL 1

Expert Comment

by:AgelmarJagad
ID: 9639487
You definitly want to try out openmosix.  It is a kernel addition that makes clustering very easy.  The website is http://openmosix.sf.net.  paullamhkg already provided a link to openmosixview.com, which is a site that provides a great gui cluster management suite.  (openmosix.sf.net also has documentation on how to set up a cluster, but if you want more you can go to http://www.ibiblio.org/pub/Linux/docs/HOWTO/other-formats/html_single/Beowulf-HOWTO.html to get the Beowulf howto)
0
 

Expert Comment

by:darkpadden
ID: 9650140
take a look at clusterknoppix http://bofh.be/clusterknoppix/  might help
0
 
LVL 1

Expert Comment

by:AgelmarJagad
ID: 9650713
If you are trying to build the cluster by booting to CD look tat the grendelsbane disribution: http://nwst.de/.
0
 
LVL 1

Expert Comment

by:learath
ID: 9652650
What type of parallel processing are you going to be doing?  Mosix only works with threaded programs, and has limitations.  We really need more information before we can help.
0
 

Author Comment

by:CMILLER
ID: 9655116
They will be using Fortran 95
0
 

Expert Comment

by:mbpssgms
ID: 9662599
This question interested me since I am thinking of doing the same thing for the computational biophysics group at Manchester University.  
I was going to use NFS, NIS and NQS to form the cluster.  However it appears there is far better/easier ways.  

If anyone has any suggestions/comments on my method I will be most grateful.

Gavin
0
Give your grad a cloud of their own!

With up to 8TB of storage, give your favorite graduate their own personal cloud to centralize all their photos, videos and music in one safe place. They can save, sync and share all their stuff, and automatic photo backup helps free up space on their smartphone and tablet.

 
LVL 1

Expert Comment

by:sq4you
ID: 9688738
the latest issue of Linux Magazine has lots of good articles on High Availability clusters...of course u mentioned that you are looking for parallel processing clusters so thats a totally different story.
0
 
LVL 1

Expert Comment

by:sq4you
ID: 9688760
u said u are using red hat 9 basic. i dont think you will want to continue to use it as rh's end of life occurs in april 2004

u said u want built in upgrading ability. maybe u should consider the latest Suse.
0
 

Author Comment

by:CMILLER
ID: 9688816
rh's end of life occurs in april 2004

What do you mean?
0
 
LVL 1

Expert Comment

by:AgelmarJagad
ID: 9690703
Red Hat, Inc. has announced that it is discontinuing the Red Hat product line.  They are continuing selling their Red Hat Enterprise software though (I don't know if that is free).  However, even though they are ending Red Hat, they will merge their current work with the Fedora project and continue distributing that without charge, though the support will not be as good as you would get if you got enterprise.
0
 
LVL 12

Expert Comment

by:paullamhkg
ID: 9691507
Red Hat realy give us many topic to discuss, and I don't think there is/are problem on RH ending their support, as long as the RH linux distro you are now using is secured, and running fine will be good enough right.
0
 

Expert Comment

by:mbpssgms
ID: 9694586
I also am concerned about rhl's moves.  I am affraid when things are running well the software will migrate to enterprise leaving fedora users stuck.  AND if say at the univ where we need remote login on clusters we will need AS which will prove too expensive.  It all seems a mess and I may change to debian or free-bsd if I cannot solve these probs.

Also for parallel work we use mpich have a look at

http://www.lfbs.rwth-aachen.de/mp-mpich/



Gavin.
0
 
LVL 12

Expert Comment

by:paullamhkg
ID: 9744817
Well we did provide some good suggestions but not to the asker request, I have no objection on close this TA as PAQ and refund.
0
 
LVL 2

Accepted Solution

by:
Lunchy earned 0 total points
ID: 9767226
Question points reduced (250) and question PAQed by expert recommendation.
0

Featured Post

Best Practices: Disaster Recovery Testing

Besides backup, any IT division should have a disaster recovery plan. You will find a few tips below relating to the development of such a plan and to what issues one should pay special attention in the course of backup planning.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
AWS RDS 3 67
AWS CLI - Issue with name display 2 51
Using init script with Systemd: need help crafting unit file 11 79
How to learn Linux? 10 43
This article is an update and follow-up of my previous article:   Storage 101: common concepts in the IT enterprise storage This time, I expand on more frequently used storage concepts.
Are you looking to recover an email message or a contact you just deleted mistakenly? Or you are searching for a contact that you erased from your MS Outlook ‘Contacts’ folder and now realized that it was important.
This tutorial will walk an individual through configuring a drive on a Windows Server 2008 to perform shadow copies in order to quickly recover deleted files and folders. Click on Start and then select Computer to view the available drives on the se…
This demo shows you how to set up the containerized NetScaler CPX with NetScaler Management and Analytics System in a non-routable Mesos/Marathon environment for use with Micro-Services applications.

920 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

15 Experts available now in Live!

Get 1:1 Help Now