Solved

Building a cluster

Posted on 2003-10-28
16
566 Views
Last Modified: 2013-12-06
Currently I have a copy of Redhat 9 basic, I need to build a 33 node cluster,
(1 master and 32 slave nodes) for one of the professor's that works in my department.

They want to be able to do some parallel processing.

What is the best way to do this, so that upgrades and some fault tol would be built in.

I need some explanation on how to install the master and client nodes.

Thanks
0
Comment
Question by:CMILLER
  • 3
  • 3
  • 2
  • +5
16 Comments
 
LVL 12

Expert Comment

by:paullamhkg
ID: 9638968
Have a check on both url to see this can help

http://openmosixview.com./
http://lartc.org/howto/index.html
0
 
LVL 1

Expert Comment

by:AgelmarJagad
ID: 9639487
You definitly want to try out openmosix.  It is a kernel addition that makes clustering very easy.  The website is http://openmosix.sf.net.  paullamhkg already provided a link to openmosixview.com, which is a site that provides a great gui cluster management suite.  (openmosix.sf.net also has documentation on how to set up a cluster, but if you want more you can go to http://www.ibiblio.org/pub/Linux/docs/HOWTO/other-formats/html_single/Beowulf-HOWTO.html to get the Beowulf howto)
0
 

Expert Comment

by:darkpadden
ID: 9650140
take a look at clusterknoppix http://bofh.be/clusterknoppix/  might help
0
Optimizing Cloud Backup for Low Bandwidth

With cloud storage prices going down a growing number of SMBs start to use it for backup storage. Unfortunately, business data volume rarely fits the average Internet speed. This article provides an overview of main Internet speed challenges and reveals backup best practices.

 
LVL 1

Expert Comment

by:AgelmarJagad
ID: 9650713
If you are trying to build the cluster by booting to CD look tat the grendelsbane disribution: http://nwst.de/.
0
 
LVL 1

Expert Comment

by:learath
ID: 9652650
What type of parallel processing are you going to be doing?  Mosix only works with threaded programs, and has limitations.  We really need more information before we can help.
0
 

Author Comment

by:CMILLER
ID: 9655116
They will be using Fortran 95
0
 

Expert Comment

by:mbpssgms
ID: 9662599
This question interested me since I am thinking of doing the same thing for the computational biophysics group at Manchester University.  
I was going to use NFS, NIS and NQS to form the cluster.  However it appears there is far better/easier ways.  

If anyone has any suggestions/comments on my method I will be most grateful.

Gavin
0
 
LVL 1

Expert Comment

by:sq4you
ID: 9688738
the latest issue of Linux Magazine has lots of good articles on High Availability clusters...of course u mentioned that you are looking for parallel processing clusters so thats a totally different story.
0
 
LVL 1

Expert Comment

by:sq4you
ID: 9688760
u said u are using red hat 9 basic. i dont think you will want to continue to use it as rh's end of life occurs in april 2004

u said u want built in upgrading ability. maybe u should consider the latest Suse.
0
 

Author Comment

by:CMILLER
ID: 9688816
rh's end of life occurs in april 2004

What do you mean?
0
 
LVL 1

Expert Comment

by:AgelmarJagad
ID: 9690703
Red Hat, Inc. has announced that it is discontinuing the Red Hat product line.  They are continuing selling their Red Hat Enterprise software though (I don't know if that is free).  However, even though they are ending Red Hat, they will merge their current work with the Fedora project and continue distributing that without charge, though the support will not be as good as you would get if you got enterprise.
0
 
LVL 12

Expert Comment

by:paullamhkg
ID: 9691507
Red Hat realy give us many topic to discuss, and I don't think there is/are problem on RH ending their support, as long as the RH linux distro you are now using is secured, and running fine will be good enough right.
0
 

Expert Comment

by:mbpssgms
ID: 9694586
I also am concerned about rhl's moves.  I am affraid when things are running well the software will migrate to enterprise leaving fedora users stuck.  AND if say at the univ where we need remote login on clusters we will need AS which will prove too expensive.  It all seems a mess and I may change to debian or free-bsd if I cannot solve these probs.

Also for parallel work we use mpich have a look at

http://www.lfbs.rwth-aachen.de/mp-mpich/



Gavin.
0
 
LVL 12

Expert Comment

by:paullamhkg
ID: 9744817
Well we did provide some good suggestions but not to the asker request, I have no objection on close this TA as PAQ and refund.
0
 
LVL 2

Accepted Solution

by:
Lunchy earned 0 total points
ID: 9767226
Question points reduced (250) and question PAQed by expert recommendation.
0

Featured Post

What is SQL Server and how does it work?

The purpose of this paper is to provide you background on SQL Server. It’s your self-study guide for learning fundamentals. It includes both the history of SQL and its technical basics. Concepts and definitions will form the solid foundation of your future DBA expertise.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

It’s 2016. Password authentication should be dead — or at least close to dying. But, unfortunately, it has not traversed Quagga stage yet. Using password authentication is like laundering hotel guest linens with a washboard — it’s Passé.
Fine Tune your automatic Updates for Ubuntu / Debian
Learn how to navigate the file tree with the shell. Use pwd to print the current working directory: Use ls to list a directory's contents: Use cd to change to a new directory: Use wildcards instead of typing out long directory names: Use ../ to move…
This tutorial will walk an individual through the process of installing the necessary services and then configuring a Windows Server 2012 system as an iSCSI target. To install the necessary roles, go to Server Manager, and select Add Roles and Featu…

830 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question