Auto start Redhat cluster services cman clvmd qdiskd ... on server reboot; cant detect SAN partition

Posted on 2009-04-25
Last Modified: 2013-12-16

My colleague has difficulty with this : he said he could only start up the  various
Redhat (RHES 5.1) cluster services manually after the Redhat LInux OS is
rebooted/booted up :

a) cd /etc/init.d
b) ./cman start
c) ./clvmd ...
d) ./qdiskd ...
e) ./rgmanager ...

I'm not sure if the sequence of d or e should be interchanged.

Anyway, we would like all the above to be automatic started when the
pair of linux servers (call it lnx3 and lnx4) are booted up.

Q1 :
Would the following actually help or what we're missing  :

Enable cluster software to start upon reboot. At each node run /sbin/chkconfig as follows:
# chkconfig --level 2345 rgmanager on# chkconfig --level 2345 gfs on# chkconfig --level 2345 clvmd on
# chkconfig --level 2345 cman on

We're not using GFS as the Netapp SAN partition is probably mounted as
Unix file system (UFS)

Also, occasionally, when both servers lose connection to the network
together, the SAN partition would be lost and despite rebooting the
servers and running those commands given in a-e above on the primary
node alone (or both nodes), we are not able to mount the SAN partition.
Sometimes after waiting for about ten minutes, it's able to mount.  So
what did we miss, or is this just a matter of waiting or between the a-e
services, we need to pause for a while before proceeding to the next
During bootup, at the console, it will show lcfc... driver (this must be the
fibre channel driver to connect to the SAN) fails to install and
a minute following that, one of the service (think it's clvmd would fail.
However, after bootup & login, issuing "clvmd" after waiting a while
would sometimes work, but sometimes fail.  Is it I have to wait longer
& how can I tweak the delays?

How do I know if our current SAN partition is GFS or not?  (As the
previous person has left after setting up the cluster which I felt is
still missing something)

How can I convert it to GFS if it's not on GFS yet?

We're not using Oracle RAC, how can I set up Oracle instances as
part of the cluster failover service?

We have a pair of cross cables (as fencing) connecting NIC ports of
lnx3 & lnx4 servers : at all times, only one of the fencing NIC port's LED
on lnx3's is on while on lnx4, it's also one of the NIC port's LED is on.
Is this normal?

Rrather green to this, so need step by step instruction
Question by:sunhux
    1 Comment
    LVL 76

    Accepted Solution

    First question first, there is no need to specify the level since it should be included in the file/link stored in init.d.  There should be chkconfig line that sets the order of when this process needs to start/end and under which start levels it should run.

    Check the log /var/log/messages to see why the clustering services fail to start.

    Do the systems have a single path or a multipath to the NetApp SAN?
    Again check the dmesg and /var/log/messages to see if there are any events dealing with inability to mount the LUN i.e. it is not detected.

    Run mount and see what the mount point reflects for the file system.

    Dealing with oracle. First you do not setup the oracle related init files to start.
    Second, you add services to the clustering configuration such that when the cluster moves to the new node, it issues the /etc/init.d/service start directive.

    If it is a partition for Oracle, using RAW/OCFS2 with async I/O might be better.

    Featured Post

    IT, Stop Being Called Into Every Meeting

    Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

    Join & Write a Comment

    Introduction We as admins face situation where we need to redirect websites to another. This may be required as a part of an upgrade keeping the old URL but website should be served from new URL. This document would brief you on different ways ca…
    It’s 2016. Password authentication should be dead — or at least close to dying. But, unfortunately, it has not traversed Quagga stage yet. Using password authentication is like laundering hotel guest linens with a washboard — it’s Passé.
    Learn how to find files with the shell using the find and locate commands. Use locate to find a needle in a haystack.: With locate, check if the file still exists.: Use find to get the actual location of the file.:
    Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.

    730 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    16 Experts available now in Live!

    Get 1:1 Help Now