Problem with oracle on hp-ux cluster

Posted on 2012-03-12
Last Modified: 2012-03-31
I have 2 hp-ux servers as a cluster and there is an oracle database running on these servers. They share Eva discs for the database. After a firmware update of the EVA, the servers came up and the db as normally was accessible through the a-node. But the db was behaving very strange and it had to be brought down. After that I rebooted the server (a-node) but when the db came up, was the db on the b-node, so a normal failover for so far. after that I brought the a-node down again and also the b-node. The a-node has been then brought up first but without th db.... I would think when the primary node comes up, the db will come up together with it but this was not the case. When I bring up the b-node, the db comes up with it and is available for use.
Question: how can I make the db come up with the a-node again and leave the b-node as a failover server in the cluster. Because now the a-node is not a failover server because when the b-node goes down, the db does not failover to the a-node. Need some commands to figure out what the problem can be. This is not a Oracle RAC it is a hp-ux cluster. I am not familiar with hp-ux. Some help is appreciated.
Question by:sharscho
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 4
LVL 62

Expert Comment

ID: 37712106
Some versions of products would be handy. Also what exactly you did upgrade? How?

Author Comment

ID: 37712286
The update has been on the software of the eva storage system and had nothing to do with the servers. All servers that has a connection with the eva had to go down so that the update could take place on storage system.
LVL 62

Expert Comment

ID: 37712485
It updates with servers working. (Maybe some IO timeout in some picky application)....

So how did you upgrade? Really?

Did you change topology? reset parameters? did FC switch reset? Gimme some dirt?

Where are your VERSIONS???
The Eight Noble Truths of Backup and Recovery

How can IT departments tackle the challenges of a Big Data world? This white paper provides a roadmap to success and helps companies ensure that all their data is safe and secure, no matter if it resides on-premise with physical or virtual machines or in the cloud.


Author Comment

ID: 37714481
I will answer your questions first:
The upgrade was for the OS of the controller so it had nothing to do with the FC switches and or the HP-UX servers. FC switches were not resetted.

now today I went further and looking myself. I now know that HPUX serviceguard is the cluster software on that server.
The only thing that occurred was that the primary server has been brought down while the failover server was still running. So I think that the failover server took the disks over and even when I bring down the server with the shutdown -h -y now command, it locks the disks so that when I bring up the primary server it can not mount the disks so that the disks are available on the server. Both disks have been brought down with the command shutdown -h -y now. But when the problems occurred, the database has been brought down and the server has been brought down with only the shutdown command. And all this while the failover server was up abd running.

So the solution I need is for how to bring down the failover server so that it releases the disks so that the primary node can mount the disks at boot up. What are the commands to release and attach disks to a server in a cluster node? There are no errors in the logfile only that the disks are in use when the primary node comes up. I have no serviceguard knowledge so maybe someone can help out with this.
LVL 62

Expert Comment

ID: 37715337
Thre are some requirements regarding FC controller firmwares for each new eva version. They need some system drivers, and some system patchlevels. On those some oracle hotfixes are advised to keep it supported....

Serviceguard for oracle or serviceguard as such?


Accepted Solution

sharscho earned 0 total points
ID: 37715689
The problem is not with oracle. I did explain that so many times. I figured it out myself now. The HPUX serviceguard commands for stopping the cluster package had to be used. In my previous comment I clearly stated the issue. that you still ask me for version numbers, is unbelieveable. I halted the cluster package on the b-node and started it on the a-node with the hpux commands. Now the filesystems for the database are mounted again on the a-node and the database is running just fine as it was when I opened this ticket. The update does not have anything to do with the hpux server and or the software running on the hpux server. It only affects the os that runs on the EVA to control the disks and if there was a problem with that, I would not see the disks on the b-node either and the database would not run on the b-node either if the update affects the oracle version. The oracle version is 10G and the eva OS version is Thanks anyways for your attempt for trying to help out.
LVL 62

Expert Comment

ID: 37719416
Do you use ServiceGuard extension for Oracle?

Do not get ridiculous - version numbers you post so far do not make sense. Please check patchlevels yourself against HP support matrices.
LVL 62

Expert Comment

ID: 37770245
If you got oracle agents in service guard like me i would be able to help diagnose problem, otherwise i could offer some hand with running oracle as a normal service under service guard..... no knowing which is your problem i am unable to helo.

Author Closing Comment

ID: 37790548
Because even when I explained the problem I did not get an advice that was pointing to a solution for the problem. We had an external here in the office for another project and just telling him what happened, he could point out what it can be related to hpux. And he knows about the storage upgrade because he was involved. He said to look at 2 things and point out what had to be done to solve the problem.  That is exchange of knowledge not what I experienced in this ticket.

Featured Post

Free Tool: Subnet Calculator

The subnet calculator helps you design networks by taking an IP address and network mask and returning information such as network, broadcast address, and host range.

One of a set of tools we're offering as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
spectrum scale snapshot  resotre/mount 1 29
setting local variables in a cursor block 3 28
Shell Script- gzip 5 46
Linux kernel panic ext3-fs error 14 24
Finding original email is quite difficult due to their duplicates. From this article, you will come to know why multiple duplicates of same emails appear and how to delete duplicate emails from Outlook securely and instantly while vital emails remai…
Concerto Cloud Services, a provider of fully managed private, public and hybrid cloud solutions, announced today it was named to the 20 Coolest Cloud Infrastructure Vendors Of The 2017 Cloud  (…
This videos aims to give the viewer a basic demonstration of how a user can query current session information by using the SYS_CONTEXT function
This video shows how to configure and send email from and Oracle database using both UTL_SMTP and UTL_MAIL, as well as comparing UTL_SMTP to a manual SMTP conversation with a mail server.

735 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question