Solved

Problem with oracle on hp-ux cluster

Posted on 2012-03-12
9
528 Views
Last Modified: 2012-03-31
I have 2 hp-ux servers as a cluster and there is an oracle database running on these servers. They share Eva discs for the database. After a firmware update of the EVA, the servers came up and the db as normally was accessible through the a-node. But the db was behaving very strange and it had to be brought down. After that I rebooted the server (a-node) but when the db came up, was the db on the b-node, so a normal failover for so far. after that I brought the a-node down again and also the b-node. The a-node has been then brought up first but without th db.... I would think when the primary node comes up, the db will come up together with it but this was not the case. When I bring up the b-node, the db comes up with it and is available for use.
Question: how can I make the db come up with the a-node again and leave the b-node as a failover server in the cluster. Because now the a-node is not a failover server because when the b-node goes down, the db does not failover to the a-node. Need some commands to figure out what the problem can be. This is not a Oracle RAC it is a hp-ux cluster. I am not familiar with hp-ux. Some help is appreciated.
0
Comment
Question by:sharscho
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 4
9 Comments
 
LVL 62

Expert Comment

by:gheist
ID: 37712106
Some versions of products would be handy. Also what exactly you did upgrade? How?
0
 

Author Comment

by:sharscho
ID: 37712286
The update has been on the software of the eva storage system and had nothing to do with the servers. All servers that has a connection with the eva had to go down so that the update could take place on storage system.
0
 
LVL 62

Expert Comment

by:gheist
ID: 37712485
It updates with servers working. (Maybe some IO timeout in some picky application)....

So how did you upgrade? Really?

Did you change topology? reset parameters? did FC switch reset? Gimme some dirt?

Where are your VERSIONS???
0
What does it mean to be "Always On"?

Is your cloud always on? With an Always On cloud you won't have to worry about downtime for maintenance or software application code updates, ensuring that your bottom line isn't affected.

 

Author Comment

by:sharscho
ID: 37714481
I will answer your questions first:
The upgrade was for the OS of the controller so it had nothing to do with the FC switches and or the HP-UX servers. FC switches were not resetted.

now today I went further and looking myself. I now know that HPUX serviceguard is the cluster software on that server.
The only thing that occurred was that the primary server has been brought down while the failover server was still running. So I think that the failover server took the disks over and even when I bring down the server with the shutdown -h -y now command, it locks the disks so that when I bring up the primary server it can not mount the disks so that the disks are available on the server. Both disks have been brought down with the command shutdown -h -y now. But when the problems occurred, the database has been brought down and the server has been brought down with only the shutdown command. And all this while the failover server was up abd running.

So the solution I need is for how to bring down the failover server so that it releases the disks so that the primary node can mount the disks at boot up. What are the commands to release and attach disks to a server in a cluster node? There are no errors in the logfile only that the disks are in use when the primary node comes up. I have no serviceguard knowledge so maybe someone can help out with this.
0
 
LVL 62

Expert Comment

by:gheist
ID: 37715337
Thre are some requirements regarding FC controller firmwares for each new eva version. They need some system drivers, and some system patchlevels. On those some oracle hotfixes are advised to keep it supported....

Serviceguard for oracle or serviceguard as such?

VERSION NUMBERS NOW!!!!
0
 

Accepted Solution

by:
sharscho earned 0 total points
ID: 37715689
The problem is not with oracle. I did explain that so many times. I figured it out myself now. The HPUX serviceguard commands for stopping the cluster package had to be used. In my previous comment I clearly stated the issue. that you still ask me for version numbers, is unbelieveable. I halted the cluster package on the b-node and started it on the a-node with the hpux commands. Now the filesystems for the database are mounted again on the a-node and the database is running just fine as it was when I opened this ticket. The update does not have anything to do with the hpux server and or the software running on the hpux server. It only affects the os that runs on the EVA to control the disks and if there was a problem with that, I would not see the disks on the b-node either and the database would not run on the b-node either if the update affects the oracle version. The oracle version is 10G and the eva OS version is 6.2.4.0 Thanks anyways for your attempt for trying to help out.
0
 
LVL 62

Expert Comment

by:gheist
ID: 37719416
Do you use ServiceGuard extension for Oracle?

Do not get ridiculous - version numbers you post so far do not make sense. Please check patchlevels yourself against HP support matrices.
0
 
LVL 62

Expert Comment

by:gheist
ID: 37770245
If you got oracle agents in service guard like me i would be able to help diagnose problem, otherwise i could offer some hand with running oracle as a normal service under service guard..... no knowing which is your problem i am unable to helo.
0
 

Author Closing Comment

by:sharscho
ID: 37790548
Because even when I explained the problem I did not get an advice that was pointing to a solution for the problem. We had an external here in the office for another project and just telling him what happened, he could point out what it can be related to hpux. And he knows about the storage upgrade because he was involved. He said to look at 2 things and point out what had to be done to solve the problem.  That is exchange of knowledge not what I experienced in this ticket.
0

Featured Post

Independent Software Vendors: We Want Your Opinion

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article aims to explain the working of CircularLogArchiver. This tool was designed to solve the buildup of log file in cases where systems do not support circular logging or where circular logging is not enabled
Shell script to create broker configuration file using current broker Configuration, solely for purpose of backup on Linux. Script may need to be modified depending on OS-installation. Please deploy and verify the script in a test environment.
Video by: Steve
Using examples as well as descriptions, step through each of the common simple join types, explaining differences in syntax, differences in expected outputs and showing how the queries run along with the actual outputs based upon a simple set of dem…
This video shows syntax for various backup options while discussing how the different basic backup types work.  It explains how to take full backups, incremental level 0 backups, incremental level 1 backups in both differential and cumulative mode a…
Suggested Courses

632 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question