How to simulate an Oracle RAC node down scenario to test Fast Connection failover ?

Other than normal shutting down  the instance on one of the node, can someone just methods to simulate the node down scenario with some simple commands on Linux ? No pulling out the plug is possible as the machines are located elsewhere.

I want to test the Oracle FCF by simulating a node outage situation. I want some easy methods to simulate the outage(not graceful outage) to prove the point.

Any pointers ?

Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Mark GeerlingsDatabase AdministratorCommented:
If the server has multiple NICs, and the RAC interconnect uses a different NIC (and IP address) than you use to connect the Linux O/S, you could shut down the NIC that the interconnect uses.

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
lsmkAuthor Commented:

Could you please tell the commands to shutdown the NIC of the interconnect ?
Mark GeerlingsDatabase AdministratorCommented:
That is a Linux O/S command, not an Oracle command.  I know that it is possible, but I'm not a master of the Linux O/S commands.  If you have a Linux System Administrator, ask him or her for help with this.  If you are also the Linux administrator for this server, I know that you will have to connect as "root" to do this command, but you may have to ask a question in the Linux section of this site (or search for similar questions there) about how to shut down and restart an individual NIC in a Linux machine with multiple NICs.
Determine the Perfect Price for Your IT Services

Do you wonder if your IT business is truly profitable or if you should raise your prices? Learn how to calculate your overhead burden with our free interactive tool and use it to determine the right price for your IT services. Download your free eBook now!

Please take a look at:

To stop / disable network interface use ifconfig command. It is  used to configure the kernel-resident network interfaces.
 You can pass up and down flags/option to this command.
 ==> up - This flag causes the interface to be activated. It is implicitly specified if an address is assigned to the interface.
 ==> down -   This  flag causes the driver for this interface to be shut down.
 So the following command will disable eth1: ifconfig eth1 down

And to get it back type the command: ifconfig eth1 up


lsmkAuthor Commented:
Thanks Markgeer and Tolomir. I want to use the following commands in RAC to simulate abnormal outage in different combinations.

1) The linux commands(ifconfig or ifdown)  to bring down the network interface
2) lsnrctl to stop the listener service of the node to be put down
3) svrctl with (-o abort -i <instance>) option to bring down the node
4) Of course, shutting down the server itself


1.) solved
2.) lsrnctl stop (as oracle user on the shell)
4.) shutdown -h now (as user root on the shell)   <-- don't try this remote ;-)

It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Oracle Database

From novice to tech pro — start learning today.