[Okta Webinar] Learn how to a build a cloud-first strategyRegister Now

x
?
Solved

Solaris 10 IPMP failover behaviour and RAC interconnect restrictions

Posted on 2009-04-21
2
Medium Priority
?
1,843 Views
Last Modified: 2013-12-21
We are trying to do link state IPMP for Solaris 10 on 3 database servers running oracle RAC. we have 3 networks on 2 subnets 10..x.139.0/24 and 10.x.138.0/24
10.x.138.0 = net2
10.x.139.0 = net3, and net4
net4 is oracle interconnect, only oracle interconnect traffic should go over this(these) interface(s).

-no active probing of the IPMP interfaces is happening (nor can we use it)
-Currently all traffic is going out net3 (nxge4)
-also on failover testing, traffic will default to lowest interface (nxge2) which is bad.
-Tried subnetting in /etc/netmasks file, no luck.
-we've reviewed a number of docs, just missing the last bit of magic

Q) How do we separate traffic to only take net4 traffic to net4 interfaces

Q) Is there a way to control the failover behaviour of the interfaces to only failover to the appropriate IPMP interface?

--IFCONFIG INFO--
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
        inet 127.0.0.1 netmask ff000000
nxge1: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 2
        inet 0.0.0.0 netmask ff000000 broadcast 0.255.255.255
        groupname IPMPnet2
        ether 0:21:28:9:17:ef
nxge2: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 3
        inet 0.0.0.0 netmask ff000000 broadcast 0.255.255.255
        groupname IPMPnet4
        ether 0:21:28:9:17:f0
nxge4: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 4
        inet 10.x.139.50 netmask ffffff00 broadcast 10.x.139.255
        ether 0:21:28:9:29:8e
nxge5: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 5
        inet 10.x.138.73 netmask ffffff00 broadcast 10.x.138.255
        groupname IPMPnet2
        ether 0:21:28:9:29:8f
nxge5:1: flags=201040843<UP,BROADCAST,RUNNING,MULTICAST,DEPRECATED,IPv4,CoS> mtu 1500 index 5
        inet 10.x.138.145 netmask ffffff00 broadcast 10.x.138.255
nxge6: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 6
        inet 10.x.139.195 netmask ffffff00 broadcast 10.x.139.255
        groupname IPMPnet4
        ether 0:21:28:9:29:90
-- NETSTAT-NVR INFO --
IRE Table: IPv4
  Destination             Mask           Gateway          Device Mxfrg Rtt   Ref Flg  Out  In/Fwd
-------------------- --------------- -------------------- ------ ----- ----- --- --- ----- ------
default              0.0.0.0         10.x.138.1                  1500*    0   1 UG    1715      0
10.x.138.0          255.255.255.0   10.x.138.73         nxge5   1500*    0   1 U     1390      0
10.x.138.0          255.255.255.0   10.x.138.73         nxge5:1  1500*    0   1 U        0      0
10.x.139.0          255.255.255.0   10.x.139.50         nxge4   1500*    0   1 U     1148      0
10.x.139.0          255.255.255.0   10.x.139.195        nxge6   1500*    0   1 U        3      0
224.0.0.0            240.0.0.0       10.x.138.73         nxge5   1500*    0   1 U        0      0
127.0.0.1            255.255.255.255 127.0.0.1            lo0     8232*    0  30 UH   69238      0
 
-- hostname.* files --
bash-3.00# more /etc/hostname.*
::::::::::::::
/etc/hostname.nxge1
::::::::::::::
#mn2-db1-net2-2
group IPMPnet2 up
::::::::::::::
/etc/hostname.nxge2
::::::::::::::
#mn2-db1-net4-2
group IPMPnet4 up
::::::::::::::
/etc/hostname.nxge4
::::::::::::::
#mn2-db1-net3
10.x.139.50 netmask 255.255.255.0 broadcast + up
::::::::::::::
/etc/hostname.nxge4.bkup
::::::::::::::
mn2-db1-net3
::::::::::::::
/etc/hostname.nxge5
::::::::::::::
#mn2-db1-net2-1
10.x.138.73 netmask 255.255.255.0 broadcast + group IPMPnet2 up
::::::::::::::
/etc/hostname.nxge6
::::::::::::::
#mn2-db1-net4-1
10.x.139.195 netmask 255.255.255.0 broadcast + group IPMPnet4 up
::::::::::::::
/etc/hostname.nxge6.bkup
::::::::::::::
#mn2-db1-net4-1
10.x.139.195 netmask 255.255.255.0 broadcast + group IPMPnet4 up
 
--netmasks inf --
/etc/netmasks
10.x.139.0     255.255.255.0
10.x.138.0     255.255.255.0
 
-- default router info --
cat /etc/defaultrouter
10.x.138.1

Open in new window

0
Comment
Question by:ruggerrick
2 Comments
 
LVL 22

Assisted Solution

by:Brian Utterback
Brian Utterback earned 400 total points
ID: 24237058
Please post the output of "netstat -rn". What is the IP address of the other end of the net4 link?
0
 

Accepted Solution

by:
ruggerrick earned 0 total points
ID: 24283434
we had to break down the config, I cannot get an applicable output of netstat -nr
0

Featured Post

Independent Software Vendors: We Want Your Opinion

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Tech spooks aren't just for those who are tech savvy, it also happens to those of us running a business. Check out the top tech spooks for business owners.
In this article, the configuration steps in Zabbix to monitor devices via SNMP will be discussed with some real examples on Cisco Router/Switch, Catalyst Switch, NAS Synology device.
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.
In this video we outline the Physical Segments view of NetCrunch network monitor. By following this brief how-to video, you will be able to learn how NetCrunch visualizes your network, how granular is the information collected, as well as where to f…
Suggested Courses

868 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question