[x]
Posted via EE Mobile

Search, ask, and monitor your questions on the go with EE Mobile. Visit Experts Exchange from your mobile device and never be out of touch again.
Question
[x]
Attachment Details
[x]
The Solution Rating System

With so many solutions, how can you tell which solutions are most likely to help you and which ones are not? To provide you with a tool to use, we rate our solutions based on various elements that most accurately determine if a solution is a quality solution. To explain what factors affect the solution rating, here are the elements we take into consideration when formulating our solution rating.

  • The Grade of the Solution
  • The Zone Rank of the Expert Providing the Solution
  • The Number of Author and Expert Comments
  • The Number of Experts Contributing
  • The Feedback of the Community

Your Input Matters
Because of the way the system is set up, the most important variable in this equation is you. As a member of Experts Exchange, you are able to cast your vote on the quality of the solutions in regard to how complete, accurate, helpful and easy to understand each solution is. When you provide your feedback, each rating is adjusted accordingly. So, if you see a solution that has a poor rating that you think is a good solution, let us know by rating it. As you do, the rating will be adjusted and will become more accurate for other members of our site.

If you have any suggestions that you would like to make for our rating system, please ask a question in the Suggestions Zone of Community Support.

Thank you!
8.0

Solaris 10 IPMP failover behaviour and RAC interconnect restrictions

Asked by ruggerrick in Sun Solaris, Oracle 10.x, Unix Networking

Tags: Solaris IPMP oracle RAC interconnect unix networking

We are trying to do link state IPMP for Solaris 10 on 3 database servers running oracle RAC. we have 3 networks on 2 subnets 10..x.139.0/24 and 10.x.138.0/24
10.x.138.0 = net2
10.x.139.0 = net3, and net4
net4 is oracle interconnect, only oracle interconnect traffic should go over this(these) interface(s).

-no active probing of the IPMP interfaces is happening (nor can we use it)
-Currently all traffic is going out net3 (nxge4)
-also on failover testing, traffic will default to lowest interface (nxge2) which is bad.
-Tried subnetting in /etc/netmasks file, no luck.
-we've reviewed a number of docs, just missing the last bit of magic

Q) How do we separate traffic to only take net4 traffic to net4 interfaces

Q) Is there a way to control the failover behaviour of the interfaces to only failover to the appropriate IPMP interface?
1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
20:
21:
22:
23:
24:
25:
26:
27:
28:
29:
30:
31:
32:
33:
34:
35:
36:
37:
38:
39:
40:
41:
42:
43:
44:
45:
46:
47:
48:
49:
50:
51:
52:
53:
54:
55:
56:
57:
58:
59:
60:
61:
62:
63:
64:
65:
66:
67:
68:
69:
70:
71:
72:
73:
74:
75:
76:
77:
78:
79:
80:
81:

--IFCONFIG INFO--
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
        inet 127.0.0.1 netmask ff000000
nxge1: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 2
        inet 0.0.0.0 netmask ff000000 broadcast 0.255.255.255
        groupname IPMPnet2
        ether 0:21:28:9:17:ef
nxge2: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 3
        inet 0.0.0.0 netmask ff000000 broadcast 0.255.255.255
        groupname IPMPnet4
        ether 0:21:28:9:17:f0
nxge4: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 4
        inet 10.x.139.50 netmask ffffff00 broadcast 10.x.139.255
        ether 0:21:28:9:29:8e
nxge5: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 5
        inet 10.x.138.73 netmask ffffff00 broadcast 10.x.138.255
        groupname IPMPnet2
        ether 0:21:28:9:29:8f
nxge5:1: flags=201040843<UP,BROADCAST,RUNNING,MULTICAST,DEPRECATED,IPv4,CoS> mtu 1500 index 5
        inet 10.x.138.145 netmask ffffff00 broadcast 10.x.138.255
nxge6: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 6
        inet 10.x.139.195 netmask ffffff00 broadcast 10.x.139.255
        groupname IPMPnet4
        ether 0:21:28:9:29:90
-- NETSTAT-NVR INFO --
IRE Table: IPv4
  Destination             Mask           Gateway          Device Mxfrg Rtt   Ref Flg  Out  In/Fwd
-------------------- --------------- -------------------- ------ ----- ----- --- --- ----- ------
default              0.0.0.0         10.x.138.1                  1500*    0   1 UG    1715      0
10.x.138.0          255.255.255.0   10.x.138.73         nxge5   1500*    0   1 U     1390      0
10.x.138.0          255.255.255.0   10.x.138.73         nxge5:1  1500*    0   1 U        0      0
10.x.139.0          255.255.255.0   10.x.139.50         nxge4   1500*    0   1 U     1148      0
10.x.139.0          255.255.255.0   10.x.139.195        nxge6   1500*    0   1 U        3      0
224.0.0.0            240.0.0.0       10.x.138.73         nxge5   1500*    0   1 U        0      0
127.0.0.1            255.255.255.255 127.0.0.1            lo0     8232*    0  30 UH   69238      0
 
-- hostname.* files --
bash-3.00# more /etc/hostname.*
::::::::::::::
/etc/hostname.nxge1
::::::::::::::
#mn2-db1-net2-2
group IPMPnet2 up
::::::::::::::
/etc/hostname.nxge2
::::::::::::::
#mn2-db1-net4-2
group IPMPnet4 up
::::::::::::::
/etc/hostname.nxge4
::::::::::::::
#mn2-db1-net3
10.x.139.50 netmask 255.255.255.0 broadcast + up
::::::::::::::
/etc/hostname.nxge4.bkup
::::::::::::::
mn2-db1-net3
::::::::::::::
/etc/hostname.nxge5
::::::::::::::
#mn2-db1-net2-1
10.x.138.73 netmask 255.255.255.0 broadcast + group IPMPnet2 up
::::::::::::::
/etc/hostname.nxge6
::::::::::::::
#mn2-db1-net4-1
10.x.139.195 netmask 255.255.255.0 broadcast + group IPMPnet4 up
::::::::::::::
/etc/hostname.nxge6.bkup
::::::::::::::
#mn2-db1-net4-1
10.x.139.195 netmask 255.255.255.0 broadcast + group IPMPnet4 up
 
--netmasks inf --
/etc/netmasks
10.x.139.0     255.255.255.0
10.x.138.0     255.255.255.0
 
-- default router info --
cat /etc/defaultrouter
10.x.138.1
[+][-]04/26/09 11:28 AM, ID: 24237058Assisted Solution

Assisted solutions are selected by the member who asked the question as a comment that contributed to their question's solution.

Start your 30-day free trial to view this Assisted Solution or ask the Experts your question.

 
[+][-]05/01/09 02:06 PM, ID: 24283434Accepted Solution

View this solution now by starting your 30-day free trial. Setting up your free trial is quick, easy, and secure. We will return you to this solution, unlocked, when you're done.

About this solution

Zones: Sun Solaris, Oracle 10.x, Unix Networking
Tags: Solaris IPMP oracle RAC interconnect unix networking
Sign Up Now!
Solution Provided By: ruggerrick
Participating Experts: 1
Solution Grade: A
 
 
Loading Advertisement...
20091111-EE-VQP-89 - Hierarchy / EE_QW_3_20080625