10Gig Ethernet
Problem: Not able to ping ISCSI ports on Dell MD3600 using 10G ethernet adapter connected to 10 G ethernet switch.
Environment: Dell MD3600i ISCSI storage, Dell R900, Broadcom 10G dual port ethernet adapter, Solaris10 x86, and CISCO 10 G switch
Here are the steps I have done on the Server.
Set the speed of ISCSI ports to 10G using Dell Storage Manager Client utility
#ifconfig -a plumb
All the four ports bnxe0, bnxe1, bnxe2 and bnxe3 are available
(server has 2 NICs both 10G broadcom)
Next I assign IP address to one port
# ifconfig bnxe0 192.168.10.10 netmask 255.255.255.0 up
Once this is done, from the server I can not ping any device connected to the same switch on the same network, like my management workstation which is 192.168.10.20
If I move all the network cables to another switch, 10/100/1G, I am able to ping all the devices, ISCSI ports as well as the management workstation (I do make sure to change the speed for all the ISCSI ports back to 1G)
iscsiadm list discovery-address also works fine.
Also want to confirm that when all the 10G devices (ethernet adapter as well as ISCSI ports) are connected to the 10G switch, I do see green LED on the ethernet switch, which confirms a 10G connection. Where as my Management workstation port on the switch stays amber indicating 10/100 connection. But from management workstation I can still ping the ISCSI ports, but can not ping the server's ethernet port.
Environment: Dell MD3600i ISCSI storage, Dell R900, Broadcom 10G dual port ethernet adapter, Solaris10 x86, and CISCO 10 G switch
Here are the steps I have done on the Server.
Set the speed of ISCSI ports to 10G using Dell Storage Manager Client utility
#ifconfig -a plumb
All the four ports bnxe0, bnxe1, bnxe2 and bnxe3 are available
(server has 2 NICs both 10G broadcom)
Next I assign IP address to one port
# ifconfig bnxe0 192.168.10.10 netmask 255.255.255.0 up
Once this is done, from the server I can not ping any device connected to the same switch on the same network, like my management workstation which is 192.168.10.20
If I move all the network cables to another switch, 10/100/1G, I am able to ping all the devices, ISCSI ports as well as the management workstation (I do make sure to change the speed for all the ISCSI ports back to 1G)
iscsiadm list discovery-address also works fine.
Also want to confirm that when all the 10G devices (ethernet adapter as well as ISCSI ports) are connected to the 10G switch, I do see green LED on the ethernet switch, which confirms a 10G connection. Where as my Management workstation port on the switch stays amber indicating 10/100 connection. But from management workstation I can still ping the ISCSI ports, but can not ping the server's ethernet port.
Craig Beck
What configuration do you have on the 10G switch?
ASKER
I did not do any configuration on switch and I am not sure how to do or check it.
Ok, you said you connect all 4 10G ports to the switch...
Are they meant to be individual NICs, or are they supposed to be some kind of redundant/resilient setup?
Are they meant to be individual NICs, or are they supposed to be some kind of redundant/resilient setup?
ASKER
I have connected only two ports, one port on each NIC, to the 10 G switch.
Initially I just want to be able to see ISCSI ports using just one NIC port, but later I do want to set up redundancy using IP Multipathing.
Initially I just want to be able to see ISCSI ports using just one NIC port, but later I do want to set up redundancy using IP Multipathing.
ASKER
Is there anything extra that needs to be done on the Solaris box to configure 10G NICs?
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.