Link to home
Start Free TrialLog in
Avatar of sysprof
sysprof

asked on

Connection to EMC Celerra hosted NFS lost when Jumbo frame used

I have an existing VMware 4.1 environment of 8 esx hosts 4.1 and vCentr4.1 connected to NFS volumes hosted on EMC Celerra. NFS vSwitch is configured with jumbo frame of 9000 and all working fine. In parallel I have built a new vSphere5 environment of 3 Esx5 hosts (dl580g7 256gb ram 40 cores each) I have configured all networking including NFS that connects to same NFS volumes on EMC Celerra as my live 4.1 environment. My new vsphere 5 is not live. I can connect to NFS volume with MTU of 1500 but as soon I change this to 9000 (to match my live environment) and reboot esxi5 I lose connection to NFS test volume. Could someone advice why is it so? Is this a bug in esxi5? It works fine with 4.1 but not in 5. Only difference is that I have created a new test volume on same EMC Celerra SAN that I keep losing in esxi5. I used host profile to configure my esxi5 hosts.
ASKER CERTIFIED SOLUTION
Avatar of Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Flag of United Kingdom of Great Britain and Northern Ireland image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of sysprof
sysprof

ASKER

Yes we have MTU enabled globally on a Cisco SAN switch and I have direct connection to it. We have ether channel between SAN switch and the EMC NAS switch. My live environment is rerunning of HP blades but they all come to same SAN switch that I'm connected directly to.
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of sysprof

ASKER

I'm on latest build. Yes MTU on port group for NFS. Well, host will be rebooted at some point if not immediately. If I don't reboot it loses SAN any way
okay, just checkng, so it connects to nfs mount, and then disconnects?

Im wondering if you need an additional NFS settings setting in Advanced Settings,mas recommended by vendor
Avatar of sysprof

ASKER

I have done tcp heap and tcp heap max to 24 and 96 respectively and NFS settings to match my live environment under advanced settings Cant think of anything else Would it make any difference if I remove and recreate port group just in coz I used host profile to configure my esx hosts? Also my switch Port and NIC settings are auto negotiate. Should i change them to static? Or Is there any bios settings I should change?
we have debated the auto neg versus static options here with our Cisco guys, and they have always recommended Auto both ends, but its worth changing if the port is dropping out, if you can see stats on the physical switch.

Ive seen host profiles get configuration wrong, I would test a manual creation of switches, portgroups
Avatar of sysprof

ASKER

Ok will try tomorrow and see if that makes a difference thx
Avatar of sysprof

ASKER

I have tried configuring from scratch but still lost my coonectivity to SAN I'm worried that without MTU being 9000 I will get into trouble when migrating my live 4.1 VM(s) I intend to simply detach my 4.1 host and attach to 5.1 host and then vmotion my VM(s) any ideas? Really stuck
Avatar of sysprof

ASKER

Strange thing is that I can browse my temp SAN volume or even create or delete folders with NFS being MTU 9000 but as soon I start vmotion any test vm it gets stuck at 9 % and fails in about 10 min Data store shows as inaccessible but still I can create and elected folders while it's inaccessible my to heap and max ate 24 and 96 NFS send receive buffer size both ate 64
Avatar of sysprof

ASKER

When I run ping at my 5.0 host with option for jumbo frame It fails but same ping works on my live 4.1 host My nics support jumbo frames Is there any way I can change NIC settings on my 5.0 host to support jumbo frames? Or if automatically supports it? I didn't run HP smart pack CD on my new dl580 so I'm assuming it's getting device drivers from esxi operating system?
all the drivers are included in the OS.

Have you updated your HP with the latest firmware DVD?

Are you using the HP OEM version of ESXi from the HP Site?
Avatar of sysprof

ASKER

I haven't updated my HP server with firmware DVD. I suppose jumbo frames should be supported without latest firmware? I'm not using HP OEM version I only used HP version of esx when I configured esx on HP blades I suppose my predecessor use HP version of esx 4.1 on live environment though Why can't I pong with jumbo frame option this should be a networking issue? Can we somehow change NIC settings to make sure if supports jumbo frames? Sorry too many questions but pl do answer them all
Before deployment of any new HP Servers for VMware ESXi, we always

1. Update firmware with latest firmware DVD.
2. Download and Deploy ESXi 5.0 from HP Site. (it has the latest up to date drivers for the NICs).

If you raised the same issue with HP and /or VMware, they would also ask are you running latest firmware from firmware DVD, and HP OEM version of ESXi 5.0, plus then updates from portal.

NIC drivers or firmware can be responsible for the way the NIC functions or not functions, we had issues where Jumbo Frames was NOT supported, until new firmware/drivers were available in Intel and Broadcom nics.

We would also check if there newer drivers available for VMware site for the NICs.
Avatar of sysprof

ASKER

If I download smart update firmware DVD cd for HP dl580g7 and esxi5 option Would that have everything I need or do I still need software separately for network or storage etc It's giving me loads of options Would I run my HP server off this cd and it will popup wizard to upgrade? What if I use HP smarts tart cd8.7 would that suffice?
Avatar of sysprof

ASKER

I have HP nc375i and intel 82571eb network adapters
Avatar of sysprof

ASKER

Would i be good enough to install upgrades from update manager in esxi5 It's showing me drivers fro older esx versions as well I believe if I remediate my esxi5 it will only apply updates for5?
personally, I would try a HP OEM ESXi 5.0 download, and apply Updates.
Avatar of sysprof

ASKER

Hmm I have downloaded firmware DVD for dl580 g7 Would it be simply to burn DVD and restart server and follow wizard to finish update? Or it's slightly complicated that that? Any stepbysyep article?
Avatar of sysprof

ASKER

I have installed HP OEM but still no joy Should I go for firmware upgrade?
As I stated above complete the firmware upgrade.
I would like to see networking and config for ESXi 4.1 and 5.0