?
Solved

Connection to EMC Celerra hosted NFS lost when Jumbo frame used

Posted on 2012-08-30
23
Medium Priority
?
1,223 Views
Last Modified: 2012-09-18
I have an existing VMware 4.1 environment of 8 esx hosts 4.1 and vCentr4.1 connected to NFS volumes hosted on EMC Celerra. NFS vSwitch is configured with jumbo frame of 9000 and all working fine. In parallel I have built a new vSphere5 environment of 3 Esx5 hosts (dl580g7 256gb ram 40 cores each) I have configured all networking including NFS that connects to same NFS volumes on EMC Celerra as my live 4.1 environment. My new vsphere 5 is not live. I can connect to NFS volume with MTU of 1500 but as soon I change this to 9000 (to match my live environment) and reboot esxi5 I lose connection to NFS test volume. Could someone advice why is it so? Is this a bug in esxi5? It works fine with 4.1 but not in 5. Only difference is that I have created a new test volume on same EMC Celerra SAN that I keep losing in esxi5. I used host profile to configure my esxi5 hosts.
0
Comment
Question by:sysprof
  • 13
  • 9
22 Comments
 
LVL 124

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 1500 total points
ID: 38351505
do your switches support jumbo frames?
0
 

Author Comment

by:sysprof
ID: 38351540
Yes we have MTU enabled globally on a Cisco SAN switch and I have direct connection to it. We have ether channel between SAN switch and the EMC NAS switch. My live environment is rerunning of HP blades but they all come to same SAN switch that I'm connected directly to.
0
 
LVL 124

Assisted Solution

by:Andrew Hancock (VMware vExpert / EE MVE^2)
Andrew Hancock (VMware vExpert / EE MVE^2) earned 1500 total points
ID: 38351584
are you on the latest 5.0 build?

mtu 9000 on the VMKernel portgroup?

it should not disconnect if incorrect mtu

why the reboot after changed of mtu?
0
Industry Leaders: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

 

Author Comment

by:sysprof
ID: 38351759
I'm on latest build. Yes MTU on port group for NFS. Well, host will be rebooted at some point if not immediately. If I don't reboot it loses SAN any way
0
 
LVL 124
ID: 38351768
okay, just checkng, so it connects to nfs mount, and then disconnects?

Im wondering if you need an additional NFS settings setting in Advanced Settings,mas recommended by vendor
0
 

Author Comment

by:sysprof
ID: 38351826
I have done tcp heap and tcp heap max to 24 and 96 respectively and NFS settings to match my live environment under advanced settings Cant think of anything else Would it make any difference if I remove and recreate port group just in coz I used host profile to configure my esx hosts? Also my switch Port and NIC settings are auto negotiate. Should i change them to static? Or Is there any bios settings I should change?
0
 
LVL 124
ID: 38351864
we have debated the auto neg versus static options here with our Cisco guys, and they have always recommended Auto both ends, but its worth changing if the port is dropping out, if you can see stats on the physical switch.

Ive seen host profiles get configuration wrong, I would test a manual creation of switches, portgroups
0
 

Author Comment

by:sysprof
ID: 38352063
Ok will try tomorrow and see if that makes a difference thx
0
 

Author Comment

by:sysprof
ID: 38353553
I have tried configuring from scratch but still lost my coonectivity to SAN I'm worried that without MTU being 9000 I will get into trouble when migrating my live 4.1 VM(s) I intend to simply detach my 4.1 host and attach to 5.1 host and then vmotion my VM(s) any ideas? Really stuck
0
 

Author Comment

by:sysprof
ID: 38353621
Strange thing is that I can browse my temp SAN volume or even create or delete folders with NFS being MTU 9000 but as soon I start vmotion any test vm it gets stuck at 9 % and fails in about 10 min Data store shows as inaccessible but still I can create and elected folders while it's inaccessible my to heap and max ate 24 and 96 NFS send receive buffer size both ate 64
0
 

Author Comment

by:sysprof
ID: 38354256
When I run ping at my 5.0 host with option for jumbo frame It fails but same ping works on my live 4.1 host My nics support jumbo frames Is there any way I can change NIC settings on my 5.0 host to support jumbo frames? Or if automatically supports it? I didn't run HP smart pack CD on my new dl580 so I'm assuming it's getting device drivers from esxi operating system?
0
 
LVL 124
ID: 38354301
all the drivers are included in the OS.

Have you updated your HP with the latest firmware DVD?

Are you using the HP OEM version of ESXi from the HP Site?
0
 

Author Comment

by:sysprof
ID: 38354380
I haven't updated my HP server with firmware DVD. I suppose jumbo frames should be supported without latest firmware? I'm not using HP OEM version I only used HP version of esx when I configured esx on HP blades I suppose my predecessor use HP version of esx 4.1 on live environment though Why can't I pong with jumbo frame option this should be a networking issue? Can we somehow change NIC settings to make sure if supports jumbo frames? Sorry too many questions but pl do answer them all
0
 
LVL 124
ID: 38354415
Before deployment of any new HP Servers for VMware ESXi, we always

1. Update firmware with latest firmware DVD.
2. Download and Deploy ESXi 5.0 from HP Site. (it has the latest up to date drivers for the NICs).

If you raised the same issue with HP and /or VMware, they would also ask are you running latest firmware from firmware DVD, and HP OEM version of ESXi 5.0, plus then updates from portal.

NIC drivers or firmware can be responsible for the way the NIC functions or not functions, we had issues where Jumbo Frames was NOT supported, until new firmware/drivers were available in Intel and Broadcom nics.

We would also check if there newer drivers available for VMware site for the NICs.
0
 

Author Comment

by:sysprof
ID: 38354483
If I download smart update firmware DVD cd for HP dl580g7 and esxi5 option Would that have everything I need or do I still need software separately for network or storage etc It's giving me loads of options Would I run my HP server off this cd and it will popup wizard to upgrade? What if I use HP smarts tart cd8.7 would that suffice?
0
 

Author Comment

by:sysprof
ID: 38354493
I have HP nc375i and intel 82571eb network adapters
0
 

Author Comment

by:sysprof
ID: 38354519
Would i be good enough to install upgrades from update manager in esxi5 It's showing me drivers fro older esx versions as well I believe if I remediate my esxi5 it will only apply updates for5?
0
 
LVL 124
ID: 38354560
personally, I would try a HP OEM ESXi 5.0 download, and apply Updates.
0
 

Author Comment

by:sysprof
ID: 38354720
Hmm I have downloaded firmware DVD for dl580 g7 Would it be simply to burn DVD and restart server and follow wizard to finish update? Or it's slightly complicated that that? Any stepbysyep article?
0
 

Author Comment

by:sysprof
ID: 38354975
I have installed HP OEM but still no joy Should I go for firmware upgrade?
0
 
LVL 124
ID: 38358633
As I stated above complete the firmware upgrade.
0
 
LVL 124
ID: 38358733
I would like to see networking and config for ESXi 4.1 and 5.0
0

Featured Post

Get quick recovery of individual SharePoint items

Free tool – Veeam Explorer for Microsoft SharePoint, enables fast, easy restores of SharePoint sites, documents, libraries and lists — all with no agents to manage and no additional licenses to buy.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

The following article is comprised of the pearls we have garnered deploying virtualization solutions since Virtual Server 2005 and subsequent 2008 RTM+ Hyper-V in standalone and clustered environments.
In this article we will learn how to backup a VMware farm using Nakivo Backup & Replication. In this tutorial we will install the software on a Windows 2012 R2 Server.
This video shows you how easy it is to boot from ISO images for virtual machines with the ISO images stored on a local datastore on the ESXi host.
How to Install VMware Tools in Red Hat Enterprise Linux 6.4 (RHEL 6.4) Step-by-Step Tutorial
Suggested Courses

839 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question