Link to home
Start Free TrialLog in
Avatar of Wes Fields
Wes FieldsFlag for United States of America

asked on

Jumbo Frames on NIC in VMware

Do I need to enable Jumbo Frames on the dedicated iSCSI NICs in VMware?

I have configured the MTU on the Dell SCv2020 SAN, Dell N3024 Switches, vSwitch1 and 2, but when I try to configure the NIC with MTU of 9000... This is the error I receive.

User generated image
If I flip the MTU on the NIC dedicated to the iSCSI connections back to 1500 then I can see all the LUNs and Datastores.  I have reviewed this document too.

https://www.experts-exchange.com/articles/9132/HOW-TO-Enable-Jumbo-Frames-on-a-VMware-vSphere-Hypervisor-ESXi-5-0-host-server-using-the-VMware-vSphere-Client.html

The NICs for this Host are:  Broadcom Corporation NetXtreme BCM5720 Gigabit Ethernet.

Thanks!
ASKER CERTIFIED SOLUTION
Avatar of Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Flag of United Kingdom of Great Britain and Northern Ireland image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Just an update, I've checked all our Dell Servers, running ESXi 6.0, and they are using BCM5720 wth iSCSI software adaptors, enabled for Jumbo Frames with an MNT of 9000, with no issues.

Check your SAN and Network settings.

Make sure ALL the VMKernel Portgroups are 9000, and also the main vSwitch is 9000.
Avatar of Wes Fields

ASKER

Yes I am using the software iSCSI Adapter.  I have confirmed everything is running at 9000 MTU.

SAN
SWITCH
vSwitch

but the moment I switch the MTU on the vmNIC dedicated to the ISCSI it can't see any LUNs/datastores.  I checked the BCM5720 and it does support Jumbo Frames.
Let me check one more time since your update Andrew.
vary the size of the MTU, 4000, 8192, 9016, etc

a jumbo frame is defined as any frame larger than 1500 (approx!).

there is not really any standard.

you can also test your network using vmkping.

see here

https://communities.vmware.com/message/2418768

http://rickardnobel.se/troubleshoot-jumbo-frames-with-vmkping/

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1003728
I will start running through those documents Andrew and see what I can find.
make sure the VMKernel iSCSI Fault Domain is also 9000, and not defaulting and set to 1500!

also most Dell storage switches we've seen 9000 are the default, but just check the individual ports!
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
that's odd we use 9000 on out ESXi nics, and the switches are set to 9216!

and we also use Dell switches!
Avatar of ICT_Pro
ICT_Pro

I belive switches MTU need to set a bit higher compare to client for overflow.
This was the fix after working with Dell Enterprise.