small vmware w/ san infrastructure - need recommendations on vswitch & kernel config

I'm looking to see if someone can provide me with recommendations or examples of real world best practices for configuring a smaller vmware environment with vmware essentials plus.

How would you recommend configuring the vswitches & kernels? We have 8 NICs per Gen-8. The Nimble will have 1 mgmt and 2 for iSCSI.

On the ESX hosts I plan to go with:
1 vswitch for mgmt/VMs(4 nics),
1 vswitch for vMotion kernel (2 nics) , and
1 vswitch for iSCSI (2 nics).

1. That was my plan, do you recommend something else? If so, why?
2. Is there an Active/Failover setup i should use to make sure MGMT traffic is not stepped on?
LVL 5
MetaltreeAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
What is usually recommended is, at least two nics for all services, e.g. management network, vmotion, virtual machine network, which is common, sense, so you have teaming and resilience in place should a nic fail.

iSCSI Storage Network at least 2 nics, on single vSwitch configured for multipath.

see my EE Article, Step by Step Tutorial Instructions with Screenshots

HOW TO: Add an iSCSI Software Adaptor and Create an iSCSI Multipath Network in VMware vSphere Hypervisor ESXi 5.0

also on the same storage vSwitch configure Jumbo Frames, if SAN Network Ports, and Physical Switch support Jumbo Frames.

HOW TO: Enable Jumbo Frames on a VMware vSphere Hypervisor (ESXi 5.0) host server using the VMware vSphere Client


If you read the Best Practices, VMware would like you to create a network pair for

1. Management Network
2. vMotion
3. iSCSI
4. VMs

the above may be impractile, so some use the iSCSI network for vMotion, keep all the storage together.

The number of nics, you require for VMs, depends on how many VMs, and how busy they will get.

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
MetaltreeAuthor Commented:
I read/heard that since I use a Nimble SAN, Jumbo Frames should not be used. Have you heard this?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
I've not specifically heard this, I would check with the vendor.
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
VMware

From novice to tech pro — start learning today.