Still celebrating National IT Professionals Day with 3 months of free Premium Membership. Use Code ITDAY17

x
?
Solved

VMware vSwitch design best practice for ESXi hosts with 8x NIC ports

Posted on 2016-11-20
9
Medium Priority
?
1,135 Views
Last Modified: 2016-11-20
Hi All,

Can anyone here please share and comments on my initial design of VMware vSphere best practice  data network design on my below HP DL 380 G9 server with the total of 8x NIC ports ?

This is only for the data network (not storage iSCSI).

ESXi design
Is that design commonly used and according to the best practice for VMware network deployment ?

Which uplink ports should be configured with LACP or link aggregation in the Cisco 3850 Switch for maximum throughput ?
0
Comment
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 4
9 Comments
 
LVL 123

Assisted Solution

by:Andrew Hancock (VMware vExpert / EE MVE^2)
Andrew Hancock (VMware vExpert / EE MVE^2) earned 2000 total points
ID: 41894798
Firstly LACP is NOT SUPPORTED for standard vSwitches.

You will then want at least two network interfaces for iSCSI and two network interfaces for vMotion.

Jumbo Frames enabled on vSwitches for iSCSI and vMotion.

see my EE Articles, step by step instructions with screenshots, valid for all versions of ESXi.

HOW TO: Enable Jumbo Frames on a VMware vSphere Hypervisor (ESXi 5.0) host server using the VMware vSphere Client

HOW TO: Add an iSCSI Software Adaptor and Create an iSCSI Multipath Network in VMware vSphere Hypervisor ESXi 5.0

also configure vMotion as per iSCSI but you do not need to complete the binding order.

So you will have two active active network interfaces for iSCSI configured as MPIO and vMotion.

This is based on most iSCSI SANs.

Use different VLANS and different IP Address ranges for both networks , e.g. 10.x.x.x and 172.x.x.x

Your design is okay, BUT do not use LACP not supported, and also make both nics, Active/Active, do not see the point of cabling up a nic to a physical port, and leaving as standby, certainly for vMotion two nics is better than one, for throughout, and resilience.

As an example ONLY

10NICs-with-annotations---.jpg
1
 
LVL 8

Author Comment

by:Senior IT System Engineer
ID: 41895084
Andrew,
The network diagram above is for the data network not for storage iSCSI.

So if I use the LACP (802.3ad) or trunking with distributed virtual switch would that be recommended or possible ?

The VSphere edition is Essentials Plus.
0
 
LVL 123
ID: 41895105
LACP is supported with Distributed Switches. Is this a single host or many hosts in a cluster - how many ?

You can use Standard Trunks with Standard vSwitch, but just not use the LACP protocol.

Cisco uses something called ether channel which you can use for your trunks for your VMs.
0
Looking for a new Web Host?

Lunarpages' assortment of hosting products and solutions ensure a perfect fit for anyone looking to get their vision or products to market. Our award winning customer support and 30-day money back guarantee show the pride we take in being the industry's premier MSP.

 
LVL 8

Author Comment

by:Senior IT System Engineer
ID: 41895111
Andrew,

This is for maximum 3 hosts.

My core switch is CISCO brand.
0
 
LVL 8

Author Comment

by:Senior IT System Engineer
ID: 41895113
The VMs in these hosts running heavy upload and download of data for Business intelligence

Hence I'd like to know if the normal trunking of the 4x uplink ports can be beneficial or not.
0
 
LVL 123
ID: 41895132
Small numbers of hosts, you don't usually use Distributed Switches.

The VMs in these hosts running heavy upload and download of data for Business intelligence

Hence I'd like to know if the normal trunking of the 4x uplink ports can be beneficial or not.

It will be beneficial if you currently have a bottleneck with networking.

1 network interface, rather than 4 network interfaces.

What is the current network utilisation ?
1
 
LVL 8

Author Comment

by:Senior IT System Engineer
ID: 41895135
Ah I see,

I was under the impression that I would need to deploy vDS to enable me to trunk the network cable with my Cisco 3850 switches.

So far the network utilization in the old DRS cluster is just maxing up to 50-55% not 100% fully utilized, this new implementation of 3x ESXi in the new DRS cluster is for separating the environment only.
0
 
LVL 123

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 2000 total points
ID: 41895138
No need for vDS to connect 4 network interfaces  from an ESXi host to a Cisco Switch.

Can be done in many different methods, using a Static Trunk, rather than a LACP trunk.

Sample configuration of EtherChannel / Link Aggregation Control Protocol (LACP) with ESXi/ESX and Cisco/HP switches (1004048)

You can use Etherchannel and Standard Switches, using Cisco physical switches.
1
 
LVL 8

Author Closing Comment

by:Senior IT System Engineer
ID: 41895139
Cool, many thanks Andrew.

I will be using the PortID as the load balancing method for the Standard vSwitches above.
0

Featured Post

New benefit for Premium Members - Upgrade now!

Ready to get started with anonymous questions today? It's easy! Learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Originally, this post was published on Monitis Blog, you can check it here . It goes without saying that technology has transformed society and the very nature of how we live, work, and communicate in ways that would’ve been incomprehensible 5 ye…
Arrow Electronics was searching for a KVM  (Keyboard/Video/Mouse) switch that could display on one single monitor the current status of all units being tested on the rack.
Internet Business Fax to Email Made Easy - With  eFax Corporate (http://www.enterprise.efax.com), you'll receive a dedicated online fax number, which is used the same way as a typical analog fax number. You'll receive secure faxes in your email, f…
Michael from AdRem Software outlines event notifications and Automatic Corrective Actions in network monitoring. Automatic Corrective Actions are scripts, which can automatically run upon discovery of a certain undesirable condition in your network.…

670 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question