Solved

VMware vSwitch design best practice for ESXi hosts with 8x NIC ports

Posted on 2016-11-20
9
362 Views
Last Modified: 2016-11-20
Hi All,

Can anyone here please share and comments on my initial design of VMware vSphere best practice  data network design on my below HP DL 380 G9 server with the total of 8x NIC ports ?

This is only for the data network (not storage iSCSI).

ESXi design
Is that design commonly used and according to the best practice for VMware network deployment ?

Which uplink ports should be configured with LACP or link aggregation in the Cisco 3850 Switch for maximum throughput ?
0
Comment
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 4
9 Comments
 
LVL 120

Assisted Solution

by:Andrew Hancock (VMware vExpert / EE MVE^2)
Andrew Hancock (VMware vExpert / EE MVE^2) earned 500 total points
ID: 41894798
Firstly LACP is NOT SUPPORTED for standard vSwitches.

You will then want at least two network interfaces for iSCSI and two network interfaces for vMotion.

Jumbo Frames enabled on vSwitches for iSCSI and vMotion.

see my EE Articles, step by step instructions with screenshots, valid for all versions of ESXi.

HOW TO: Enable Jumbo Frames on a VMware vSphere Hypervisor (ESXi 5.0) host server using the VMware vSphere Client

HOW TO: Add an iSCSI Software Adaptor and Create an iSCSI Multipath Network in VMware vSphere Hypervisor ESXi 5.0

also configure vMotion as per iSCSI but you do not need to complete the binding order.

So you will have two active active network interfaces for iSCSI configured as MPIO and vMotion.

This is based on most iSCSI SANs.

Use different VLANS and different IP Address ranges for both networks , e.g. 10.x.x.x and 172.x.x.x

Your design is okay, BUT do not use LACP not supported, and also make both nics, Active/Active, do not see the point of cabling up a nic to a physical port, and leaving as standby, certainly for vMotion two nics is better than one, for throughout, and resilience.

As an example ONLY

10NICs-with-annotations---.jpg
1
 
LVL 8

Author Comment

by:Senior IT System Engineer
ID: 41895084
Andrew,
The network diagram above is for the data network not for storage iSCSI.

So if I use the LACP (802.3ad) or trunking with distributed virtual switch would that be recommended or possible ?

The VSphere edition is Essentials Plus.
0
 
LVL 120
ID: 41895105
LACP is supported with Distributed Switches. Is this a single host or many hosts in a cluster - how many ?

You can use Standard Trunks with Standard vSwitch, but just not use the LACP protocol.

Cisco uses something called ether channel which you can use for your trunks for your VMs.
0
Portable, direct connect server access

The ATEN CV211 connects a laptop directly to any server allowing you instant access to perform data maintenance and local operations, for quick troubleshooting, updating, service and repair.

 
LVL 8

Author Comment

by:Senior IT System Engineer
ID: 41895111
Andrew,

This is for maximum 3 hosts.

My core switch is CISCO brand.
0
 
LVL 8

Author Comment

by:Senior IT System Engineer
ID: 41895113
The VMs in these hosts running heavy upload and download of data for Business intelligence

Hence I'd like to know if the normal trunking of the 4x uplink ports can be beneficial or not.
0
 
LVL 120
ID: 41895132
Small numbers of hosts, you don't usually use Distributed Switches.

The VMs in these hosts running heavy upload and download of data for Business intelligence

Hence I'd like to know if the normal trunking of the 4x uplink ports can be beneficial or not.

It will be beneficial if you currently have a bottleneck with networking.

1 network interface, rather than 4 network interfaces.

What is the current network utilisation ?
1
 
LVL 8

Author Comment

by:Senior IT System Engineer
ID: 41895135
Ah I see,

I was under the impression that I would need to deploy vDS to enable me to trunk the network cable with my Cisco 3850 switches.

So far the network utilization in the old DRS cluster is just maxing up to 50-55% not 100% fully utilized, this new implementation of 3x ESXi in the new DRS cluster is for separating the environment only.
0
 
LVL 120

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 500 total points
ID: 41895138
No need for vDS to connect 4 network interfaces  from an ESXi host to a Cisco Switch.

Can be done in many different methods, using a Static Trunk, rather than a LACP trunk.

Sample configuration of EtherChannel / Link Aggregation Control Protocol (LACP) with ESXi/ESX and Cisco/HP switches (1004048)

You can use Etherchannel and Standard Switches, using Cisco physical switches.
1
 
LVL 8

Author Closing Comment

by:Senior IT System Engineer
ID: 41895139
Cool, many thanks Andrew.

I will be using the PortID as the load balancing method for the Standard vSwitches above.
0

Featured Post

Free Tool: SSL Checker

Scans your site and returns information about your SSL implementation and certificate. Helpful for debugging and validating your SSL configuration.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

When converting a physical machine to a virtual machine using VMware vCenter Converter Standalone or vCenter Converter Enterprise, if an adapter type is not selected during the initial customization the resulting virtual machine may contain an IDE d…
In this article we will learn how to backup a VMware farm using Nakivo Backup & Replication. In this tutorial we will install the software on a Windows 2012 R2 Server.
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.
Here's a very brief overview of the methods PRTG Network Monitor (https://www.paessler.com/prtg) offers for monitoring bandwidth, to help you decide which methods you´d like to investigate in more detail.  The methods are covered in more detail in o…

739 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question