Solved

VMware vSwitch design best practice for ESXi hosts with 8x NIC ports

Posted on 2016-11-20
9
620 Views
Last Modified: 2016-11-20
Hi All,

Can anyone here please share and comments on my initial design of VMware vSphere best practice  data network design on my below HP DL 380 G9 server with the total of 8x NIC ports ?

This is only for the data network (not storage iSCSI).

ESXi design
Is that design commonly used and according to the best practice for VMware network deployment ?

Which uplink ports should be configured with LACP or link aggregation in the Cisco 3850 Switch for maximum throughput ?
0
Comment
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 4
9 Comments
 
LVL 121

Assisted Solution

by:Andrew Hancock (VMware vExpert / EE MVE^2)
Andrew Hancock (VMware vExpert / EE MVE^2) earned 500 total points
ID: 41894798
Firstly LACP is NOT SUPPORTED for standard vSwitches.

You will then want at least two network interfaces for iSCSI and two network interfaces for vMotion.

Jumbo Frames enabled on vSwitches for iSCSI and vMotion.

see my EE Articles, step by step instructions with screenshots, valid for all versions of ESXi.

HOW TO: Enable Jumbo Frames on a VMware vSphere Hypervisor (ESXi 5.0) host server using the VMware vSphere Client

HOW TO: Add an iSCSI Software Adaptor and Create an iSCSI Multipath Network in VMware vSphere Hypervisor ESXi 5.0

also configure vMotion as per iSCSI but you do not need to complete the binding order.

So you will have two active active network interfaces for iSCSI configured as MPIO and vMotion.

This is based on most iSCSI SANs.

Use different VLANS and different IP Address ranges for both networks , e.g. 10.x.x.x and 172.x.x.x

Your design is okay, BUT do not use LACP not supported, and also make both nics, Active/Active, do not see the point of cabling up a nic to a physical port, and leaving as standby, certainly for vMotion two nics is better than one, for throughout, and resilience.

As an example ONLY

10NICs-with-annotations---.jpg
1
 
LVL 8

Author Comment

by:Senior IT System Engineer
ID: 41895084
Andrew,
The network diagram above is for the data network not for storage iSCSI.

So if I use the LACP (802.3ad) or trunking with distributed virtual switch would that be recommended or possible ?

The VSphere edition is Essentials Plus.
0
 
LVL 121
ID: 41895105
LACP is supported with Distributed Switches. Is this a single host or many hosts in a cluster - how many ?

You can use Standard Trunks with Standard vSwitch, but just not use the LACP protocol.

Cisco uses something called ether channel which you can use for your trunks for your VMs.
0
PeopleSoft Has Never Been Easier

PeopleSoft Adoption Made Smooth & Simple!

On-The-Job Training Is made Intuitive & Easy With WalkMe's On-Screen Guidance Tool.  Claim Your Free WalkMe Account Now

 
LVL 8

Author Comment

by:Senior IT System Engineer
ID: 41895111
Andrew,

This is for maximum 3 hosts.

My core switch is CISCO brand.
0
 
LVL 8

Author Comment

by:Senior IT System Engineer
ID: 41895113
The VMs in these hosts running heavy upload and download of data for Business intelligence

Hence I'd like to know if the normal trunking of the 4x uplink ports can be beneficial or not.
0
 
LVL 121
ID: 41895132
Small numbers of hosts, you don't usually use Distributed Switches.

The VMs in these hosts running heavy upload and download of data for Business intelligence

Hence I'd like to know if the normal trunking of the 4x uplink ports can be beneficial or not.

It will be beneficial if you currently have a bottleneck with networking.

1 network interface, rather than 4 network interfaces.

What is the current network utilisation ?
1
 
LVL 8

Author Comment

by:Senior IT System Engineer
ID: 41895135
Ah I see,

I was under the impression that I would need to deploy vDS to enable me to trunk the network cable with my Cisco 3850 switches.

So far the network utilization in the old DRS cluster is just maxing up to 50-55% not 100% fully utilized, this new implementation of 3x ESXi in the new DRS cluster is for separating the environment only.
0
 
LVL 121

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 500 total points
ID: 41895138
No need for vDS to connect 4 network interfaces  from an ESXi host to a Cisco Switch.

Can be done in many different methods, using a Static Trunk, rather than a LACP trunk.

Sample configuration of EtherChannel / Link Aggregation Control Protocol (LACP) with ESXi/ESX and Cisco/HP switches (1004048)

You can use Etherchannel and Standard Switches, using Cisco physical switches.
1
 
LVL 8

Author Closing Comment

by:Senior IT System Engineer
ID: 41895139
Cool, many thanks Andrew.

I will be using the PortID as the load balancing method for the Standard vSwitches above.
0

Featured Post

SharePoint Admin?

Enable Your Employees To Focus On The Core With Intuitive Onscreen Guidance That is With You At The Moment of Need.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In this article we will learn how to backup a VMware farm using Nakivo Backup & Replication. In this tutorial we will install the software on a Windows 2012 R2 Server.
Ransomware is a malware that is again in the list of security  concerns. Not only for companies, but also for Government security and  even at personal use. IT departments should be aware and have the right  knowledge to how to fight it.
As a trusted technology advisor to your customers you are likely getting the daily question of, ‘should I put this in the cloud?’ As customer demands for cloud services increases, companies will see a shift from traditional buying patterns to new…
In this brief tutorial Pawel from AdRem Software explains how you can quickly find out which services are running on your network, or what are the IP addresses of servers responsible for each service. Software used is freeware NetCrunch Tools (https…

623 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question