best practice for vswitches in VMWARE

Hi Experts,

I have just one vswitch configured yet , the VM Network is running over it, the VMOTION and MANAGEMENT.
And I just have one NIC for this vSwitch0.


When I remeber, I think I had an extra vSwitch for VMOTION and MANAGEMENT.
But I am not sure.

What do you think, and what is recommended ?
Can you give me some hints here ?
Eprs_AdminSystem ArchitectAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
It's Best Practice and Recommended to ISOLATE ALL traffic e.g.

Management
vMotion
Virtual Machines
Storage (iSCSI and NFS).

So that's a vSwitch per each, in an ideal world, with at least two physical nic uplinks per vSwitch.

If you are short on physical nics, VLANs can help, and if you have 10GBe nics, then two 10GBe nics per vSwitch and use of VLANs

example
0
Eprs_AdminSystem ArchitectAuthor Commented:
ok I see,
Which one is your vmotion network ?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
vMotion can only operate on a VMKernel......

so the one labelled VMKernel, vMotion is a TCP/IP network function, so it MUST have an IP Address to be able to communicate with other ESXi hosts.
0
Making Bulk Changes to Active Directory

Watch this video to see how easy it is to make mass changes to Active Directory from an external text file without using complicated scripts.

Eprs_AdminSystem ArchitectAuthor Commented:
ok I see,
on my end my vm network and the management is on one vswitch.
How to seperate it ? I cannot delete the management network on it.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
How many physical nics, do you have to spare?

create a new virtual switch, with a virtual machine network.
0
Eprs_AdminSystem ArchitectAuthor Commented:
I have 12 nics for all and 2 10G nics for my storage
0
Eprs_AdminSystem ArchitectAuthor Commented:
The uplinks must be trunks right ?
The management and Data links ?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
The uplinks do not have to be trunks....

but for teaming and resilience purposes, ESXi Teaming policy only controls OUTBOUND traffic, inbound traffic is configured on your physical switches......

so, if you require resilience, and throughput STATIC TRUNKS are best! (LACP is not supported).

Okay, so lets exclude the 10GBe for storage only!

This leaves 12 nics.....

do you use VLANs ?

without VLANs, you could configure...

2 x NICs - Management (trunk)
2 x NICs - vMotion
4 x NICs - Virtual Machines (trunk)
0
Eprs_AdminSystem ArchitectAuthor Commented:
I have no vlans.

ok this is a good plan.
when you say 4x NICS for Virtual Machines in a trunk, do I have then 4x 1Gbps , so 4Gbps ?
And the trunk I have to create on the physical switch right ?
I have ESXi 5.5, can I use LACP with it ?
0
Eprs_AdminSystem ArchitectAuthor Commented:
Now I have setup a new vswitch for vmotion but it is not working.
Maybe the HP switch port settings are wrong ?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
make sure, that each server, can ping each other's vMotion interface IP Address.
0
Eprs_AdminSystem ArchitectAuthor Commented:
ok let me check this later
0
Eprs_AdminSystem ArchitectAuthor Commented:
Ok now I decided to put the vmotion network also on the 10G nics together with the Storage vswitch.
0
Eprs_AdminSystem ArchitectAuthor Commented:
Hi Andrew,

regarding this solution from you:
2 x NICs - Management (trunk)
2 x NICs - vMotion
4 x NICs - Virtual Machines (trunk)

How to setup the nics as trunks ?
In vcenter I add the nics and put them all to active.
But on the HP side what do I have to configure ? Which trunks ? LACP ?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
You must configure Static Trunks on the physical switch, and set Teaming to IP HASH. (on ESXI)

LACP is not supported.
0
Eprs_AdminSystem ArchitectAuthor Commented:
ok now I have configured the redundant nics for Management and VM´s.
But on the HP switch it is yet not configured.
I made a test and disconnected vmnic0 and I was able to connect to the host.
So this works also without having trunks.

Can you show me how to configure the trunks on the HP side ?
0
Eprs_AdminSystem ArchitectAuthor Commented:
now my setup is like this:
See the picture.

host1 networking
Is it ok to put the vmotion network on the 10G storage network, because it is faster ?
0
Eprs_AdminSystem ArchitectAuthor Commented:
On this host, see the picture before,I still have a warning that no redundancy is given on the management network. But when you see the picture before I have added 2 nics, vmnic 0 and 4.
What else can be the problem here ?

no redundancy
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Yes, you could add a VMKernel to vSwitch with the 10Gbe for vMotion.

It's possible that the nics cannot reach the default gateway.

What physical switch do you have ?
0
Eprs_AdminSystem ArchitectAuthor Commented:
I have a HP Procurve 4208vl J8773a
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
with a HP switch

To configure a static portchannel in an HP switch using ports 1, 2, 3, and 4, run this command:

conf
trunk 1-4 Trk1 Trunk

or do you use a GUI ?
0
Eprs_AdminSystem ArchitectAuthor Commented:
I have both, do have also the solution for the GUI ?
0
Eprs_AdminSystem ArchitectAuthor Commented:
...and why I cannot use LACP, because my switch can use it.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
I don't use a GUI.

But you would start the GUI, find the two ports you need to trunk and select trunk, to add them to the same trunk number.

..and why I cannot use LACP, because my switch can use it.

Because ITS NOT SUPPORTED! on Standard vSwitches, only on Distributed Switches, in Enterprise PLus version.

see here

http://kb.vmware.com/selfservice/search.do?cmd=displayKC&docType=kc&docTypeID=DT_KB_1_1&externalId=1004048
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Eprs_AdminSystem ArchitectAuthor Commented:
Great article and the configuration works fine.
Just two small things left.

One vmnic of a trunk just has 100Mbit FULL DUPLEX, all other have 1000Mbit FULL DUPLEX.
See the picture:

not 1000Mbit
From where it comes ?
On the HP switch I cannot change it because of the trunk or ?
0
Eprs_AdminSystem ArchitectAuthor Commented:
...and when I check my network adapters I see different networks observed.
See the picture:

observed networks
What does it mean, is it important ?
Why it sees different networks ?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
It appears there must be a speed mismatch on the physical network port.

try reconnecting, or changing the cable.
0
Eprs_AdminSystem ArchitectAuthor Commented:
ok, and what about the different observed networks ?
From where it comes ?
0
Eprs_AdminSystem ArchitectAuthor Commented:
ok this will work great with the trunks and vswitches.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
VMware

From novice to tech pro — start learning today.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.