Solved

VMWare Distributed Port Group Configuration

Posted on 2014-10-24
7
663 Views
Last Modified: 2014-10-29
I have a 3 esxi hosts all with matching hardware and recently set up vcenter server.

I converted all of my existing standard switches to distributed switches and all is working correctly.

The problem I am having is when I try to add a new port group to one of these distributed switches that I created. I cannot seem to get any new port groups to work correctly, there are 3 existing port groups on this virtual switch that were migrated that work fine.

I need to be able to add more port groups to access new vlans.

I try to mimic all of the properties/policies settings in the existing port groups except the vlan # of course

If I put VMs into this port group, they cannot ping the gateway. 2 VMs can ping eachother as long as they are running on the same host. They cannot if they are on different hosts.

The ports on the physical switch that the uplinks connect to are configured to trunk all vlans so I do not think there is an issue there. Same with the uplinks themselves in vcenter.

Since the port groups that I migrated to the distributed switch are ok, there must be some part of the configuration that I am missing when I create a new port group.


One thing I see that looks a little off is that there are unused ports in this port group where the other port groups have only the exact number they need. All groups are set as Ephemeral.
0
Comment
Question by:bts86
  • 4
  • 3
7 Comments
 
LVL 28

Expert Comment

by:asavener
Comment Utility
How many uplink ports do you have configured for each vDS?

You say that all VLANs are configured to trunk to your hosts, but are all VLANs allowed past the switches themselves?  (on all upstream trunk ports and between the switches themselves?)
0
 
LVL 28

Expert Comment

by:asavener
Comment Utility
Also, what kind of uplink ports are you using?  Are you running a port channel?  LACP-controlled port channel?  Just individual uplinks?

What kind of load balancing do you have configured on the new VLANs?
0
 
LVL 1

Author Comment

by:bts86
Comment Utility
I have 2 uplink ports on each host for this distributed switch where I am having the issue.

They connect to a cisco catalyst 3560 as a port-channel:

interface Port-channel7
 description esxi01
 switchport trunk encapsulation dot1q
 switchport trunk allowed vlan 1-19,21-29,31-4094
 switchport mode trunk
 switchport nonegotiate

I see now that I do not have LACP configured on the VMware hosts.

I am not familiar with some of the options I see to create a LAG. If my switch is set to nonnegotiate does that mean I want the LAG mode as "active"?


Im also a little wary of changing this configuration, can I apply it on a per host basis so that I can migrate VMs off each one first? My management access is also on this vDS and I am afraid to lose connectivity.
0
NetScaler Deployment Guides and Resources

Citrix NetScaler is certified to support many of the most commonly deployed enterprise applications. Deployment guides provide in-depth recommendations on configuring NetScaler to meet specific application requirements.

 
LVL 1

Author Comment

by:bts86
Comment Utility
on this particulat vDS, there are 2 uplink ports per host, gigabit Ethernet connected to a cisco catalyst 3560:

interface Port-channel7
 description esxi01
 switchport trunk encapsulation dot1q
 switchport trunk allowed vlan 1-19,21-29,31-4094
 switchport mode trunk
 switchport nonegotiate

I see now that I do not have lacp configured on the vDS. Can I configure this without losing connectivity on the current port groups on this vDS?
0
 
LVL 28

Accepted Solution

by:
asavener earned 500 total points
Comment Utility
Check the load balancing settings configured on each port group (a working port group and a non-working port group).

Are you configuring through the web client or the c# client?

Be careful making any LACP changes, as I think it's global for all port groups connected to the distributed virtual switch.
0
 
LVL 1

Author Comment

by:bts86
Comment Utility
load balancing is the same on all port groups: route based on originating virtual port

I am using the web client.
0
 
LVL 1

Author Comment

by:bts86
Comment Utility
I have figured this out.

The new vlan was created on an asa firewall which does not participate in vtp. So I created the vlan also on the switch with the command : int vlan 51

In troubleshooting I gave the vlan an ip and tried to ping the gateway. There was an error: ip not enabled or interface is down.

What I did not realize is that that command does not actually add the vlan to the database event though it shows it as an interface in the config. The command should have been just: vlan 51

I've never realized this because I usually have at least one switchport configured in access mode for a vlan or it receive vlan information from another switch that does by vtp.


Added the vlan to the switch properly and now can ping everything that it should

What a lot of trouble for such a simple solution.

Thanks for your help. I have actually removed the port channels from the switch because what you pointed out showed me that they were not really functioning as a port channel. Instead of configuring lacp and risking losing connectivity. I am keeping the physicals port as individual uplinks and configured teaming on all port groups to route based on physical nic load.

All is working well this way. I can see in the performance monitors that the traffic is being spread on both nics.
0

Featured Post

Highfive + Dolby Voice = No More Audio Complaints!

Poor audio quality is one of the top reasons people don’t use video conferencing. Get the crispest, clearest audio powered by Dolby Voice in every meeting. Highfive and Dolby Voice deliver the best video conferencing and audio experience for every meeting and every room.

Join & Write a Comment

#Citrix #Citrix Netscaler #HTTP Compression #Load Balance
Last article we focus in how to VMware: How to create and use VMs TAGs – Part 1 so before follow this article and perform the next tasks, you should read the first article how to create the TAG before using them in Veeam Backup Jobs.
Teach the user how to use vSphere Update Manager to update the VMware Tools and virtual machine hardware version Open vSphere Client: Review manual processes for updating VMware Tools and virtual hardware versions: Create a new baseline group in vSp…
This video shows you how easy it is to boot from ISO images for virtual machines with the ISO images stored on a local datastore on the ESXi host.

763 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

13 Experts available now in Live!

Get 1:1 Help Now