VMWare Distributed Port Group Configuration

I have a 3 esxi hosts all with matching hardware and recently set up vcenter server.

I converted all of my existing standard switches to distributed switches and all is working correctly.

The problem I am having is when I try to add a new port group to one of these distributed switches that I created. I cannot seem to get any new port groups to work correctly, there are 3 existing port groups on this virtual switch that were migrated that work fine.

I need to be able to add more port groups to access new vlans.

I try to mimic all of the properties/policies settings in the existing port groups except the vlan # of course

If I put VMs into this port group, they cannot ping the gateway. 2 VMs can ping eachother as long as they are running on the same host. They cannot if they are on different hosts.

The ports on the physical switch that the uplinks connect to are configured to trunk all vlans so I do not think there is an issue there. Same with the uplinks themselves in vcenter.

Since the port groups that I migrated to the distributed switch are ok, there must be some part of the configuration that I am missing when I create a new port group.


One thing I see that looks a little off is that there are unused ports in this port group where the other port groups have only the exact number they need. All groups are set as Ephemeral.
LVL 1
bts86Asked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

asavenerCommented:
How many uplink ports do you have configured for each vDS?

You say that all VLANs are configured to trunk to your hosts, but are all VLANs allowed past the switches themselves?  (on all upstream trunk ports and between the switches themselves?)
0
asavenerCommented:
Also, what kind of uplink ports are you using?  Are you running a port channel?  LACP-controlled port channel?  Just individual uplinks?

What kind of load balancing do you have configured on the new VLANs?
0
bts86Author Commented:
I have 2 uplink ports on each host for this distributed switch where I am having the issue.

They connect to a cisco catalyst 3560 as a port-channel:

interface Port-channel7
 description esxi01
 switchport trunk encapsulation dot1q
 switchport trunk allowed vlan 1-19,21-29,31-4094
 switchport mode trunk
 switchport nonegotiate

I see now that I do not have LACP configured on the VMware hosts.

I am not familiar with some of the options I see to create a LAG. If my switch is set to nonnegotiate does that mean I want the LAG mode as "active"?


Im also a little wary of changing this configuration, can I apply it on a per host basis so that I can migrate VMs off each one first? My management access is also on this vDS and I am afraid to lose connectivity.
0
Powerful Yet Easy-to-Use Network Monitoring

Identify excessive bandwidth utilization or unexpected application traffic with SolarWinds Bandwidth Analyzer Pack.

bts86Author Commented:
on this particulat vDS, there are 2 uplink ports per host, gigabit Ethernet connected to a cisco catalyst 3560:

interface Port-channel7
 description esxi01
 switchport trunk encapsulation dot1q
 switchport trunk allowed vlan 1-19,21-29,31-4094
 switchport mode trunk
 switchport nonegotiate

I see now that I do not have lacp configured on the vDS. Can I configure this without losing connectivity on the current port groups on this vDS?
0
asavenerCommented:
Check the load balancing settings configured on each port group (a working port group and a non-working port group).

Are you configuring through the web client or the c# client?

Be careful making any LACP changes, as I think it's global for all port groups connected to the distributed virtual switch.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
bts86Author Commented:
load balancing is the same on all port groups: route based on originating virtual port

I am using the web client.
0
bts86Author Commented:
I have figured this out.

The new vlan was created on an asa firewall which does not participate in vtp. So I created the vlan also on the switch with the command : int vlan 51

In troubleshooting I gave the vlan an ip and tried to ping the gateway. There was an error: ip not enabled or interface is down.

What I did not realize is that that command does not actually add the vlan to the database event though it shows it as an interface in the config. The command should have been just: vlan 51

I've never realized this because I usually have at least one switchport configured in access mode for a vlan or it receive vlan information from another switch that does by vtp.


Added the vlan to the switch properly and now can ping everything that it should

What a lot of trouble for such a simple solution.

Thanks for your help. I have actually removed the port channels from the switch because what you pointed out showed me that they were not really functioning as a port channel. Instead of configuring lacp and risking losing connectivity. I am keeping the physicals port as individual uplinks and configured teaming on all port groups to route based on physical nic load.

All is working well this way. I can see in the performance monitors that the traffic is being spread on both nics.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
VMware

From novice to tech pro — start learning today.