?
Solved

ESX Vlan trunking to DMZ Vlan

Posted on 2008-09-30
8
Medium Priority
?
5,275 Views
Last Modified: 2010-05-18
I currently have an ESXi server configured, with both NICs in the server configured as trunks.

They connect to a Cisco 3750 stack.

Here is my switch config:

XXXXX#sh run int gi2/0/9
Building configuration...

Current configuration : 391 bytes
!
interface GigabitEthernet2/0/9
 description CHQSRVR07 NIC 2
 switchport trunk encapsulation dot1q
 switchport trunk native vlan 2
 switchport mode trunk
 switchport nonegotiate
 srr-queue bandwidth share 10 10 60 20
 srr-queue bandwidth shape  10  0  0  0
 priority-queue out
 mls qos trust device cisco-phone
 mls qos trust cos
 auto qos voip cisco-phone
 channel-group 2 mode on
end

XXXXX#sh run int gi2/0/10
Building configuration...

Current configuration : 392 bytes
!
interface GigabitEthernet2/0/10
 description CHQSRVR07 NIC 1
 switchport trunk encapsulation dot1q
 switchport trunk native vlan 2
 switchport mode trunk
 switchport nonegotiate
 srr-queue bandwidth share 10 10 60 20
 srr-queue bandwidth shape  10  0  0  0
 priority-queue out
 mls qos trust device cisco-phone
 mls qos trust cos
 auto qos voip cisco-phone
 channel-group 2 mode on
end

XXXXX#sh run int po2
Building configuration...

Current configuration : 190 bytes
!
interface Port-channel2
 description CHQSRVR07 Etherchannel Group
 switchport trunk encapsulation dot1q
 switchport trunk native vlan 2
 switchport mode trunk
 switchport nonegotiate
end

I am successfully able to change a virtual machines VLAN in most cases, but when I attempt to change it to our DMZ VLAN, I begin to experience failures. It appears that I can ping some devices in the DMZ from my virtual machine, but not all. I also notice strange behavior with my virtual machine arp tables.

C:\Documents and Settings\XXXXX>ipconfig

Windows IP Configuration


Ethernet adapter Local Area Connection:

        Connection-specific DNS Suffix  . :
        IP Address. . . . . . . . . . . . : 192.168.1.35
        Subnet Mask . . . . . . . . . . . : 255.255.255.0
        Default Gateway . . . . . . . . . : 192.168.1.1

C:\Documents and Settings\XXXXX>arp -a

Interface: 192.168.1.35 --- 0x2
  Internet Address      Physical Address      Type
  192.168.1.1           00-02-b3-ed-6b-22     dynamic
  192.168.1.20          00-02-b3-ed-6b-22     dynamic
  192.168.1.30          00-0c-29-17-a6-05     dynamic

Load balancing in the port channel group is set to per MAC on both the switch and the VMWare server.

Is there anything outstanding out my configuration that strikes anyone as problematic?

Thanks,

Jason
0
Comment
Question by:jfaraone
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 4
  • 3
8 Comments
 
LVL 42

Expert Comment

by:paulsolov
ID: 22610620
do you have the dmz on a separate vswitch or the same vswitch? How are your port groups setup? How are your vlans setup..on vswitch (port groups) or individual virtual machines?  Normally you would want to keep the dmz on a separate vswitch with its own physical nics and a separate dmz switch for better security.  

If you have a firewall seeing the dmz traffic from the inside it may be having issues with split horizon.

0
 
LVL 26

Expert Comment

by:Soulja
ID: 22618551
I bet  you are experiencing vlan flapping due to the port channels. We recently had this problem and had to make sure the port channels on the switches we synced with the port channel on the virtual switches.
0
 

Author Comment

by:jfaraone
ID: 22624274
Just to clear some things up...

Upon further investigation, it appears that regardless of which VLAN the virtual machines are in, they have trouble communicating with other devices in the same VLAN. They do not have trouble communicating with devices in any other VLAN.

For example, my virtual machine is in VLAN 3 at the moment. He can communicate with devices in VLAN 4, 5, and 6, but not devices in VLAN 3. He can communicate with the layer 3 interface (his default gateway) for VLAN 3.

Hope that makes sense.
0
Learn how to optimize MySQL for your business need

With the increasing importance of apps & networks in both business & personal interconnections, perfor. has become one of the key metrics of successful communication. This ebook is a hands-on business-case-driven guide to understanding MySQL query parameter tuning & database perf

 
LVL 42

Expert Comment

by:paulsolov
ID: 22624332
Is this issue only for virtual machines or physical machines as well? If the physical machines are not having issues than it may be security settings on the switch, such as lockdown by MAC Address or something like that.  
0
 

Author Comment

by:jfaraone
ID: 22635582
The ESX server is connected via an Etherchannel group, as described above. When I remove one of the Etherchannel links, everything works fine... so I'm imagining there is some load balancing issue with the server I'm trying to ping and my Etherchannel setup...
0
 
LVL 42

Accepted Solution

by:
paulsolov earned 2000 total points
ID: 22637672
since you have etherchannel setup how is it setup on the vswitch? It should be setup for IP Hash otherwise you'll have issues.
0
 

Author Comment

by:jfaraone
ID: 22637806
Mine is set to MAC hash, as thats the teaming setup on my switch and I didn't want to change it on the switch side. Unless I'm mistaken, Etherchannel load balancing modes are a global setting, not a per port-channel setting. Is this correct?
0
 
LVL 42

Assisted Solution

by:paulsolov
paulsolov earned 2000 total points
ID: 22638475
check this out, it looks like for ESX 2.5 but may also apply.  

http://virtrix.blogspot.com/2006/11/vmware-switch-load-balancing.html

this may also help, look at user comments

http://blog.scottlowe.org/2006/12/04/esx-server-nic-teaming-and-vlan-trunking/
0

Featured Post

Free Tool: Site Down Detector

Helpful to verify reports of your own downtime, or to double check a downed website you are trying to access.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In this article we will learn how to backup a VMware farm using Nakivo Backup & Replication. In this tutorial we will install the software on a Windows 2012 R2 Server.
This article outlines why you need to choose a backup solution that protects your entire environment – including your VMware ESXi and Microsoft Hyper-V virtualization hosts – not just your virtual machines.
Teach the user how to install ESXi 5.5 and configure the management network System Requirements: ESXi Installation:  Management Network Configuration: Management Network Testing:
How to Install VMware Tools in Red Hat Enterprise Linux 6.4 (RHEL 6.4) Step-by-Step Tutorial
Suggested Courses

770 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question