Solved

VM disconnects from the network - still responsive at the console

Posted on 2011-03-14
27
646 Views
Last Modified: 2012-05-11
I have a VM that was creating via the vsphere client.  I selected Windows 2003 Server Enterprise 32 bit as the template.  I ended up using a R2 release version, however, not sure if that matters for when selecting the Os type I didn't see an option for R2.  I tried creating a VM from an existing template I created and one from scratch and I get the same symptoms...  After running for about 5 days it drops off the network.  The VM is responsive at the console, however, it can't see the network.  It's a DC and a certificate server.  I tried re-creating the VM three different times and got the same results.  If I enable/disable the NIC it doesn't fix it.  I also tried different NIC cards.  I have to reboot to get it to work after dropping off of the network..  Any suggestions?
0
Comment
Question by:gopher_49
  • 16
  • 7
  • 3
  • +1
27 Comments
 
LVL 118
ID: 35128565
is this the only VM which has this issue?
0
 

Author Comment

by:gopher_49
ID: 35128618
yes...  Keep in mind that I've recreated it twice using an existing template and once from scratch and always get the same symptoms.  I'm moving it to a different host right now, however, not sure if that's going to matter.
0
 
LVL 16

Expert Comment

by:danm66
ID: 35129920
have you used the same IP and hostname for it each time?  Can you change one or the other and see if the behavior goes away?  Also, if/when it does happen again, check the physical switch's arp table to see if it's listed there.  It sounds like something is causing the arp entry to be poisoned.  If I'm right, this behavior shouldn't change if it's moved to another host and they have identical network setups.
0
 

Author Comment

by:gopher_49
ID: 35129960
I tried changing the host name and that didn't help.  I have not tried changing the IP address for it's a domain controller and not sure to the impact of that.  I'll read up on changing the IP address of a DC.  I have two other DC's so I guess it should be okay.  

I have a feeling moving to the different host won't help either.  I had ARP poisoning issues at one time.  It was due to a pair of AP 5131 radios talking back to my wireless controller.  I'll check the wireless controller's syslog too.  
0
 

Author Comment

by:gopher_49
ID: 35130055
I see some ARP cache poisioning entries listed in my wireless controller.  Since it's a VM the old MAC address was different.  When it happens again I'll look on my wireless and ethernet switch.  It might be 5+ days though.
0
 

Author Comment

by:gopher_49
ID: 35172016
I did a show arp table command on the switch and I only see a few IP addresses...  One is my ASA firewall, one is my network monitor server, internel router for our site to site T1's, and the desktop that's logged into the switch.

My other switches only show these same IP's...
0
 

Author Comment

by:gopher_49
ID: 35172107
I changed the IP address.  Maybe we should wait and see what happens now?  
0
 
LVL 16

Expert Comment

by:danm66
ID: 35174035
If it's a MAC issue, it will come back no matter what the IP is, so let's see if it comes back.
0
 

Author Comment

by:gopher_49
ID: 35174157
Sounds good.  I'll update the ticket in 5 days or so...  It usually drops by then.
0
 

Author Comment

by:gopher_49
ID: 35215092
I changed the IP address on the 19th and it hasn't dropped yet, however, in the past it's stayed up this long so we'll see.  
0
 
LVL 16

Expert Comment

by:danm66
ID: 35217769
Leave the question open as long as you need to.
0
 

Author Comment

by:gopher_49
ID: 35226666
The VM dropped off the network again.  This is even with the new IP address.  Any other suggestions?
0
 
LVL 118
ID: 35226852
any events logged in the VM event log?
0
6 Surprising Benefits of Threat Intelligence

All sorts of threat intelligence is available on the web. Intelligence you can learn from, and use to anticipate and prepare for future attacks.

 
LVL 118
ID: 35226856
have you allocated a static ip address?
0
 

Author Comment

by:gopher_49
ID: 35226953
It's using a static IP address via the windows NIC tcip/ip properties.  Is there somewhere else in the VMware environment I need to allocate an IP?

In the past I did not see any esxi event logs.  I'll check again.
0
 
LVL 118
ID: 35229608
No, there's nothing else you should do inside the VM.

Windows Event Logs not ESXi event logs.

How many VMs do you have on the ESXi server?

Can you send a picture of the Networking in ESXi?

Have you exceeded the portgroups on the vSwitch?

0
 
LVL 3

Expert Comment

by:fireline1082
ID: 35229772
Not sure if this is related to your problem

but we have a problem in our company on one VM where intially it was setup for Windows 2003 SP x86 and then later we format the VM and changed it to Win 2003 R2 X64

we had the network adapter issue, and to fix this'- we just removed the exiting adapter which was setup to Flexible and changed it to E1000 - then it works


check the network adapter settings - to confirm the proper type you can check any exisitng running R2 server in your environement and change the network adapter accordingly


0
 

Author Comment

by:gopher_49
ID: 35232149
fireline1082,

My template is for Windows 2003 Enterprise Server 32 bit, however, it did not mention R2.  I'm using R2...  I'm not sure if that's the problem but maybe so?!  I do not see a template for R2.  I've been VERY suspicious to the template...  But.. I just don't see a R2 template.

I've removed the nic and replaced it with both the E1000 and even tried other nic's.

I only have physical servers running Enterprise Edition R2.  I do not have any VM's running R2 Enterprise.

hanccoka,

I see nothing in the event logs...  Once it drops of course it can't see the other DC's and I get errors in regards to not seeing them, but, prior to it dropping I see nothing.

I have 5 x VM's on the ESXi server and only 4 are running.  I even moved it to a different ESXi server and that didn't help.

I seriously doubt I've exceeded the portgroups in the vSwitch for I have a very basic config.  It's attached.




ESXi-network-config.jpg
0
 
LVL 118

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE) earned 250 total points
ID: 35232301
yes, looking at the vSwitch, you've not exceeded portgroups.

when networking is lost, have you tried, disconnecting and connecting networking from within the VM using VM Tools Applet?

what error if any do you get if you ping inside the machine, is there any traffic flowing, you'd have to look at the status of the NIC, in the VM,
0
 

Author Comment

by:gopher_49
ID: 35232677
I have not tried disconnecting via the network config of the VM in the vsphere client.  I have tried disabling and reenabling via windows.  That didn't help.  I have tried pinging to other hosts on the LAN but the VM only has one IP.  Next time should I try pinging the VM's IP's and then try pinging other IP's in the host?
0
 
LVL 118
ID: 35232738
yes, try to isolate the fault, is it in the VM or host.

0
 

Author Comment

by:gopher_49
ID: 35233128
ok..  It usually take about 5 days to drop...
0
 

Author Comment

by:gopher_49
ID: 35286052
hanccocka,

The VM can see any VM in the vswitches on either host, however, it cannot see ANY other host outside of the vswitches...  
0
 

Author Comment

by:gopher_49
ID: 35286064
correction.

It can only see IP address/hosts on it's physical switch. It can't see outside of that particular switch.  
0
 

Assisted Solution

by:gopher_49
gopher_49 earned 0 total points
ID: 37341532
I found out the problem.  

hanccocka,

Your suggestion of isolating it to where it's the VM or host helped.  I moved to a different host and same symptoms, however, I also noted that it could see other VM's within the same vswitch.  So, it's something to do with traffic in the vswitch.  I ended turning off my GFI Network Server and sure enough the VM quit dropping off of the network.  For some reason GFI Network Server monitor causes my domain controller VM to drop off of the physical switching network.  Not sure to why.. But...   It's ran for weeks and no problems.  In the past every 6-7 days it would drop.  It's now been 2.5 weeks and no problems at all.
0
 

Author Closing Comment

by:gopher_49
ID: 37360228
I ended up figuring out the culpurate with the help of hanccocka.  The VM can talk to any other VM within it's on vswitch, however, it can't talk to VM's or physical servers outside of it's vswitch and/or across the physical switches.  I turned off GFI Network Server monitor and the VM (domain controller) now stays on the network.
0
 
LVL 118
ID: 37341564
Glad, my suggestions help isolate the issue.
0

Featured Post

What Is Threat Intelligence?

Threat intelligence is often discussed, but rarely understood. Starting with a precise definition, along with clear business goals, is essential.

Join & Write a Comment

This article will show you how to create an ISO CD-ROM/DVD-ROM image (*.iso), and MD5 checksum signature, for use with VMware vSphere Hypervisor 6.5 (ESXi 6.5). It's a good idea to compare checksums, because many installations fail because of a corr…
In this article, I will show you HOW TO: Create your first Windows Virtual Machine on a VMware vSphere Hypervisor 6.5 (ESXi 6.5) Host Server, the Windows OS we will install is Windows Server 2016.
Teach the user how to join ESXi hosts to Active Directory domains Open vSphere Client: Join ESXi host to AD domain: Verify ESXi computer account in AD: Configure permissions for domain user in ESXi: Test domain user login to ESXi host:
This Micro Tutorial steps you through the configuration steps to configure your ESXi host Management Network settings and test the management network, ensure the host is recognized by the DNS Server, configure a new password, and the troubleshooting…

760 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

19 Experts available now in Live!

Get 1:1 Help Now