PING: General fault in VM’s

I have an ESXi 6.5 server with three VM guests running Windows Server 2008 R2.  I have an external switch connected to a router with a gateway of 192.168.25.1, and all VM’s have static IP’s in the .25 network.

All three VM’s could talk to each other and to the Internet with my local DNS servers - until today.  Now, each time I ping from one of the  servers to any other server and to the gateway I get a General Fault error.  I’ve reinstalled the VM Nic card to no avail.  I’ve restarted all VM’s and the ESX server and the switch the ESX is connected to, also to no avail.  I don’t know what’s changed from when it worked before.
weblarsAsked:
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

x
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
are you using the VMXNET3 network interface in the VMs?

are all VMs connected and connected at power on ?
0
weblarsAuthor Commented:
I’m not sure where I find that.  In Device Manager the network adapter is “Intel(R) PRO/1000 MT Network Connection.”
0
bbaoIT ConsultantCommented:
>  I get a General Fault error.

basically it means the VM is not network connected in anyway, nothing to do with the default gateway, DNS settings or any other host on the same subnet.

if you run IPCONFIG /ALL on the local VM, does it show an IP address assigned to the NIC? or, can you please simply post the result of IPCONFIG /ALL? thanks.
0
Making Bulk Changes to Active Directory

Watch this video to see how easy it is to make mass changes to Active Directory from an external text file without using complicated scripts.

weblarsAuthor Commented:
I've uploaded a snapshot of the ipconfig /all command.
ipconfig.JPG
0
Brian McDonaldIT ManagerCommented:
Looks like the hosts are not connected to the physical switch

are the nics on and active?

The duplicate warning is interesting, try shutting off all but one machine and seeing what happens.

Did you make a change to the vswitch or nic assignments recently?
0
weblarsAuthor Commented:
I’ve made no changes to the VM Network components.  The IP addresses are the same as when they worked weeks ago.  I went down to one VM and it still said Duplicate.  I ran the netsh winsock reset and netsh int ipv4 reset command and after reboot I reassigned the VM to the original IP and got an IP address conflict message.
0
Brian McDonaldIT ManagerCommented:
Do you have multiple vm nics assigned on the server, you could remove the vmnic and add a new one, or simple disable it and add a new one. In the guest "edit settings" area does it list only one nic? Are you using nic teaming and the team failed?
0
weblarsAuthor Commented:
I’ve added a second nic, disabled the first, and nothing works.  I’m not using teaming.
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Hello

I agree with what Brian says, deactivates one of the network interfaces at the level of the operating system, since you have duplicity of ip address.

Or you can disconnect a network card at the vm level, it also validates that the vm is in the VLAN required to establish the connection.

Regards..
0
weblarsAuthor Commented:
Everything worked weeks ago with one NIC in each VM and they talked to each other as well as other devices in the subnet.
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Hello

Do you have any physical firewall between those virtual machines, which can block communication ?.

Disable the operating system firewall.

Regards..
0
weblarsAuthor Commented:
Firewall has been disabled.
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Hello

You use some specific port to establish the communication between the servers.

Run a port scanner to validate if the port you are using is blocked.

Do you use a DHCP server to assign ip addresses to these servers?

Regards..
0
weblarsAuthor Commented:
Wouldn’t ping still work regardless of what different ports I used?  ICMP is not blocked by default.  A General Faulure of the NIC card does imply that it’s not running properly yet I’ve removed and reinstalled them to no avail.
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Do you use a DHCP server to assign ip addresses to these servers?
0
weblarsAuthor Commented:
No.  All IP addresses are static.
0
weblarsAuthor Commented:
One thing I notice now is that I lose all connectivity to the guests and the ESXi GUI and I have to restart the Management Network on the ESXi host.  DOn't know if this is a factor.
0
R@f@r P@NC3RVirtualization SpecialistCommented:
ok, did you try to remove the network card from the vm?

add it again, then disable it and enable it in the operating system?

Regards..
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Restart the ESXi administration agents, and try the connection again.

Do you have other hosts, where can you migrate the vm? if so, migrate the vm to another host and test if you have a connection between the servers.
0
weblarsAuthor Commented:
I removed all the NIC cards at teh Edit Settings level of the VM in the ESXi Administrator.  I then shut the VM down.  I then added a NIC card fron Settings and brought up the guest.  It came up with the NIC card installed and I still have "PING: transmit failed. General failure" mesages
0
weblarsAuthor Commented:
The ESXi host is connected to the physical switch, BTW.  Link lights are on and active.
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Do you have other hosts, where can you migrate the vm? if so, migrate the vm to another host and test if you have a connection between the servers.

Did you restart the host administration agents?

Do you have alarms at the Host level where the vm reside?

Do you have a distributed or standard switch?

Regards..
0
weblarsAuthor Commented:
How do you restart the host administrator agents?
I do have an event that says "Cannot connect to the specified gateway 192.168.25.1. Failed to set it."
Switch is Cisco SGE2000.
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Enter via putty to the host where the virtual machines reside, once you enter the host enter the following command:

services.sh restart

When the restart of the management agents is finished, validate again if there is a connection between the vm.

if it tells you that error message at the level of the Switch is Cisco SGE2000. The problem must come from your physical switch, it is good that you review the configurations of the physical switch and validate if there are problems at the level of the equipment.
0
weblarsAuthor Commented:
The ESX host can ping my gateway from the Test Management Network section of the System Configuration command.
0
weblarsAuthor Commented:
Here's what happens when i Putty to the host:
putty.JPG
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Please validate that you have the ssh service enabled on the Host

and the ESX shell too.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
don't use E1000 interface, add VMXNET3
0
weblarsAuthor Commented:
VMXNET3 adapter has teh same problem.  I've also swapped my switch for a NetGear ProSafe and the problem still persists.  It is either the VM Network setup that is incorrect or the NIC card on my physical ESXi server is bad.
0
weblarsAuthor Commented:
Where should I start looking at eh VM Network settings?  Here is what I have now:
vmnetwork.JPG
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
do all the VMs fail ?
0
weblarsAuthor Commented:
Yes
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Okay lets look at ESXi 6.5 host. please ensure that network interface is connected, and connected at power on

can you ping 127.0.0.1 in a VM ?

can you ping the VMs IP Address ?

can you ping the ESXi host IP Address from VM ?
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Hello

Please try to migrate those VMs to another ESXi, to validate if the network connection is established. Do you have another Host where you can migrate those vm?

Validate the configuration of the network cards in your physical server.

Also check your physical switch to see what settings it has and if it is connected to your physical host.

Share the images if possible.

I remain attentive to your comments.

regards...
0
weblarsAuthor Commented:
I don’t have another ESXi host.  I would have to build a new one.  I will verify the physical NIC card on the server before doing so.  My switch works because my other machines talk to it as well as to the ESXi host.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
I was waiting for the results of my question ?
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Hello,

Verify your network card in your physical server, validate that they are not alarmed.

Validate that you have communication from the Host to the vm and from the vm to the host.

Validate your DNS settings, with an nslookup.

I remain attentive to your comments.

Regards...
0
weblarsAuthor Commented:
I can ping 127.0.0.1, I cannot ping itself nor can I ping the VM host.
0
weblarsAuthor Commented:
I also cannot ping the VM's from the host isng the Testing Management Network page.
0
weblarsAuthor Commented:
Here is what my vmnic's look like:
vmnetwork1.JPG
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Hello,

On the vmnic1 card, place the same speed that you have set in the vmnic0.

Can you ping the gateway from the vm? and from the host?

I remain attentive to your comments.

Regards...
0
weblarsAuthor Commented:
I can ping the gateway from the host, but not from any of the VM's.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
why is a link down remove nic and re-test

can you just quickly deploy a new VM and check networking

are your VMs Statically Allocated ?

if you set to DHCP do they get an IP Address?
0
weblarsAuthor Commented:
How do I delete vmnic1?

I have no DHCP server on this network.  All VM's are statically assigned.

I'll try to bring up a new VM and test.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
select properties of vSwitch
0
weblarsAuthor Commented:
Where do I select properties of vSwitch?
0
weblarsAuthor Commented:
Okay vmnic1 is deleted.
0
weblarsAuthor Commented:
I built a new VM and I have the same problem.  See attached:
vmnewvm.JPG
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Hello,

Can you change that vm to another VLAN to validate if the problem is resolved?

I remain attentive to your comments.

Regards...
0
weblarsAuthor Commented:
I'm not sure what you mean.  Aother vlan where?
0
weblarsAuthor Commented:
When I change the IP from 192.168.25.247 to 192.168.26.247, I get an IP address conflict.
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Hello,

Go to the operating system.
Properties of the network card.
Select TCP-IP v4 - Properties
Change the ip address that you indicate.

I remain attentive to your comments.

Regards...
0
weblarsAuthor Commented:
Every IP address I choose says (Duplicate) and I get the IP address conflict window.  THese are IP addresses that I know are not being used.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
if you were to change the IP Address to 10.10.1.1 ?

does this work, with no error, can you ping it ?
0
weblarsAuthor Commented:
No, it doesn't work with 10.10.1.1.  I can only ping loopback, all other IP address give me General Failure.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
were there any changes made before this issue started you can recall ?
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Hello,

Do you have a firewall that blocks communication between the host and the vm?
I remain attentive to your comments.

Regards...
0
weblarsAuthor Commented:
My problem appears to be more than the ESXi server.  I took a 5-port switch and connected the uplink to my Cisco ASA router to it and my laptop, and nothing else.  Attached is the config of my laptop network port.  You see that the IPV4 address is marked Duplicate, just like the Autoconfiguration IP address.  I can ping 127.0.0.1, but I cannot ping 192.168.25.51 or 192.168.25.1.  I used to be able to do this, but now I can't.  Since I've isolated the traffic to only my laptop and the ASA router, I have to believe my problem is with the ASA router.  I am not sure what has changed.
vmnetwork2.JPG
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Hello,

validate with your interconnectivity staff the router and the configurations that were previously, probably modified something that is causing the problem, because at VM level, and vmnic cards there are no failures.

Verify mainly the router.

Let me know the results of the tests.

regards...
0
weblarsAuthor Commented:
The router was the issue.  There was a misconfigured IPSec tunnel that was broadcasting across my subnet and blocking access.  Thank you all for your help.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
How did the router get changed?
0
weblarsAuthor Commented:
Unknown
0
R@f@r P@NC3RVirtualization SpecialistCommented:
Hello,

Excellent that the problem will be solved, do not forget to describe what was the best solution to your problem.

Greetings.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Virtualization

From novice to tech pro — start learning today.