We help IT Professionals succeed at work.

Failure HyperV Cluster

625 Views
Last Modified: 2018-12-20
I have a HyperV Cluster environment.
One of the servers is not listing the virtual machines.
But VMs are up and running.
I can view the VMs of host01, but not of host02.
Also by the Cluster Manager function I can not manage the VMs.

The error below occurs:
The cluster Resource Hosting Subsystem (RHS) process was terminated and will be restarted. This is typically associated with cluster health detection and recovery of a resource. Refer to the System event log to determine which resource and resource DLL is causing the issue.

And:
A component on the server did not respond in a timely fashion. This caused the cluster resource 'Virtual Machine SRVCWBMON01 (2)' (resource type 'Virtual Machine', DLL 'vmclusres.dll') to exceed its time-out threshold. As part of cluster health detection, recovery actions will be taken. The cluster will try to automatically recover by terminating and restarting the Resource Hosting Subsystem (RHS) process that is running this resource. Verify that the underlying infrastructure (such as storage, networking, or services) that are associated with the resource are functioning correctly.
Chamado.png
Comment
Watch Question

MaheshArchitect
CERTIFIED EXPERT
Distinguished Expert 2019

Commented:
remove VMs from cluster, remove server from cluster and add it again and then add virtual machine resources again

Author

Commented:
This problem does not occur only in the Cluster function.
Using HyperV's local host manager, it does not view the VMs that are connected to it.
But the VMs are up and running, that is, I just can not manage them, but they are up and running.

Even right on the host I can not see the VMs.
MaheshArchitect
CERTIFIED EXPERT
Distinguished Expert 2019

Commented:
try installing hyper-v manager tools on other server, windows 10 and check if you are able to connect
kevinhsiehNetwork Engineer
CERTIFIED EXPERT
Commented:
This one is on us!
(Get your first solution completely free - no credit card required)
UNLOCK SOLUTION

Author

Commented:
Yes, but it did not work.
To understand the scenario, today we have two servers in the cluster. Server 02 has this problem.

On server 01 using hyperv manager, it opens its VMs, but it tries to connect to the VMs of server 02.

On server 02 using hyperv manager, it does not open its local VMs, but of that problem server, I can connect to the VMs of server 01 correctly.

I think it's not the HyperV manager tool, but a different one.
MaheshArchitect
CERTIFIED EXPERT
Distinguished Expert 2019

Commented:
may be you can try clear / refresh WMI repository on affected hyper-v host

Author

Commented:
I have not yet restarted, but the concern is to reboot and not recognize the VMs.
At that point I can not manage them, but the VMs are up and running.
If I reboot, they may just not come back, that's the concern.

Author

Commented:
How do I clean the WMI repository?
Architect
CERTIFIED EXPERT
Distinguished Expert 2019
Commented:
This one is on us!
(Get your first solution completely free - no credit card required)
UNLOCK SOLUTION

Author

Commented:
WMI repositor is consistent

But, I found on Server 02, the Hyper-V Virtual Machine Management service in Stopping status.

He is locked in this position and does nothing.
This is why VMs are still in the air but do not appear in the HyperV Manager.
FailoverClusterManager.png
ServiceStopping.png
Server02-connectVMsServer01.png
Server02-not-connect-local-VMs.png
kevinhsiehNetwork Engineer
CERTIFIED EXPERT

Commented:
You can try to kill the process on the host.

Author

Commented:
I did this, I restarted the service, but the problem persists.

Author

Commented:
I'll schedule it for the server tonight.
kevinhsiehNetwork Engineer
CERTIFIED EXPERT

Commented:
I would manually shut down the VMs on the bad host before rebooting the host, so so they get shut down cleanly.
Philip ElderTechnical Architect - HA/Compute/Storage
CERTIFIED EXPERT

Commented:
There's a problem with Hyper-V communicating with storage from what I can see.
Get-NetAdapter | Sort Name
Get-NetLbfoTeam | Format-List
Get-VMSwitch  | Format-List

Open in new window

Let's start there.

Then, what is the Hyper-V to storage layout please?
Get-ClusterResource
Get-Cluster

Open in new window

Author

Commented:
I researched google, and I found several people saying that when the HyperV service starts giving problems, they only resolved by restarting the host.

Yes kevinhsieh, I will manually turn off each VM.

Philip Elder, the VMs are in the air and run and I can communicate with the storages without problems.

I have 16 VMs running from that host and everything is functional, just no communication to manage the VMs.

Author

Commented:
After the server restarted, the WMI service went up disabled and corrupted.
I did the recommended procedures for you.
I put the service in automatic mode and rebooted server.
HyperV has returned to normal.
Thanks for the recommendations.

Gain unlimited access to on-demand training courses with an Experts Exchange subscription.

Get Access
Why Experts Exchange?

Experts Exchange always has the answer, or at the least points me in the correct direction! It is like having another employee that is extremely experienced.

Jim Murphy
Programmer at Smart IT Solutions

When asked, what has been your best career decision?

Deciding to stick with EE.

Mohamed Asif
Technical Department Head

Being involved with EE helped me to grow personally and professionally.

Carl Webster
CTP, Sr Infrastructure Consultant
Empower Your Career
Did You Know?

We've partnered with two important charities to provide clean water and computer science education to those who need it most. READ MORE

Ask ANY Question

Connect with Certified Experts to gain insight and support on specific technology challenges including:

  • Troubleshooting
  • Research
  • Professional Opinions
Unlock the solution to this question.
Join our community and discover your potential

Experts Exchange is the only place where you can interact directly with leading experts in the technology field. Become a member today and access the collective knowledge of thousands of technology experts.

*This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

OR

Please enter a first name

Please enter a last name

8+ characters (letters, numbers, and a symbol)

By clicking, you agree to the Terms of Use and Privacy Policy.