Need Help! Force killing "Consolidate virtual machine disk files" Process in VCenter  The option to cancel is grayed out.

JB Blanco
JB Blanco used Ask the Experts™
on
There is a "Consolidate Virtual Machine Disk Files process that is stuck and i need to kill it ASAP.

Cannot stop/cancel a "Consolidate virtual machine disk files" Process in VCenter  The option to cancel is grayed out.

The process is running from our Backup server service account.  It is running a backup job on the VM and it first takes a snapshot of the vm and then consolidates.  But it is stuck on "Consolidating Virtual Machine Disk Files"  and i already tried to cancel the job in our backup server and it does nothing.  


There are two processes currenlty running on the VM

Process 1 = "Consolidate virtual machine disk files"

Process 2 = "Clone Virtual Machine"

Need help to force kill the Process 1 = "Consolidate virtual machine disk files" process only.  

The process is holding up all of our Backup operations on our Arcserve UDP Server.  It is critical that we are able to kill that process immediately

I have tried running several commands via ESXi SSH to identify the process and kill that process only, but it is not clear what process ID it is!

i tried the command "esxcli vm process list" and i get the following:
t

i tried the command "ps | grep <VM_NAME>  and i get the following:
t
Not sure which process is the "Consolidate virtual machine disk files" process which is the one i want to kill.  

I absolutely cannot kill the Process 2 = "Clone Virtual Machine" as it has been running for over 24 hours and its 80% done and i dont want to stop it!

So i cannot power off the VM at all.  Not an option.

Any suggestions?
Comment
Watch Question

Do more with

Expert Office
EXPERT OFFICE® is a registered trademark of EXPERTS EXCHANGE®
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
Were you CLONING and then a backup operation started or stopped ?
JB BlancoSr Systems Engineer

Author

Commented:
Yes we started the clone operation at 12pm yesterday, and then later at 4:00am the backup started :(
VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017
Commented:
Did the backup complete, continue or fail ?

Because a CLONE operation, generates a snapshot of the parent.

and as there is a task in progress, no other task should be submitted, e.g. the backup would then generate a snapshot or try....

it could be that the backup operation Tried to Take a Snapshot failed, and then went to Consolidate snapshot (maybe)....

I would be patient, and wait for the CLONE to complete and disable Backup in the Backup Job of this VM.
Ensure you’re charging the right price for your IT

Do you wonder if your IT business is truly profitable or if you should raise your prices? Learn how to calculate your overhead burden using our free interactive tool and use it to determine the right price for your IT services. Start calculating Now!

JB BlancoSr Systems Engineer

Author

Commented:
Yes you are correct!

The backup job is stuck, it never even started.

I believe the situation is exactly what you are thinking.

I was afraid you would say that i would have to wait for the clone to finish.  its currently at 80% and its taking sooo long.  cause its a clone from one datacenter to another.  and its soo slow.  

I have already tried to disable/stop/kill the backup job but it is stuck as well.  I got arcserve udp support ticket open to try and stop it somehow but i feel Vcenter may be holding it up.  So thats why i came here.  to try and kill the backup process of Consolidating Virtual Machine Disk Files" Process.  

I also have a ticket open with VMware support to try what they can.,  But still waiting to hear back from them.
JB BlancoSr Systems Engineer

Author

Commented:
is'nt there a way to kill the process?
JB BlancoSr Systems Engineer

Author

Commented:
on the screen shot i posted of "ps | grep <VM_NAME>

Is it possible that one of those processes is corresponding to Process #1??
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
The backup is doing no harm at present, so I would just wait.

As for VMware Support - good luck with that! (VMware Support is getting worse!)

Without having hands on to your server (VMware will via Remote Support and WebEx), that process could be backed off, and "held" waiting for Task to finish. (Clone task)
JB BlancoSr Systems Engineer

Author

Commented:
Ok, the Backup job process was successfully killed on our Backup server.  But i still see the "Consolidate virtual machine disk files" - initiator = Backup Server Service Account process stuck and grayed out from cancellation in VCenter.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
if you restart the vCenter Server Service it will cancel all tasks, but this will also kill the clone task.

What is the CLONE percentage completion ?

Unless the "stack" is now broken! (because of the Snapshot API Task!)

Do more with

Expert Office
Submit tech questions to Ask the Experts™ at any time to receive solutions, advice, and new ideas from leading industry professionals.

Start 7-Day Free Trial