Need Help! Force killing "Consolidate virtual machine disk files" Process in VCenter The option to cancel is grayed out.

There is a "Consolidate Virtual Machine Disk Files process that is stuck and i need to kill it ASAP.

Cannot stop/cancel a "Consolidate virtual machine disk files" Process in VCenter  The option to cancel is grayed out.

The process is running from our Backup server service account.  It is running a backup job on the VM and it first takes a snapshot of the vm and then consolidates.  But it is stuck on "Consolidating Virtual Machine Disk Files"  and i already tried to cancel the job in our backup server and it does nothing.  


There are two processes currenlty running on the VM

Process 1 = "Consolidate virtual machine disk files"

Process 2 = "Clone Virtual Machine"

Need help to force kill the Process 1 = "Consolidate virtual machine disk files" process only.  

The process is holding up all of our Backup operations on our Arcserve UDP Server.  It is critical that we are able to kill that process immediately

I have tried running several commands via ESXi SSH to identify the process and kill that process only, but it is not clear what process ID it is!

i tried the command "esxcli vm process list" and i get the following:
t

i tried the command "ps | grep <VM_NAME>  and i get the following:
t
Not sure which process is the "Consolidate virtual machine disk files" process which is the one i want to kill.  

I absolutely cannot kill the Process 2 = "Clone Virtual Machine" as it has been running for over 24 hours and its 80% done and i dont want to stop it!

So i cannot power off the VM at all.  Not an option.

Any suggestions?
JB BlancoSr Systems EngineerAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
Were you CLONING and then a backup operation started or stopped ?
JB BlancoSr Systems EngineerAuthor Commented:
Yes we started the clone operation at 12pm yesterday, and then later at 4:00am the backup started :(
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
Did the backup complete, continue or fail ?

Because a CLONE operation, generates a snapshot of the parent.

and as there is a task in progress, no other task should be submitted, e.g. the backup would then generate a snapshot or try....

it could be that the backup operation Tried to Take a Snapshot failed, and then went to Consolidate snapshot (maybe)....

I would be patient, and wait for the CLONE to complete and disable Backup in the Backup Job of this VM.

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Your Guide to Achieving IT Business Success

The IT Service Excellence Tool Kit has best practices to keep your clients happy and business booming. Inside, you’ll find everything you need to increase client satisfaction and retention, become more competitive, and increase your overall success.

JB BlancoSr Systems EngineerAuthor Commented:
Yes you are correct!

The backup job is stuck, it never even started.

I believe the situation is exactly what you are thinking.

I was afraid you would say that i would have to wait for the clone to finish.  its currently at 80% and its taking sooo long.  cause its a clone from one datacenter to another.  and its soo slow.  

I have already tried to disable/stop/kill the backup job but it is stuck as well.  I got arcserve udp support ticket open to try and stop it somehow but i feel Vcenter may be holding it up.  So thats why i came here.  to try and kill the backup process of Consolidating Virtual Machine Disk Files" Process.  

I also have a ticket open with VMware support to try what they can.,  But still waiting to hear back from them.
JB BlancoSr Systems EngineerAuthor Commented:
is'nt there a way to kill the process?
JB BlancoSr Systems EngineerAuthor Commented:
on the screen shot i posted of "ps | grep <VM_NAME>

Is it possible that one of those processes is corresponding to Process #1??
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
The backup is doing no harm at present, so I would just wait.

As for VMware Support - good luck with that! (VMware Support is getting worse!)

Without having hands on to your server (VMware will via Remote Support and WebEx), that process could be backed off, and "held" waiting for Task to finish. (Clone task)
JB BlancoSr Systems EngineerAuthor Commented:
Ok, the Backup job process was successfully killed on our Backup server.  But i still see the "Consolidate virtual machine disk files" - initiator = Backup Server Service Account process stuck and grayed out from cancellation in VCenter.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
if you restart the vCenter Server Service it will cancel all tasks, but this will also kill the clone task.

What is the CLONE percentage completion ?

Unless the "stack" is now broken! (because of the Snapshot API Task!)
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Virtualization

From novice to tech pro — start learning today.