VDP Snapshots left after powering down VDP

brian_appliedcpu used Ask the Experts™
We have a VMware 5.1 cluster with VDP backup.
I was storage vmotioning several vm's the other day and the VDP got stupid and was running for more than 12 hours.  Users were complaining about the slow down so I forcibly shut down the VDP servers. (They were taking wayyyyy to long to shut down)  Now I have vdp snapshots left with my VMs.  I tried to vstorage motion one vm and it hung at 81%.  After a rather long process of removing the vm and recreating and pointing to the vmdk it is back up but do not want to go thru the process for 6 more VMs.
If I power up VDP will it clean up?
Is there any other way to clean them up? (is consolidate safe?)

Any help is appreciated...  very stressed out right now.
Watch Question

Do more with

Expert Office
EXPERT OFFICE® is a registered trademark of EXPERTS EXCHANGE®
VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017
You are not really, going to like what I about to tell you, but ALL backup applications which backup VMs, even VMware, and Veeam etc, will leave VMs running on snapshots after backup which is *BAD*.

It's a part of VMware Administration you need to get used to, and check every day after backup, they are not running on a snapshot, and it's been like its forever, since VMware invented and released ESX 1.0 (I've been there with them since then!)

So either check manually, or set a vCenter Alarm, to warn you of Snapshots, or run scripts etc

When a VM runs on a snapshot performance will be poor, and at the next backup, the situation gets worse.....

VDP WILL NOT solve this on restart you will need to complete some admin....

Have a read of my EE Article

HOW TO: VMware Snapshots :- Be Patient

Sometimes, you will not see any snapshots listed in Snapshot Manager.

How to solve the issue....

1. Take a new snapshot.
2. Wait 60 seconds
3. Select Delete ALL and BE PATIENT!

Snapshot merging/deletion can take, seconds, minutes, hours, days and weeks, DO NOT be tempted to stop/cancel the operation when started, fiddle with vCenter, stop vCenter Server, stop services, fiddle with Hosts etc - you will corrupt the virtual disk!

Walk away, get a coffee, do not stare at the screen, it's likely to sit at 90, 95 or 99% for hours, and look hung, but it will complete.

this depends on how large the snapshot and fast your storage is...

So before you continue, read my EE Article Above, I feel your pain, screenshot datastore folders, and lets see what the Snapshot sizes are....

and Welcome to Snapshot Hell - snapshots are evil...


and when Merging a Snapshot performance of the VM gets worse, so if you can turn OFF the VM, the better!


Thank you!
Shut them down one at a time and followed your advice.
They consolidated at a rate of around 1GB / Min so the 10GB snapshots went fast.
Had one VM that shut down but VCenter thought it was still up.... hung.... I hate my job.
So even trying to do an esxcli shutdown with hard and force did nothing
esxcli vms vm kill --type=[soft,hard,force] --world-id=WorldNumber
Had to restart the host, then it came up as invalid
Had to remove from the vcenter and re-add.  During that process the vmx file icon was not valid so it did not want to add... refresh and it changed.... The Lord is good, it was a huge exchange server.
Added it back, then booted fine, then down again, do the snapshot dance per your instructions and take it back up.  Store mounted fine and on to the next.
Did I say I hate my job....
Thank you for your assistance.
I am still curious why it hung on shutdown and why when I vstorage motioned a vm that had a snapshot that it hung on 81% for 12+ hours, if you think you can answer them I can start a new question.
Thanks again you were a life saver.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Thanks for your kinds words...

1. VDP does take an age to shutdown, and sometimes it remains unresponsive and hangs! (still in latest version!).

2. I would *never* be confident in Storage vMotioning a VM with a snapshot! Deal with the snapshot first!

Do more with

Expert Office
Submit tech questions to Ask the Experts™ at any time to receive solutions, advice, and new ideas from leading industry professionals.

Start 7-Day Free Trial