vmware - ran out of space on datastore - vm's froze - I freed some space - most are running again

vmware - ran out of space on datastore - vm's froze - I freed some space - most are running again - doing full reboot of guest and host systems - anything I should check other than the obvious - things seem to be running?  

(Mostly RHEL/CentOS guess OS's)
XetroximynAsked:
Who is Participating?

Improve company productivity with a Business Account.Sign Up

x
 
Andrew Hancock (VMware vExpert / EE MVE^2)Connect With a Mentor VMware and Virtualization ConsultantCommented:
vmware - ran out of space on datastore - vm's froze - I freed some space - most are running again

To be expected!!!! The more VMs, you keep deploying and powering on the worse free space gets! Don't assume, you can use all the space to 0 bytes free, you cannot.

You should leave at least 20-30% FREE on a datastore, for

1. Memory SWAP files = RAM allocated in the VM, so if you have an 8GB RAM in the VM, 8GB will be used also on the datastore.

2. Check for Snapshots.

and I have an article you can read to check for that!

HOW TO: VMware Snapshots :- Be Patient

and I'm afraid the rest is down to Poor Administration!

You should have seen the alerts! at 75% and 85%!
0
 
Gary DewrellConnect With a Mentor Senior Network AdministratorCommented:
Had the same issue a couple of months back. Only had one that would not come back and it was due to a corrupt snapshot. Had to call VMware support but they helped manually consolidate all of the snapshots and then all was well.
0
 
XetroximynAuthor Commented:
Don't assume, you can use all the space to 0 bytes free, you cannot.
yes, i would never take any system intentionally above 90%, i know I shouldnt expect to go to 100%....

To be expected!!!!
yes, i figured.... im not complaining my vms froze.... I'm askinng if there is anything I should check, not that I have things running again?  like maybe corruption on esxi datastore


and I'm afraid the rest is down to Poor Administration!

You should have seen the alerts! at 75% and 85%!

yea.... unfortunately acronis in inadvertently made another copy of new vm in the middle of the night..... im working on getting nagios set up on everything so that can have pagerduty actually call me, but havnt finished that yet....  
is there a way i can have vcenter or esxi atleast email me in the meantime?  I could link that up to a pagerduty call.
0
 
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
ESXi datastore will be find, but you could end up with corrupt virtual machine disks, if you had snapshots, and then they'll not power on, and they would be corrupted - game over! hence why it's important, not to go above 75%

vCenter Server can email you if you configure the actions in the alerts, with an email address, and add a SMTP server.
0
 
XetroximynAuthor Commented:
but you could end up with corrupt virtual machine disks, if you had snapshots, and then they'll not power on, and they would be corrupted - game over!

I had some VM's with snapshots, but they seem to have reconciled and booted OK... so I should be good right?  Or are there any possible extra latent problems I should test for?

Thanks!
0
 
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
You also need to check for snapshots on a daily basis, and check why you had snapshots.

Lucky, if you run out of space, they can get corrupted.
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.