Solved

vmware - ran out of space on datastore - vm's froze - I freed some space - most are running again

Posted on 2016-07-17
6
91 Views
1 Endorsement
Last Modified: 2016-10-27
vmware - ran out of space on datastore - vm's froze - I freed some space - most are running again - doing full reboot of guest and host systems - anything I should check other than the obvious - things seem to be running?  

(Mostly RHEL/CentOS guess OS's)
1
Comment
Question by:Xetroximyn
  • 3
  • 2
6 Comments
 
LVL 12

Assisted Solution

by:Gary Dewrell
Gary Dewrell earned 250 total points
ID: 41715999
Had the same issue a couple of months back. Only had one that would not come back and it was due to a corrupt snapshot. Had to call VMware support but they helped manually consolidate all of the snapshots and then all was well.
0
 
LVL 117

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE) earned 250 total points
ID: 41716017
vmware - ran out of space on datastore - vm's froze - I freed some space - most are running again

To be expected!!!! The more VMs, you keep deploying and powering on the worse free space gets! Don't assume, you can use all the space to 0 bytes free, you cannot.

You should leave at least 20-30% FREE on a datastore, for

1. Memory SWAP files = RAM allocated in the VM, so if you have an 8GB RAM in the VM, 8GB will be used also on the datastore.

2. Check for Snapshots.

and I have an article you can read to check for that!

HOW TO: VMware Snapshots :- Be Patient

and I'm afraid the rest is down to Poor Administration!

You should have seen the alerts! at 75% and 85%!
0
 

Author Comment

by:Xetroximyn
ID: 41716050
Don't assume, you can use all the space to 0 bytes free, you cannot.
yes, i would never take any system intentionally above 90%, i know I shouldnt expect to go to 100%....

To be expected!!!!
yes, i figured.... im not complaining my vms froze.... I'm askinng if there is anything I should check, not that I have things running again?  like maybe corruption on esxi datastore


and I'm afraid the rest is down to Poor Administration!

You should have seen the alerts! at 75% and 85%!

yea.... unfortunately acronis in inadvertently made another copy of new vm in the middle of the night..... im working on getting nagios set up on everything so that can have pagerduty actually call me, but havnt finished that yet....  
is there a way i can have vcenter or esxi atleast email me in the meantime?  I could link that up to a pagerduty call.
0
Get up to 2TB FREE CLOUD per backup license!

An exclusive Black Friday offer just for Expert Exchange audience! Buy any of our top-rated backup solutions & get up to 2TB free cloud per system! Perform local & cloud backup in the same step, and restore instantly—anytime, anywhere. Grab this deal now before it disappears!

 
LVL 117
ID: 41716070
ESXi datastore will be find, but you could end up with corrupt virtual machine disks, if you had snapshots, and then they'll not power on, and they would be corrupted - game over! hence why it's important, not to go above 75%

vCenter Server can email you if you configure the actions in the alerts, with an email address, and add a SMTP server.
0
 

Author Comment

by:Xetroximyn
ID: 41716199
but you could end up with corrupt virtual machine disks, if you had snapshots, and then they'll not power on, and they would be corrupted - game over!

I had some VM's with snapshots, but they seem to have reconciled and booted OK... so I should be good right?  Or are there any possible extra latent problems I should test for?

Thanks!
0
 
LVL 117
ID: 41716995
You also need to check for snapshots on a daily basis, and check why you had snapshots.

Lucky, if you run out of space, they can get corrupted.
0

Featured Post

Backup Your Microsoft Windows Server®

Backup all your Microsoft Windows Server – on-premises, in remote locations, in private and hybrid clouds. Your entire Windows Server will be backed up in one easy step with patented, block-level disk imaging. We achieve RTOs (recovery time objectives) as low as 15 seconds.

Join & Write a Comment

Suggested Solutions

When we have a dead host and we lose all connections to the ESXi, and we need to find a way to move all VMs from that dead ESXi host.
Last article we focus in how to VMware: How to create and use VMs TAGs – Part 1 so before follow this article and perform the next tasks, you should read the first article how to create the TAG before using them in Veeam Backup Jobs.
Teach the user how to install log collectors and how to configure ESXi 5.5 for remote logging Open console session and mount vCenter Server installer: Install vSphere Core Dump Collector: Install vSphere Syslog Collector: Open vSphere Client: Config…
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.

707 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

16 Experts available now in Live!

Get 1:1 Help Now