Solved

ESXi Hosts unknown shutdown

Posted on 2012-03-29
9
621 Views
Last Modified: 2012-06-27
I have two DL380 servers.  One is a G6 and the other a G7 running ESXi 4.1, in vcenter.  This morning at 0708 both host shutdown.  Upon arrival at the site, both hosts had power and just needed to be powered on.  No other servers were shut down or rebooted in the rack.  The servers are also configured to turn on when power is applied, but did not do so.  They are also attached to a UPS.  The UPS log showed two low voltage events shortly before the servers went down, each was about 6 seconds.

We believe the UPS is faulty, but it does not indicate so in our monitoring software.

What logs can I look at on the ESXi servers to get any information on what may have happened?
0
Comment
Question by:asrvwiz
  • 4
  • 3
  • 2
9 Comments
 
LVL 119

Assisted Solution

by:Andrew Hancock (VMware vExpert / EE MVE^2)
Andrew Hancock (VMware vExpert / EE MVE^2) earned 400 total points
ID: 37783557
look at

/var/log/vmkernel.log

BUT, you may find the events have gone, because there is little or no storage for ESXinto store events, if the servers have been restarted, the logs will be cleared.

you need to setup a Syslog server for ESXi servers to log events remotely toma syslog server.

see here to enable Syslog

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1016621
0
 

Author Comment

by:asrvwiz
ID: 37784152
No vmkernel.log in /var/log  We do have syslogging enabled to our SIM appliance, I will have to pull reports to see if I can find anything.
0
 
LVL 119
ID: 37784167
sorry, its now called messages
0
NAS Cloud Backup Strategies

This article explains backup scenarios when using network storage. We review the so-called “3-2-1 strategy” and summarize the methods you can use to send NAS data to the cloud

 
LVL 119
ID: 37784170
you wil see older logs .0.gz etc
0
 
LVL 55

Expert Comment

by:andyalder
ID: 37786695
There may be some info on the server healt log, but you'd have to reboot from SmartStart CD to read that.

What make/model of UPS is it?
0
 

Author Comment

by:asrvwiz
ID: 37795899
Andyalder,

The UPS is an APC Smart 3000 RM XL.  We moved some of the load off of it and ran a calibration  and a self test both passed.  We think the UPS is bad but we are currently remodeling the space and will be replacing all UPS's with one.  We already have a generator behind the UPS.


Hanccocka,

So it is var/log/messages?  It must get overwrote when it boots.  We do capute that log, but I could not find anything in it.
0
 
LVL 119

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 400 total points
ID: 37796035
Correct ESXi does not keep logs, through a reboot.

You need to create a Syslog server, and get ESXi to send the alerts to a remote Syslog server.

if the server has just died, stopped, powered off, its unlikely anything will be recorded.
0
 
LVL 55

Assisted Solution

by:andyalder
andyalder earned 100 total points
ID: 37796249
SmartUPS are generally OK, the PSUs in these servers need pure sine wave which they provide (unless faulty).
0
 

Author Closing Comment

by:asrvwiz
ID: 37797276
Thanks for the help Everyone!
0

Featured Post

The Eight Noble Truths of Backup and Recovery

How can IT departments tackle the challenges of a Big Data world? This white paper provides a roadmap to success and helps companies ensure that all their data is safe and secure, no matter if it resides on-premise with physical or virtual machines or in the cloud.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

When converting a physical machine to a virtual machine using VMware vCenter Converter Standalone or vCenter Converter Enterprise, if an adapter type is not selected during the initial customization the resulting virtual machine may contain an IDE d…
In this article, I will show you HOW TO: Install VMware Tools for Windows on a VMware Windows virtual machine on a VMware vSphere Hypervisor 6.5 (ESXi 6.5) Host Server, using the VMware Host Client. The virtual machine has Windows Server 2016 instal…
Teach the user how to join ESXi hosts to Active Directory domains Open vSphere Client: Join ESXi host to AD domain: Verify ESXi computer account in AD: Configure permissions for domain user in ESXi: Test domain user login to ESXi host:
This tutorial will walk an individual through the steps necessary to enable the VMware\Hyper-V licensed feature of Backup Exec 2012. In addition, how to add a VMware server and configure a backup job. The first step is to acquire the necessary licen…

813 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

13 Experts available now in Live!

Get 1:1 Help Now