Solved

ESXi Hosts unknown shutdown

Posted on 2012-03-29
9
622 Views
Last Modified: 2012-06-27
I have two DL380 servers.  One is a G6 and the other a G7 running ESXi 4.1, in vcenter.  This morning at 0708 both host shutdown.  Upon arrival at the site, both hosts had power and just needed to be powered on.  No other servers were shut down or rebooted in the rack.  The servers are also configured to turn on when power is applied, but did not do so.  They are also attached to a UPS.  The UPS log showed two low voltage events shortly before the servers went down, each was about 6 seconds.

We believe the UPS is faulty, but it does not indicate so in our monitoring software.

What logs can I look at on the ESXi servers to get any information on what may have happened?
0
Comment
Question by:asrvwiz
  • 4
  • 3
  • 2
9 Comments
 
LVL 119

Assisted Solution

by:Andrew Hancock (VMware vExpert / EE MVE^2)
Andrew Hancock (VMware vExpert / EE MVE^2) earned 400 total points
ID: 37783557
look at

/var/log/vmkernel.log

BUT, you may find the events have gone, because there is little or no storage for ESXinto store events, if the servers have been restarted, the logs will be cleared.

you need to setup a Syslog server for ESXi servers to log events remotely toma syslog server.

see here to enable Syslog

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1016621
0
 

Author Comment

by:asrvwiz
ID: 37784152
No vmkernel.log in /var/log  We do have syslogging enabled to our SIM appliance, I will have to pull reports to see if I can find anything.
0
 
LVL 119
ID: 37784167
sorry, its now called messages
0
Ransomware: The New Cyber Threat & How to Stop It

This infographic explains ransomware, type of malware that blocks access to your files or your systems and holds them hostage until a ransom is paid. It also examines the different types of ransomware and explains what you can do to thwart this sinister online threat.  

 
LVL 119
ID: 37784170
you wil see older logs .0.gz etc
0
 
LVL 55

Expert Comment

by:andyalder
ID: 37786695
There may be some info on the server healt log, but you'd have to reboot from SmartStart CD to read that.

What make/model of UPS is it?
0
 

Author Comment

by:asrvwiz
ID: 37795899
Andyalder,

The UPS is an APC Smart 3000 RM XL.  We moved some of the load off of it and ran a calibration  and a self test both passed.  We think the UPS is bad but we are currently remodeling the space and will be replacing all UPS's with one.  We already have a generator behind the UPS.


Hanccocka,

So it is var/log/messages?  It must get overwrote when it boots.  We do capute that log, but I could not find anything in it.
0
 
LVL 119

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 400 total points
ID: 37796035
Correct ESXi does not keep logs, through a reboot.

You need to create a Syslog server, and get ESXi to send the alerts to a remote Syslog server.

if the server has just died, stopped, powered off, its unlikely anything will be recorded.
0
 
LVL 55

Assisted Solution

by:andyalder
andyalder earned 100 total points
ID: 37796249
SmartUPS are generally OK, the PSUs in these servers need pure sine wave which they provide (unless faulty).
0
 

Author Closing Comment

by:asrvwiz
ID: 37797276
Thanks for the help Everyone!
0

Featured Post

PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Veeam Backup & Replication has added a new integration – Veeam Backup for Microsoft Office 365.  In this blog, we will discuss how you can benefit from Office 365 email backup with the Veeam’s new product and try to shed some light on the needs and …
In this article, I will show you HOW TO: Perform a Physical to Virtual (P2V) Conversion the easy way from a computer backup (image).
This Micro Tutorial walks you through using a remote console to access a server and install ESXi 5.1. This example is showing remote access and installation using a Dell server. The hypervisor is the very first component of your virtual infrastructu…
This video shows you how to use a vSphere client to connect to your ESX host as the root user. Demonstrates the basic connection of bypassing certification set up. Demonstrates how to access the traditional view to begin managing your virtual mac…

860 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question