Solved

ESXi Hosts unknown shutdown

Posted on 2012-03-29
9
614 Views
Last Modified: 2012-06-27
I have two DL380 servers.  One is a G6 and the other a G7 running ESXi 4.1, in vcenter.  This morning at 0708 both host shutdown.  Upon arrival at the site, both hosts had power and just needed to be powered on.  No other servers were shut down or rebooted in the rack.  The servers are also configured to turn on when power is applied, but did not do so.  They are also attached to a UPS.  The UPS log showed two low voltage events shortly before the servers went down, each was about 6 seconds.

We believe the UPS is faulty, but it does not indicate so in our monitoring software.

What logs can I look at on the ESXi servers to get any information on what may have happened?
0
Comment
Question by:asrvwiz
  • 4
  • 3
  • 2
9 Comments
 
LVL 117

Assisted Solution

by:Andrew Hancock (VMware vExpert / EE MVE)
Andrew Hancock (VMware vExpert / EE MVE) earned 400 total points
ID: 37783557
look at

/var/log/vmkernel.log

BUT, you may find the events have gone, because there is little or no storage for ESXinto store events, if the servers have been restarted, the logs will be cleared.

you need to setup a Syslog server for ESXi servers to log events remotely toma syslog server.

see here to enable Syslog

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1016621
0
 

Author Comment

by:asrvwiz
ID: 37784152
No vmkernel.log in /var/log  We do have syslogging enabled to our SIM appliance, I will have to pull reports to see if I can find anything.
0
 
LVL 117
ID: 37784167
sorry, its now called messages
0
 
LVL 117
ID: 37784170
you wil see older logs .0.gz etc
0
How to improve team productivity

Quip adds documents, spreadsheets, and tasklists to your Slack experience
- Elevate ideas to Quip docs
- Share Quip docs in Slack
- Get notified of changes to your docs
- Available on iOS/Android/Desktop/Web
- Online/Offline

 
LVL 55

Expert Comment

by:andyalder
ID: 37786695
There may be some info on the server healt log, but you'd have to reboot from SmartStart CD to read that.

What make/model of UPS is it?
0
 

Author Comment

by:asrvwiz
ID: 37795899
Andyalder,

The UPS is an APC Smart 3000 RM XL.  We moved some of the load off of it and ran a calibration  and a self test both passed.  We think the UPS is bad but we are currently remodeling the space and will be replacing all UPS's with one.  We already have a generator behind the UPS.


Hanccocka,

So it is var/log/messages?  It must get overwrote when it boots.  We do capute that log, but I could not find anything in it.
0
 
LVL 117

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE) earned 400 total points
ID: 37796035
Correct ESXi does not keep logs, through a reboot.

You need to create a Syslog server, and get ESXi to send the alerts to a remote Syslog server.

if the server has just died, stopped, powered off, its unlikely anything will be recorded.
0
 
LVL 55

Assisted Solution

by:andyalder
andyalder earned 100 total points
ID: 37796249
SmartUPS are generally OK, the PSUs in these servers need pure sine wave which they provide (unless faulty).
0
 

Author Closing Comment

by:asrvwiz
ID: 37797276
Thanks for the help Everyone!
0

Featured Post

How your wiki can always stay up-to-date

Quip doubles as a “living” wiki and a project management tool that evolves with your organization. As you finish projects in Quip, the work remains, easily accessible to all team members, new and old.
- Increase transparency
- Onboard new hires faster
- Access from mobile/offline

Join & Write a Comment

It Is not possible to enable LLDP in vSwitch(at least is not supported by VMware), so in this article we will enable this, and also go trough how to enabled CDP and how to get this information in vSwitches and also in vDS.
Veeam Backup & Replication has added a new integration – Veeam Backup for Microsoft Office 365.  In this blog, we will discuss how you can benefit from Office 365 email backup with the Veeam’s new product and try to shed some light on the needs and …
Teach the user how to convert virtaul disk file formats and how to rename virtual machine files on datastores. Open vSphere Web Client: Review VM disk settings: Migrate VM to new datastore with a thick provisioned (lazy zeroed) disk format: Rename a…
This video shows you how easy it is to boot from ISO images for virtual machines with the ISO images stored on a local datastore on the ESXi host.

757 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

22 Experts available now in Live!

Get 1:1 Help Now