Solved

Logging on VMware 5.5

Posted on 2014-03-09
10
1,320 Views
Last Modified: 2014-03-20
I have a VMware ESXi 5.5 that hangs up twice within last two days. Is there any log on VMware that I can check.

I have check the log /var/log/syslog.log but I can't find anything strange.

Tks
0
Comment
Question by:AXISHK
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 5
10 Comments
 
LVL 25

Expert Comment

by:Zephyr ICT
ID: 39916788
These logs are of interest as well:

/var/log/hostd.log
/var/log/vmkernel.log

where "/var/log/vmkwarning.log" is a summary of the Warning and Alerts taken from the VMkernel log...

Could be a hardware issue ... But yeah, the logs should shed more light on it, hopefully.
0
 

Author Comment

by:AXISHK
ID: 39916821
See this couple of time in the vmkwarning.log. For the time "2014-03-08T18:04:38.291Z", what time zone does it log ?  I have two disk, usb installed with vmware OS. A a single RAID5 disk holding the database. Does my problem relate to disk issue ?

fidsk show two disk, what are they ?

Disk /dev/disks/mpx.vmhba32:C0:T0:L0: 7856127 sectors, 7671K
Disk /dev/disks/mpx.vmhba1:C0:T0:L0: 2006782768 sectors, 1913M


 cpu2:32787)WARNING: ScsiDeviceIO: 1223: Device mpx.vmhba1:C0:T0:L0 performance has deteriorated. I/O latency increased from average value of 19335 microseconds to 584548 microseconds.
vmkernel.log
0
 
LVL 25

Expert Comment

by:Zephyr ICT
ID: 39916836
I'm assuming this is your USB containing ESXi:

Disk /dev/disks/mpx.vmhba32:C0:T0:L0: 7856127 sectors, 7671K

And this is the disk containing your VM's:

Disk /dev/disks/mpx.vmhba1:C0:T0:L0: 2006782768 sectors, 1913M

-- cpu2:32787)WARNING: ScsiDeviceIO: 1223: Device mpx.vmhba1:C0:T0:L0 performance has deteriorated. I/O latency increased from average value of 19335 microseconds to 584548 microseconds. --

This means that your disk has some serious IO issues, probably you are running something really disk IO intensive or too much VM's on this one disk. This could definitely freeze your ESXi server if this happens frequently.
0
Independent Software Vendors: We Want Your Opinion

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

 

Author Comment

by:AXISHK
ID: 39916851
Is there a hardware problem ? How can I isolate whether this is a VM IO issue or hardware IO problem ?

For the USB, does it mean the size of my VM host is 7.6MB ? so smaller...

For the time show in the log file, does it match exactly to my server (or local) time ?

Tks
0
 
LVL 25

Expert Comment

by:Zephyr ICT
ID: 39916863
You can analyze disk IO with this https://labs.vmware.com/flings/io-analyzer 

As well as take a look at your performance charts of the host with vsphere client.

Might need to add a few more spindles to get better performance of opt for SSD drives for the more intensive VMs maybe
0
 

Author Comment

by:AXISHK
ID: 39916895
Which Disk IO should I check ? I have selected Stack Graphic (Per VM) with read rate but it doesn't allow me to select few more measuring counters..

Tks
0
 
LVL 25

Expert Comment

by:Zephyr ICT
ID: 39916902
0
 

Author Comment

by:AXISHK
ID: 39916940
Can't find the counter name mentioned in the URL, for the counter measured in the article, does it correpsonding to the counter found under VMware host ?

KernelLatency      -> Kernel command latency
DeviceLatency       -> Physical device write latency
                                        Physical device read latency
queueLatency      -> queue command latency
0
 
LVL 25

Accepted Solution

by:
Zephyr ICT earned 500 total points
ID: 39916962
Yes, those are the "Internal Names" of the Counters, they correspond... You can also check Write latency and Write requests and read rate/requests ...
0
 

Author Closing Comment

by:AXISHK
ID: 39942486
Tks
0

Featured Post

Free Tool: Port Scanner

Check which ports are open to the outside world. Helps make sure that your firewall rules are working as intended.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In this article, I will show you HOW TO: Suppress Configuration Issues and Warnings Alert displayed in Summary status for ESXi 6.5 after enabling SSH or ESXi Shell.
Giving access to ESXi shell console is always an issue for IT departments to other Teams, or Projects. We need to find a way so that teams can use ESXTOP for their POCs, or tests without giving them the access to ESXi host shell console with a root …
Teach the user how to install and configure the vCenter Orchestrator virtual appliance Open vSphere Web Client: Deploy vCenter Orchestrator virtual appliance OVA file: Verify vCenter Orchestrator virtual appliance boots successfully: Connect to the …
Teach the user how to use vSphere Update Manager to update the VMware Tools and virtual machine hardware version Open vSphere Client: Review manual processes for updating VMware Tools and virtual hardware versions: Create a new baseline group in vSp…

749 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question