Solved

Logging on VMware 5.5

Posted on 2014-03-09
10
1,297 Views
Last Modified: 2014-03-20
I have a VMware ESXi 5.5 that hangs up twice within last two days. Is there any log on VMware that I can check.

I have check the log /var/log/syslog.log but I can't find anything strange.

Tks
0
Comment
Question by:AXISHK
  • 5
  • 5
10 Comments
 
LVL 25

Expert Comment

by:Zephyr ICT
ID: 39916788
These logs are of interest as well:

/var/log/hostd.log
/var/log/vmkernel.log

where "/var/log/vmkwarning.log" is a summary of the Warning and Alerts taken from the VMkernel log...

Could be a hardware issue ... But yeah, the logs should shed more light on it, hopefully.
0
 

Author Comment

by:AXISHK
ID: 39916821
See this couple of time in the vmkwarning.log. For the time "2014-03-08T18:04:38.291Z", what time zone does it log ?  I have two disk, usb installed with vmware OS. A a single RAID5 disk holding the database. Does my problem relate to disk issue ?

fidsk show two disk, what are they ?

Disk /dev/disks/mpx.vmhba32:C0:T0:L0: 7856127 sectors, 7671K
Disk /dev/disks/mpx.vmhba1:C0:T0:L0: 2006782768 sectors, 1913M


 cpu2:32787)WARNING: ScsiDeviceIO: 1223: Device mpx.vmhba1:C0:T0:L0 performance has deteriorated. I/O latency increased from average value of 19335 microseconds to 584548 microseconds.
vmkernel.log
0
 
LVL 25

Expert Comment

by:Zephyr ICT
ID: 39916836
I'm assuming this is your USB containing ESXi:

Disk /dev/disks/mpx.vmhba32:C0:T0:L0: 7856127 sectors, 7671K

And this is the disk containing your VM's:

Disk /dev/disks/mpx.vmhba1:C0:T0:L0: 2006782768 sectors, 1913M

-- cpu2:32787)WARNING: ScsiDeviceIO: 1223: Device mpx.vmhba1:C0:T0:L0 performance has deteriorated. I/O latency increased from average value of 19335 microseconds to 584548 microseconds. --

This means that your disk has some serious IO issues, probably you are running something really disk IO intensive or too much VM's on this one disk. This could definitely freeze your ESXi server if this happens frequently.
0
 

Author Comment

by:AXISHK
ID: 39916851
Is there a hardware problem ? How can I isolate whether this is a VM IO issue or hardware IO problem ?

For the USB, does it mean the size of my VM host is 7.6MB ? so smaller...

For the time show in the log file, does it match exactly to my server (or local) time ?

Tks
0
 
LVL 25

Expert Comment

by:Zephyr ICT
ID: 39916863
You can analyze disk IO with this https://labs.vmware.com/flings/io-analyzer 

As well as take a look at your performance charts of the host with vsphere client.

Might need to add a few more spindles to get better performance of opt for SSD drives for the more intensive VMs maybe
0
Netscaler Common Configuration How To guides

If you use NetScaler you will want to see these guides. The NetScaler How To Guides show administrators how to get NetScaler up and configured by providing instructions for common scenarios and some not so common ones.

 

Author Comment

by:AXISHK
ID: 39916895
Which Disk IO should I check ? I have selected Stack Graphic (Per VM) with read rate but it doesn't allow me to select few more measuring counters..

Tks
0
 
LVL 25

Expert Comment

by:Zephyr ICT
ID: 39916902
0
 

Author Comment

by:AXISHK
ID: 39916940
Can't find the counter name mentioned in the URL, for the counter measured in the article, does it correpsonding to the counter found under VMware host ?

KernelLatency      -> Kernel command latency
DeviceLatency       -> Physical device write latency
                                        Physical device read latency
queueLatency      -> queue command latency
0
 
LVL 25

Accepted Solution

by:
Zephyr ICT earned 500 total points
ID: 39916962
Yes, those are the "Internal Names" of the Counters, they correspond... You can also check Write latency and Write requests and read rate/requests ...
0
 

Author Closing Comment

by:AXISHK
ID: 39942486
Tks
0

Featured Post

Efficient way to get backups off site to Azure

This user guide provides instructions on how to deploy and configure both a StoneFly Scale Out NAS Enterprise Cloud Drive virtual machine and Veeam Cloud Connect in the Microsoft Azure Cloud.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article will show you how to create an ISO CD-ROM/DVD-ROM image (*.iso), and MD5 checksum signature, for use with VMware vSphere Hypervisor 6.5 (ESXi 6.5). It's a good idea to compare checksums, because many installations fail because of a corr…
HOW TO: Upload an ISO image to a VMware datastore for use with VMware vSphere Hypervisor 6.5 (ESXi 6.5) using the vSphere Host Client, and checking its MD5 checksum signature is correct.  It's a good idea to compare checksums, because many installat…
Teach the user how to rename, unmount, delete and upgrade VMFS datastores. Open vSphere Web Client: Rename VMFS and NFS datastores: Upgrade VMFS-3 volume to VMFS-5: Unmount VMFS datastore: Delete a VMFS datastore:
Teach the user how to configure vSphere clusters to support the VMware FT feature Open vSphere Web Client: Verify vSphere HA is enabled: Verify netowrking for vMotion and FT Logging is in place or create it: Turn On FT for a virtual machine: Verify …

911 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

23 Experts available now in Live!

Get 1:1 Help Now