Solved

Logging on VMware 5.5

Posted on 2014-03-09
10
1,314 Views
Last Modified: 2014-03-20
I have a VMware ESXi 5.5 that hangs up twice within last two days. Is there any log on VMware that I can check.

I have check the log /var/log/syslog.log but I can't find anything strange.

Tks
0
Comment
Question by:AXISHK
  • 5
  • 5
10 Comments
 
LVL 25

Expert Comment

by:Zephyr ICT
ID: 39916788
These logs are of interest as well:

/var/log/hostd.log
/var/log/vmkernel.log

where "/var/log/vmkwarning.log" is a summary of the Warning and Alerts taken from the VMkernel log...

Could be a hardware issue ... But yeah, the logs should shed more light on it, hopefully.
0
 

Author Comment

by:AXISHK
ID: 39916821
See this couple of time in the vmkwarning.log. For the time "2014-03-08T18:04:38.291Z", what time zone does it log ?  I have two disk, usb installed with vmware OS. A a single RAID5 disk holding the database. Does my problem relate to disk issue ?

fidsk show two disk, what are they ?

Disk /dev/disks/mpx.vmhba32:C0:T0:L0: 7856127 sectors, 7671K
Disk /dev/disks/mpx.vmhba1:C0:T0:L0: 2006782768 sectors, 1913M


 cpu2:32787)WARNING: ScsiDeviceIO: 1223: Device mpx.vmhba1:C0:T0:L0 performance has deteriorated. I/O latency increased from average value of 19335 microseconds to 584548 microseconds.
vmkernel.log
0
 
LVL 25

Expert Comment

by:Zephyr ICT
ID: 39916836
I'm assuming this is your USB containing ESXi:

Disk /dev/disks/mpx.vmhba32:C0:T0:L0: 7856127 sectors, 7671K

And this is the disk containing your VM's:

Disk /dev/disks/mpx.vmhba1:C0:T0:L0: 2006782768 sectors, 1913M

-- cpu2:32787)WARNING: ScsiDeviceIO: 1223: Device mpx.vmhba1:C0:T0:L0 performance has deteriorated. I/O latency increased from average value of 19335 microseconds to 584548 microseconds. --

This means that your disk has some serious IO issues, probably you are running something really disk IO intensive or too much VM's on this one disk. This could definitely freeze your ESXi server if this happens frequently.
0
Simplifying Server Workload Migrations

This use case outlines the migration challenges that organizations face and how the Acronis AnyData Engine supports physical-to-physical (P2P), physical-to-virtual (P2V), virtual to physical (V2P), and cross-virtual (V2V) migration scenarios to address these challenges.

 

Author Comment

by:AXISHK
ID: 39916851
Is there a hardware problem ? How can I isolate whether this is a VM IO issue or hardware IO problem ?

For the USB, does it mean the size of my VM host is 7.6MB ? so smaller...

For the time show in the log file, does it match exactly to my server (or local) time ?

Tks
0
 
LVL 25

Expert Comment

by:Zephyr ICT
ID: 39916863
You can analyze disk IO with this https://labs.vmware.com/flings/io-analyzer 

As well as take a look at your performance charts of the host with vsphere client.

Might need to add a few more spindles to get better performance of opt for SSD drives for the more intensive VMs maybe
0
 

Author Comment

by:AXISHK
ID: 39916895
Which Disk IO should I check ? I have selected Stack Graphic (Per VM) with read rate but it doesn't allow me to select few more measuring counters..

Tks
0
 
LVL 25

Expert Comment

by:Zephyr ICT
ID: 39916902
0
 

Author Comment

by:AXISHK
ID: 39916940
Can't find the counter name mentioned in the URL, for the counter measured in the article, does it correpsonding to the counter found under VMware host ?

KernelLatency      -> Kernel command latency
DeviceLatency       -> Physical device write latency
                                        Physical device read latency
queueLatency      -> queue command latency
0
 
LVL 25

Accepted Solution

by:
Zephyr ICT earned 500 total points
ID: 39916962
Yes, those are the "Internal Names" of the Counters, they correspond... You can also check Write latency and Write requests and read rate/requests ...
0
 

Author Closing Comment

by:AXISHK
ID: 39942486
Tks
0

Featured Post

PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

In this step by step tutorial with screenshots, we will show you HOW TO: Enable SSH Remote Access on a VMware vSphere Hypervisor 6.5 (ESXi 6.5). This is important if you need to enable SSH remote access for additional troubleshooting of the ESXi hos…
In this article we will learn how to backup a VMware farm using Nakivo Backup & Replication. In this tutorial we will install the software on a Windows 2012 R2 Server.
Teach the user how to rename, unmount, delete and upgrade VMFS datastores. Open vSphere Web Client: Rename VMFS and NFS datastores: Upgrade VMFS-3 volume to VMFS-5: Unmount VMFS datastore: Delete a VMFS datastore:
Teach the user how to use vSphere Update Manager to update the VMware Tools and virtual machine hardware version Open vSphere Client: Review manual processes for updating VMware Tools and virtual hardware versions: Create a new baseline group in vSp…

792 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question