Solved

Logging on VMware 5.5

Posted on 2014-03-09
10
1,288 Views
Last Modified: 2014-03-20
I have a VMware ESXi 5.5 that hangs up twice within last two days. Is there any log on VMware that I can check.

I have check the log /var/log/syslog.log but I can't find anything strange.

Tks
0
Comment
Question by:AXISHK
  • 5
  • 5
10 Comments
 
LVL 25

Expert Comment

by:Zephyr ICT
Comment Utility
These logs are of interest as well:

/var/log/hostd.log
/var/log/vmkernel.log

where "/var/log/vmkwarning.log" is a summary of the Warning and Alerts taken from the VMkernel log...

Could be a hardware issue ... But yeah, the logs should shed more light on it, hopefully.
0
 

Author Comment

by:AXISHK
Comment Utility
See this couple of time in the vmkwarning.log. For the time "2014-03-08T18:04:38.291Z", what time zone does it log ?  I have two disk, usb installed with vmware OS. A a single RAID5 disk holding the database. Does my problem relate to disk issue ?

fidsk show two disk, what are they ?

Disk /dev/disks/mpx.vmhba32:C0:T0:L0: 7856127 sectors, 7671K
Disk /dev/disks/mpx.vmhba1:C0:T0:L0: 2006782768 sectors, 1913M


 cpu2:32787)WARNING: ScsiDeviceIO: 1223: Device mpx.vmhba1:C0:T0:L0 performance has deteriorated. I/O latency increased from average value of 19335 microseconds to 584548 microseconds.
vmkernel.log
0
 
LVL 25

Expert Comment

by:Zephyr ICT
Comment Utility
I'm assuming this is your USB containing ESXi:

Disk /dev/disks/mpx.vmhba32:C0:T0:L0: 7856127 sectors, 7671K

And this is the disk containing your VM's:

Disk /dev/disks/mpx.vmhba1:C0:T0:L0: 2006782768 sectors, 1913M

-- cpu2:32787)WARNING: ScsiDeviceIO: 1223: Device mpx.vmhba1:C0:T0:L0 performance has deteriorated. I/O latency increased from average value of 19335 microseconds to 584548 microseconds. --

This means that your disk has some serious IO issues, probably you are running something really disk IO intensive or too much VM's on this one disk. This could definitely freeze your ESXi server if this happens frequently.
0
 

Author Comment

by:AXISHK
Comment Utility
Is there a hardware problem ? How can I isolate whether this is a VM IO issue or hardware IO problem ?

For the USB, does it mean the size of my VM host is 7.6MB ? so smaller...

For the time show in the log file, does it match exactly to my server (or local) time ?

Tks
0
 
LVL 25

Expert Comment

by:Zephyr ICT
Comment Utility
You can analyze disk IO with this https://labs.vmware.com/flings/io-analyzer

As well as take a look at your performance charts of the host with vsphere client.

Might need to add a few more spindles to get better performance of opt for SSD drives for the more intensive VMs maybe
0
What Security Threats Are You Missing?

Enhance your security with threat intelligence from the web. Get trending threat insights on hackers, exploits, and suspicious IP addresses delivered to your inbox with our free Cyber Daily.

 

Author Comment

by:AXISHK
Comment Utility
Which Disk IO should I check ? I have selected Stack Graphic (Per VM) with read rate but it doesn't allow me to select few more measuring counters..

Tks
0
 
LVL 25

Expert Comment

by:Zephyr ICT
Comment Utility
0
 

Author Comment

by:AXISHK
Comment Utility
Can't find the counter name mentioned in the URL, for the counter measured in the article, does it correpsonding to the counter found under VMware host ?

KernelLatency      -> Kernel command latency
DeviceLatency       -> Physical device write latency
                                        Physical device read latency
queueLatency      -> queue command latency
0
 
LVL 25

Accepted Solution

by:
Zephyr ICT earned 500 total points
Comment Utility
Yes, those are the "Internal Names" of the Counters, they correspond... You can also check Write latency and Write requests and read rate/requests ...
0
 

Author Closing Comment

by:AXISHK
Comment Utility
Tks
0

Featured Post

Backup Your Microsoft Windows Server®

Backup all your Microsoft Windows Server – on-premises, in remote locations, in private and hybrid clouds. Your entire Windows Server will be backed up in one easy step with patented, block-level disk imaging. We achieve RTOs (recovery time objectives) as low as 15 seconds.

Join & Write a Comment

Exchange server is not supported in any cloud-hosted platform (other than Azure with Azure Premium Storage).
HOW TO: Install and Configure VMware vSphere Hypervisor 6.5 (ESXi 6.5), Step by Step Tutorial with screenshots. From Download, Checking Media, to Completed Installation.
Teach the user how to configure vSphere Replication and how to protect and recover VMs Open vSphere Web Client: Verify vsphere Replication is enabled: Enable vSphere Replication for a virtual machine: Verify replicated VM is created: Recover replica…
Teach the user how to use create log bundles for vCenter Server or ESXi hosts Open vSphere Web Client: Generate vCenter Server and ESXi host log bundle:  Open vCenter Server Appliance Web Management interface and generate log bundle: Open vCenter Se…

771 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now