Solved

ESXI 4.1 Host draws HIGH CPU at Idle

Posted on 2011-09-16
18
1,100 Views
Last Modified: 2012-05-12
Hello Expert Friends,
I manage a single ESXI host for a client and lately, (but maybe I did not notice it before) it is showing 50% CPU in the VI client when the system is totally idling. It is a IBM-Lenovo RD120 (M6447-18U) server running 12 VM's as Virtual Desktops. When a user logs in, performance is very poor and simply opening a browser window usually pegs CPU for a 30 seconds or more. Given is shows 50% usage totally idling (and all the VM's show nearly 0 CPU usage) makes me think there is a serious issue. Why would the CPU be so high when it is not taken by the VM's? All health parameters in the VI client logs are good.

THanks!
-John
0
Comment
Question by:JohnnyD74
  • 10
  • 8
18 Comments
 
LVL 118
ID: 36552863
what you do not state is the amount of memory in the host, memory assigned to 12VMs, high cpu usage is normal with a user login to desktop, if the datastore is slow or host is suffering memory starvation, and its paging swapping to disk.
0
 
LVL 118
ID: 36552866
have you tried Veeam Monitor for free to start checking all the performance metrics for the host and VMs, do VMs for instance use roaming profiles and or virus scanning.
0
 

Author Comment

by:JohnnyD74
ID: 36552883
Hi Hanccoka,

I am running 20GB of memory on the host and 15K SAS RAID 5 array. The Key is that i am seeing 50% host CPU useage at IDLE with ABSOLUTELY 0 ACTIVITY ON TH VM'S. The VM's even show 0 CPU Useage....yet still the 50% Useage. I have a moderate about of experience with VMware and ESX and this is quite abnormal.

Thanks.
0
 

Author Comment

by:JohnnyD74
ID: 36552888
Oh...and 2GB of memory are assigned to each winXP VM.
0
 
LVL 118
ID: 36552890
So if ALL the VMs are OFF, you have 50% CPU?

Memory in the VMs, OS in the VMs?
0
 
LVL 118
ID: 36552895
RAID 5 datastore is poor choice of RAID for Desktop VMs.
0
 
LVL 118
ID: 36552898
So 24GB memory assigned to VMs, on a 20GB host, so its over committed, by 4GB.
0
 

Author Comment

by:JohnnyD74
ID: 36552902
Yes...I know, but that is what I have and not related to my CPU delema.
0
 

Author Comment

by:JohnnyD74
ID: 36552905
Yes...correct on the memory numbers.
0
Free Gift Card with Acronis Backup Purchase!

Backup any data in any location: local and remote systems, physical and virtual servers, private and public clouds, Macs and PCs, tablets and mobile devices, & more! For limited time only, buy any Acronis backup products and get a FREE Amazon/Best Buy gift card worth up to $200!

 

Author Comment

by:JohnnyD74
ID: 36552914
No....I believe if they are off, the CPU goes down but the VI client shows near 0 useage for all VM's at Idle.
0
 
LVL 118
ID: 36552918
So, when powering up the VMs, one by one, when does 50% CPU occur?
0
 
LVL 118
ID: 36552922
I would suggest using Veeam Monitor for free to analyse the metrics.
0
 
LVL 118
ID: 36552941
also you state in the opening question, that you did not notice, what do the performance charts state for the year? has this always been the case, or has it just started occuring.
0
 

Author Comment

by:JohnnyD74
ID: 36553010
When powering up the VM's Host CPU is at 100%....the 50% at Idle seems to illustrate the Issue and weakness of the CPU...and I don't believe it has always done this..
0
 
LVL 118
ID: 36554004
Performance Chart History?
0
 
LVL 118

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE) earned 500 total points
ID: 36554013
At Power-UP you are likely to hit 100% for a while, because of the over subscribbed RAM situation, because at power-up, ALL VMs will require 24GB for a moment of time, at this time the host will start using the paging file on the disk system, this action of disk swapping will cause high CPU for a while.

Veeam Monitor for free

If you want a quick tool, to help you with wanting to know all the individual elements, then I would suggest using Veeam Monitor Free Edition

Veeam Monitor leverages Veeam Business View™ to enable performance monitoring, alerting and reporting for virtual machine groups based on criteria such as business unit, department, location, purpose, service-level agreement or any other criteria you define. This ability to perform business-centric monitoring helps to identify the business impact of a virtual infrastructure’s performance and respond accordingly. It also allows you to configure flexible alerts based on known server type characteristics and the potential business impact of an outage for more granular service-level management. You can also create targeted reports showing only the data relevant to specific business units, departments or types of server.
More features

Source
http://www.veeam.com/esxi-monitoring-free.html.


If you want to get down and dirty with the servers, then I would recommend the following documents


Performance Monitoring and Analysis


Guest-based performance monitoring is an inaccurate and unhelpful means of evaluating performance in virtual deployments.  See Guest-based Performance Measurement for more inforamtion.  Monitoring and analysis of VMware ESX Server should be performed with esxtop and VirtualCenter.

esxtop is the tried-and-true means of collecting every performance stat  needed and making it available in a way that is conducive to analysis.  The best source of information on launching esxtop can be found in the Resource Management Guide (page 159).

1. Check and correct CPU utilization: CPU Performance Analysis and Monitoring

2. Identify memory bottlenecks and remove: Memory Performance Analysis and Monitoring

3. Characterize storage performance and correct: Storage Performance Analysis and Monitoring

4. Understand and improve the network utilization profile: Network Performance Analysis and Monitoring

Within each of these articles are techniques for using counters from  VirtualCenter and esxtop.  Information on those counters is provided in

vCenter Performance Counters
esxtop Performance Counters

Also, note that, while useless in collecting performance data, Perfmon  can help with analysis of large esxtop output files.  

Using Perfmon for esxtop-based Performance Analysis

The vSphere Client can indicate that VM network traffic is causing a 1 GB Ethernet adapter to have a 99% utilization rate. But strangely, it doesn't display which kind of traffic is going across the virtual networks, where it came from or where it's going.

To learn which traffic is going across a virtual network, there's another free tool for vSphere: Xangati for ESX, a virtual appliance that tracks conversations on the virtual network. It's great for troubleshooting any virtual network issue, analyzing virtual desktop infrastructure and correlating vCenter performance stats with virtual network stats.

http://xangati.com/try-it-free/ (free)
0
 

Author Comment

by:JohnnyD74
ID: 36557617
Hi Hanccoka,

Sorry for my delay. I was out for awhile.THANK YOU for all the details. I understand the impact on startup but the the host CPU will hang at 50% utilization for HOURS ON END AND COSTANTLY with NO load at all. The office is closed on weekends and I have checked the CPU utilization on the weekends and it still is at 50%. I will check your suggestions and get back with you. Thanks Again!
0
 

Author Closing Comment

by:JohnnyD74
ID: 36574092
Thanks for all your help Hanccocka! I am still having the issue but with all your suggestions here, I am sure I will get to the bottom of things.
0

Featured Post

VMware Disaster Recovery and Data Protection

In this expert guide, you’ll learn about the components of a Modern Data Center. You will use cases for the value-added capabilities of Veeam®, including combining backup and replication for VMware disaster recovery and using replication for data center migration.

Join & Write a Comment

David Varnum recently wrote up his impressions of PRTG, based on a presentation by my colleague Christian at Tech Field Day at VMworld in Barcelona. Thanks David, for your detailed and honest evaluation!
HOW TO: Install and Configure VMware vSphere Hypervisor 6.5 (ESXi 6.5), Step by Step Tutorial with screenshots. From Download, Checking Media, to Completed Installation.
Teach the user how to install ESXi 5.5 and configure the management network System Requirements: ESXi Installation:  Management Network Configuration: Management Network Testing:
Teach the user how to use configure the vCenter Server storage filters Open vSphere Web Client:  Navigate to vCenter Server Advanced Settings: Add the four vCenter Server storage filters: Review the advanced settings: Modify the values of the four v…

744 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now