Solved

ESXI 4.1 Host draws HIGH CPU at Idle

Posted on 2011-09-16
18
1,113 Views
Last Modified: 2012-05-12
Hello Expert Friends,
I manage a single ESXI host for a client and lately, (but maybe I did not notice it before) it is showing 50% CPU in the VI client when the system is totally idling. It is a IBM-Lenovo RD120 (M6447-18U) server running 12 VM's as Virtual Desktops. When a user logs in, performance is very poor and simply opening a browser window usually pegs CPU for a 30 seconds or more. Given is shows 50% usage totally idling (and all the VM's show nearly 0 CPU usage) makes me think there is a serious issue. Why would the CPU be so high when it is not taken by the VM's? All health parameters in the VI client logs are good.

THanks!
-John
0
Comment
Question by:JohnnyD74
  • 10
  • 8
18 Comments
 
LVL 119
ID: 36552863
what you do not state is the amount of memory in the host, memory assigned to 12VMs, high cpu usage is normal with a user login to desktop, if the datastore is slow or host is suffering memory starvation, and its paging swapping to disk.
0
 
LVL 119
ID: 36552866
have you tried Veeam Monitor for free to start checking all the performance metrics for the host and VMs, do VMs for instance use roaming profiles and or virus scanning.
0
 

Author Comment

by:JohnnyD74
ID: 36552883
Hi Hanccoka,

I am running 20GB of memory on the host and 15K SAS RAID 5 array. The Key is that i am seeing 50% host CPU useage at IDLE with ABSOLUTELY 0 ACTIVITY ON TH VM'S. The VM's even show 0 CPU Useage....yet still the 50% Useage. I have a moderate about of experience with VMware and ESX and this is quite abnormal.

Thanks.
0
Efficient way to get backups off site to Azure

This user guide provides instructions on how to deploy and configure both a StoneFly Scale Out NAS Enterprise Cloud Drive virtual machine and Veeam Cloud Connect in the Microsoft Azure Cloud.

 

Author Comment

by:JohnnyD74
ID: 36552888
Oh...and 2GB of memory are assigned to each winXP VM.
0
 
LVL 119
ID: 36552890
So if ALL the VMs are OFF, you have 50% CPU?

Memory in the VMs, OS in the VMs?
0
 
LVL 119
ID: 36552895
RAID 5 datastore is poor choice of RAID for Desktop VMs.
0
 
LVL 119
ID: 36552898
So 24GB memory assigned to VMs, on a 20GB host, so its over committed, by 4GB.
0
 

Author Comment

by:JohnnyD74
ID: 36552902
Yes...I know, but that is what I have and not related to my CPU delema.
0
 

Author Comment

by:JohnnyD74
ID: 36552905
Yes...correct on the memory numbers.
0
 

Author Comment

by:JohnnyD74
ID: 36552914
No....I believe if they are off, the CPU goes down but the VI client shows near 0 useage for all VM's at Idle.
0
 
LVL 119
ID: 36552918
So, when powering up the VMs, one by one, when does 50% CPU occur?
0
 
LVL 119
ID: 36552922
I would suggest using Veeam Monitor for free to analyse the metrics.
0
 
LVL 119
ID: 36552941
also you state in the opening question, that you did not notice, what do the performance charts state for the year? has this always been the case, or has it just started occuring.
0
 

Author Comment

by:JohnnyD74
ID: 36553010
When powering up the VM's Host CPU is at 100%....the 50% at Idle seems to illustrate the Issue and weakness of the CPU...and I don't believe it has always done this..
0
 
LVL 119
ID: 36554004
Performance Chart History?
0
 
LVL 119

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 500 total points
ID: 36554013
At Power-UP you are likely to hit 100% for a while, because of the over subscribbed RAM situation, because at power-up, ALL VMs will require 24GB for a moment of time, at this time the host will start using the paging file on the disk system, this action of disk swapping will cause high CPU for a while.

Veeam Monitor for free

If you want a quick tool, to help you with wanting to know all the individual elements, then I would suggest using Veeam Monitor Free Edition

Veeam Monitor leverages Veeam Business View™ to enable performance monitoring, alerting and reporting for virtual machine groups based on criteria such as business unit, department, location, purpose, service-level agreement or any other criteria you define. This ability to perform business-centric monitoring helps to identify the business impact of a virtual infrastructure’s performance and respond accordingly. It also allows you to configure flexible alerts based on known server type characteristics and the potential business impact of an outage for more granular service-level management. You can also create targeted reports showing only the data relevant to specific business units, departments or types of server.
More features

Source
http://www.veeam.com/esxi-monitoring-free.html.


If you want to get down and dirty with the servers, then I would recommend the following documents


Performance Monitoring and Analysis


Guest-based performance monitoring is an inaccurate and unhelpful means of evaluating performance in virtual deployments.  See Guest-based Performance Measurement for more inforamtion.  Monitoring and analysis of VMware ESX Server should be performed with esxtop and VirtualCenter.

esxtop is the tried-and-true means of collecting every performance stat  needed and making it available in a way that is conducive to analysis.  The best source of information on launching esxtop can be found in the Resource Management Guide (page 159).

1. Check and correct CPU utilization: CPU Performance Analysis and Monitoring

2. Identify memory bottlenecks and remove: Memory Performance Analysis and Monitoring

3. Characterize storage performance and correct: Storage Performance Analysis and Monitoring

4. Understand and improve the network utilization profile: Network Performance Analysis and Monitoring

Within each of these articles are techniques for using counters from  VirtualCenter and esxtop.  Information on those counters is provided in

vCenter Performance Counters
esxtop Performance Counters

Also, note that, while useless in collecting performance data, Perfmon  can help with analysis of large esxtop output files.  

Using Perfmon for esxtop-based Performance Analysis

The vSphere Client can indicate that VM network traffic is causing a 1 GB Ethernet adapter to have a 99% utilization rate. But strangely, it doesn't display which kind of traffic is going across the virtual networks, where it came from or where it's going.

To learn which traffic is going across a virtual network, there's another free tool for vSphere: Xangati for ESX, a virtual appliance that tracks conversations on the virtual network. It's great for troubleshooting any virtual network issue, analyzing virtual desktop infrastructure and correlating vCenter performance stats with virtual network stats.

http://xangati.com/try-it-free/ (free)
0
 

Author Comment

by:JohnnyD74
ID: 36557617
Hi Hanccoka,

Sorry for my delay. I was out for awhile.THANK YOU for all the details. I understand the impact on startup but the the host CPU will hang at 50% utilization for HOURS ON END AND COSTANTLY with NO load at all. The office is closed on weekends and I have checked the CPU utilization on the weekends and it still is at 50%. I will check your suggestions and get back with you. Thanks Again!
0
 

Author Closing Comment

by:JohnnyD74
ID: 36574092
Thanks for all your help Hanccocka! I am still having the issue but with all your suggestions here, I am sure I will get to the bottom of things.
0

Featured Post

Microsoft Certification Exam 74-409

Veeam® is happy to provide the Microsoft community with a study guide prepared by MVP and MCT, Orin Thomas. This guide will take you through each of the exam objectives, helping you to prepare for and pass the examination.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

You may have a outside contractor who comes in once a week or seasonal to do some work in your office but you only want to give him access to the programs and files he needs and keep privet all other documents and programs, can you do this on a loca…
Scenario: Your operations manager has discovered an anomaly in your security system. The business will start to suffer within 15 minutes if it is a major IT incident. What should she do? We have 6 recommendations for managing major incidents (https:…
Teach the user how to convert virtaul disk file formats and how to rename virtual machine files on datastores. Open vSphere Web Client: Review VM disk settings: Migrate VM to new datastore with a thick provisioned (lazy zeroed) disk format: Rename a…
This video shows you how to use a vSphere client to connect to your ESX host as the root user. Demonstrates the basic connection of bypassing certification set up. Demonstrates how to access the traditional view to begin managing your virtual mac…

821 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question