Very high CPU on virtual server (VMWare guest) - same application on physical server has no problem
We run a video recording/archiving application called Digital Sentry. Currently we have several physical Windows 2008 R2 servers each recording video from 30 to 60 cameras. There is not special hardware installed...data is pulled from cameras over TCP/IP and written to iSCSI volumes. Each physical server has 4 cores (2 dual-core sockets) and 8GB memory. CPU usage is usually very low (about 10%) and memory usage is also low.
But when we try running this application on a virtual server (VMWare ESX 5), even a small number of cameras (4) quickly pushes CPU above 50%. This makes no sense.
Any ideas?
But when we try running this application on a virtual server (VMWare ESX 5), even a small number of cameras (4) quickly pushes CPU above 50%. This makes no sense.
Any ideas?
what graphic memory is configured on physical and Virtual.
1. Check the VM has no Snapshot.
2. How many vCPUs have you added? More than 2?
3. What is the underlying datastore fabric? RAID 1, 10, 5
4. What are the hosts disks? SATA or SAS
5. How many disks?
6. Speed of disks?
2. How many vCPUs have you added? More than 2?
3. What is the underlying datastore fabric? RAID 1, 10, 5
4. What are the hosts disks? SATA or SAS
5. How many disks?
6. Speed of disks?
ASKER
No snapshot, 2 vCPUs, VMFS datastore on NFS volume on NetApp aggregate of 24 SAS (15Krpm) disks. The VM virtual hardsware version is 8. The network driver is VMXNET3 and the VM is using the paravirtual SCSI driver (so, of course, VM tools is installed).
We are NOT beginners at VMWare. We run about 150VMs on the same cluster. This is the only one that behaves like this.
We are NOT beginners at VMWare. We run about 150VMs on the same cluster. This is the only one that behaves like this.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Do you need further help with this question?
ASKER
I've requested that this question be deleted for the following reason:
None of the responses were helpful. I was looking for reasons why software running on a VM might use much more CPU than the same software running on physical hardware. General advice on tuning VMware or vague statements like "hypervisors perform poorly compared to physical" are no help.
None of the responses were helpful. I was looking for reasons why software running on a VM might use much more CPU than the same software running on physical hardware. General advice on tuning VMware or vague statements like "hypervisors perform poorly compared to physical" are no help.
If you host is not feeling any load then let the VM monitors show any amount of cpu load. Are you getting slow images transfer etc?
If you want exact help then you need to get someone in your office and BTW even beginners run 150 VMs. It is so easy!
If you want exact help then you need to get someone in your office and BTW even beginners run 150 VMs. It is so easy!
The CPU % in performance monitor is an unreliable measure on a virtual machine. The hypervisor only offers CPU if the guest asks for it, which means that CPU % looks high even when the hypervisor still has plenty of capacity.
I meant that last post as an objection....
We did answer why CPU usage will appear high in a VM. You have to go look at other metrics to determine if the CPU usage is actually greater, such as the performance tab for the VM.
We did answer why CPU usage will appear high in a VM. You have to go look at other metrics to determine if the CPU usage is actually greater, such as the performance tab for the VM.
ASKER
I've requested that this question be deleted for the following reason:
Bottom line is I got nothing usefull, so I don't want to award points.
Bottom line is I got nothing usefull, so I don't want to award points.
"Nothing useful?" That seems a little hyperbolic.
Perhaps the answer was not answered to your satisfaction, but we attempted to assist and you provided minimal feedback.
Perhaps the answer was not answered to your satisfaction, but we attempted to assist and you provided minimal feedback.
I asked you a question in http:#a39199703
Do you need further help with this question?
you did not respond, other than to delete the question!
Do you need further help with this question?
you did not respond, other than to delete the question!
ASKER
I've requested that this question be deleted for the following reason:
, I've decided this is not a good use of my time Nobody seems to have any experience of specify application behavior that leads to unreasonably high CPU usage on a virtual machine.
, I've decided this is not a good use of my time Nobody seems to have any experience of specify application behavior that leads to unreasonably high CPU usage on a virtual machine.
Question:
Answer:
Simply changing the text of your delete request does not make the delete request valid.
But when we try running this application on a virtual server (VMWare ESX 5), even a small number of cameras (4) quickly pushes CPU above 50%. This makes no sense.
Any ideas?
Answer:
The CPU % in performance monitor is an unreliable measure on a virtual machine. The hypervisor only offers CPU if the guest asks for it, which means that CPU % looks high even when the hypervisor still has plenty of capacity.
Simply changing the text of your delete request does not make the delete request valid.
My recommendation is to delete with no refund.
If that is not an option, then I would recommend splitting points among all participating experts.
If that is not an option, then I would recommend splitting points among all participating experts.
Are you using E1000 NICs or VMware paravirtualised ones?
iscsi is used on both physical and virtual servers?
VMware tools are installed?
How many VCPus are you using in the virtual machine?
Is your esx/esxi more powerful than the original server?