Link to home
Start Free TrialLog in
Avatar of wahlster
wahlsterFlag for United States of America

asked on

VMware - Monitor Disk Activity of VMs?

Perhaps a silly question but is there a way to monitor disk activity of all my VM's?  I'm interested in finding out if a VM is writing excessively to it's disk.  Our VM's hard disk are located on a NetApp filer.  We mirror the NetApp volumes out of state to our disastor recovery site.  We are seeing large volumes of data getting mirrored occasionally to the disaster site.  A theory is that a VM may be writing large quantities of data to it's disk resulting in the large amounts of data getting mirrored.

We are running ESX 4.1.  Can I monitor using Virtual Center?  Is there a script that I can use?

Thanks in advance for your help,
Terry
SOLUTION
Avatar of Paul Solovyovsky
Paul Solovyovsky
Flag of United States of America image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Above I meant if using NFS to check total volume size..not CIFS..
are you using vCenter server?  If so, you can review the various charts and measurements from the past to see what's been happening.  

Once you find the data you need, then you can see if there are appropriate alarms for them on the alarms tab (you can view/set the alarms at the vm/host/cluster/datacenter/VC levels, but only edit the default ones at the DC and VC levels).  On the alarms tab there are buttons in the upper left corner, click on the definitions to see what ones are in place and right-click in the white space to add a new one and you can see the different ones that are available.
ASKER CERTIFIED SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
What VMware guy said. You can also get live stats out of vSphere client, but it seems to somewhat hammer the vCenter server.
Another way to get live raw numbers is to run esxtop on the service console of the ESX server, see http://kb.vmware.com/selfservice/microsites/search.do?cmd=displayKC&docType=kc&externalId=1008205 which is entitled "using esxtop to identify storage performance issues".
Avatar of wahlster

ASKER

Thanks for your replies.  We are using Virtual Center.  As far as using deduplication on the Netapp I'm not sure but we are not compressing the snapshots.  LUNS are getting mirrored not replicated to our disaster site.  I looked at the Disk charts as suggested by VMwareGuy but nothing stands out.  We are going to give NetApp support a call to see if they can find something.
Connect to the filer using netapp system manager. If you don't have it download from the now site. Check the volumes since lins can be setup for dedupe and thin provision. By replication I meant snapmirror
Look at Disk \ write requests.. that should stand out.  It is recorded in a basic summation, which is confusing, because you have to look at the sample period, which is 20 seconds by default.   you can also look at the write rate peaks, recorded in Kbps.  the peak will incidate the the max KBps writes taking place.  you can compare these #s to other VMs on the same storage to see if it is indeed what is causing the excessive data writes.
Avatar of berkcomjonathan
berkcomjonathan

If you have each VM's disk in a separate volume, from the filer you can do:

stats show -i 5 volume

That will give you a 5 second idea of volume statistics.  Then look for volumes that have high write_data (b/s). You can increase or decrease the interval (-i) to fit your needs.  I had a situation pretty similar to this.  I cloned a VM and failed to increase the memory on the clone.  It was swapping like a mofo, which meant heavy NFS writes to it's volume.
Sorry about the delay.  Issue was a result of disk write as a result of an upgrade of Symantec's Enterprise Vault.  
Thanks for your help!
Terry
I did not want to accept my answer as a solution.  
Unselect my post as an answer.
If you're running EV that makes sense and also depends whether you write to a server that uses the Netapp or directly to the Netapp (allowing it do the compression and dedupe).  Also ensure that you are archiving and before snapmirror takes place as well as enable compression on the snapmirror.

Since EV archives and puts the data in as flat files your snapmirror shouldn't contain much more data then delta of your archive for the day unless you're ingesting your initial archive into the vault