Solved

disk performance issues

Posted on 2010-08-30
4
1,164 Views
Last Modified: 2012-05-10
Hardware:

IBM 3650 M3
RAID 10 using m5015 with BBU (Write Cache Enabled)
-all drives are used in the RAID 10 Array
16 x 146gb 10k rpm sas drives
stripe size 1mb
12gb ram
dual qc xeon


Function:  VMWARE esxi 4.x Server, running 3-4 vm.  

There will be an oracle db server, and app server, and windows server 2003


Problem:  Disk Performance. Currently when copying a 3gb USR folder on the same disk & vm it takes over 3 minutes to copy.

I was thinking part of the problem is the disk stripe size i chose in the RAID setup?  Is there a recommendation of a stripe size for this config above?  The server is not in production yet, waiting to solve the disk performance issue.

0
Comment
Question by:freycom
  • 2
4 Comments
 
LVL 47

Expert Comment

by:dlethe
ID: 33558386
VMWare segments I/Os to 64KB in each VM.  So you want to make sure that each VM is configured for 64KB NTFS I/O size.  Anything else is less efficient.  Also, in general your I/O is going to be random as far as VMWare is concerned.  

You would be better off redoing the storage, and taking 2x146GB drives, and making a RAID1 out of it, and then nailing it to a specific machine so it has direct access to it.  Then put your most I/O intensive stuff there.  Yes, it somewhat defeats the purpose of VMWare, but if you make it the D or E drive instead of the C drive, then you will still have easy migrations and such.

Also if your partitions were never set up as aligned on 64KB, then you need to do that.  
0
 
LVL 8

Expert Comment

by:markzz
ID: 33559547
There is always much discussion about these sorts of issues.
Optimising your disk performance is often a complex process.
As mentioned raid 1 mirror is generally going to yeild the best read/write performance but this is only the case when talking overhead partity which you will experience with any raid 5 or 6 configuration.
There is also the issue of a single spindles I/O limits. Depending on the type of SAS disks you have purchased (single or duel chanel, 3Gb or 6Gb) will dictate the actual spindle limitations and of course how many SAS chanels are driveing the disks.
I'd hazard a guess that your raid10 would be fine.
A strip of 64K is optimum but asny multiple of 64K should be also be acceptible although 1MB is rather large.
More importantly you also need to align the starting sector and format to a cluster size which is matched to your application/average file write size.
For alignment try vOptimiser.
For format review the  Oracle write size. it will be divisable size of 64K I suspect. SQL has a standard of 4K.
I recently optimised a standalone server which was suffering periodic i/O issues. The average I/O load reduced by about 25%.
We at work have over the past few months spent approx 100 hours realigning guest sessions. Do it right from the start.
A tip, of you use the standalone importer is missalignes the disks..
0
 

Author Comment

by:freycom
ID: 33559616
They are 6gb and i was mistaken, I had 128 kb stripe, and the write cache was disabled.  I enabled write cache.

Performance is better.  Do have recommendation on how to test Disk speed in Red hat ES?


Should i still drop the cache size?
0
 
LVL 8

Accepted Solution

by:
markzz earned 500 total points
ID: 33560764
Start sector (or offset) is now your most important issue to address.
anything that's a multiple of 4K is ok but 64K is the standard most work to.

When you say the cache size do you mean the memory cache on the controller?
If so I'd say test a 50% split but more than likely a 75% dedicated to write and 25% to read would be my suggestion.
Also you mentioned it was taking 3 minutes to write a 3GB file.
Considering your writing to local disk not a SAN that's not too bad. The best I'd expect you to get would be 1.5 to 2GB per minute..if writing random files. If streaming large files you should get better..
Remember it's still only local disk in a server not a SAN.
0

Featured Post

Free Tool: Path Explorer

An intuitive utility to help find the CSS path to UI elements on a webpage. These paths are used frequently in a variety of front-end development and QA automation tasks.

One of a set of tools we're offering as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
DCIM Folder not showing on iPhone 5S 12 84
Hit router interface limit 7 41
Testing physical servers with diagnostic software 10 54
Raid 1 Rebuilding sync fail 3 33
In this article, I will show you HOW TO: Perform a Physical to Virtual (P2V) Conversion the easy way from a computer backup (image).
This article aims to explain the working of CircularLogArchiver. This tool was designed to solve the buildup of log file in cases where systems do not support circular logging or where circular logging is not enabled
Teach the user how to edit .vmx files to add advanced configuration options Open vSphere Web Client: Edit Settings for a VM: Choose VM Options -> Advanced: Add Configuration Parameters:
Teach the user how to use create log bundles for vCenter Server or ESXi hosts Open vSphere Web Client: Generate vCenter Server and ESXi host log bundle:  Open vCenter Server Appliance Web Management interface and generate log bundle: Open vCenter Se…

830 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question