Link to home
Create AccountLog in
Avatar of wlacroix
wlacroix

asked on

VMware growth

Current Enviroment:
3x VM ESXi hosts 38 gigs ram each, raid 0 (esxi runs here)
4x 2 port nics (2 for data(2 networks) 2 for iscsi)) per host

CURRENT STORAGE:
IBM DS3300
12x 1TB sata disks Raid 10 configuration
Split into 5 LUNs
all hosts have access to all luns

Running 12 vms currently (with some performance issues)
App server 2008 R2 x64
App server 2003 x32
Web server 2008 R2 x64
Linux ubuntu x64
network monitor server 2003 x32
DHCP\RDP linux server x64
DC\Phone monitor server (with DB) 2003 x32
2x 2003 terminal servers (30 users each) x32 (cant go 64)
DC 2008 R2 x64
Web server 2008 x32

We will be adding another 12+ VMs
3x sql servers
2x more mail servers (minor mail, may add the domains to current)
3x terminal servers
1x file server
2x+ domain controllers

Will be adding 2 more VM host servers 38 gigs ram, perhaps 3 we have the hardware.

PROPOSED Storage Changes:
IBM DS3524 with expansion
48x 600 gig sas disks
4x 10 disk raid 10s
1x 6 disk raid 5 (storage of ISOs)
2 disks for Global HotSwap\HotSwap SPARE

All of my reading tells me to build raid specific disks for VMs which becomes complicated, the rest of my team is not raid \ vm oriented and I am the only one that understands it for the most part. I am looking to put in a simple solution so the other team members can deal with building new vms etc and be able to place them without my intervention.

Now, with this in mind, i realize there may be some performance hits due to configuration
my current raid 10 has them, I think I am spindle bound at this point.

Thoughts and opinions
Avatar of Roshan Mohammed
Roshan Mohammed
Flag of New Zealand image

what sort of performance issues are you encountering;

"Running 12 vms currently (with some performance issues)
App server 2008 R2 x64
App server 2003 x32
Web server 2008 R2 x64
Linux ubuntu x64
network monitor server 2003 x32
DHCP\RDP linux server x64
DC\Phone monitor server (with DB) 2003 x32
2x 2003 terminal servers (30 users each) x32 (cant go 64)
DC 2008 R2 x64
Web server 2008 x32"
Avatar of wlacroix
wlacroix

ASKER

We are currently seeing latency issues, Avg from solar winds san monitor shows LUNs around 200-3500 MS.

200-500 is livable, 3000 bad stuff is happening.

Veeam VMware free monitor shows each LUN, avg all LUNs show avg 30 on read, and 95 on write.
So in both situations its obvious im having a write issue on a Raid 10. (we suspect that lots of small files is killing storage system, email and terminal servers)

I am hesitant to add more VMs at this point.
ASKER CERTIFIED SOLUTION
Avatar of kevinhsieh
kevinhsieh
Flag of United States of America image

Link to home
membership
Create an account to see this answer
Signing up is free. No credit card required.
Create Account
My suggestion would be to carve out 500 GB LUNs for VMs that do not require a higher virtual disk (such as Web Servers, Domain Controllers, etc) and segregate any write intensive VMs to separate LUNs.

I can see that you are planning to upgrade to SAS drives which can improve performance pertaining to storage.
Kevinhsieh,

You are correct, we should be able to do better. Under your sugestion I took a good hard look at the storage system this AM, and there is currently a Battary issue that no one told me about. Going to have to put some other checks and ballances in place.

Its on my second controller, but still needs to be fixed.

Are there any tools that I can use to watch the cache writes? etc? Im using veeam stuff now...just fired it up last night, will check it this am.
But I dont think it gets that indept to the storage.
I got out some drafting paper and am currently plotting\marking and writing down the whole configuration, will go through it one step at a time and make tweeks where I can. See if i can get some oomph out of this thing.
Glad that I was able to point you to the issue. I think that performance will be fine once write caching is turned back on. You can probably even turn it on with a bad battery, but you risk data loss/corruption is you lose power.
I have about 3 hours of power, but they did not UPS\generator my airconditioner....they make me crazy...

I could turn it on, Ordered the parts up, they should be here tommorow or the next day.
Kindly keep us posted on how things progress. Good luck.
What about jumbo frames, I am not using them now, but im also not even close to touching the performance of this setup. Is it worth it to setup and enable?
I don't know. I don't have them turned on either. I should try it out in my DR site first.
There is only a tiny orange light on the front of the DS3300 to tell you there is a problem. Who goes into the configuration software every day? sheesh....
Veeam VMware monitor free also helped me.