?
Solved

Hard drive configuration for ESXi installation

Posted on 2010-08-24
12
Medium Priority
?
1,941 Views
Last Modified: 2013-11-11
I have a Dell PE R710 server with 8 x 300GB hard drives.  I am going to install ESXi onto the server and run several VM's.  How should I configure my hard drives?  I am hearing that RAID5 can really affect performance, so RAID1+0 is recommended.  I am also hearing you should have a seperate array for your OS, but wouldn't that be a huge waste of space.  I heard if you have all on the same array, then you are limited to 1MB block sizes with a 256GB max hard drive capacity, is that true?  Are they saying each VM will be limited to 256GB, or each hard drive partition within the VM's, or that you will only have 256GB of space to allocate to all of your VM's?  Please help!

Thanks.

Mark
0
Comment
Question by:cansib
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 4
  • 4
  • 3
  • +1
12 Comments
 
LVL 37

Expert Comment

by:Neil Russell
ID: 33512109
Go with Raid 1+0.
See discussion here about limits
http://communities.vmware.com/message/1001312 
0
 
LVL 40

Expert Comment

by:coolsport00
ID: 33512224
RAID5 doesn't hurt performance; I have several high I/O VMs on RAID5 and it's fine. That being said, a RAID10 is indeed better. But, 1. you probably won't notice a difference, and 2. you lose an extra disk.

You may have seen to install the hypervisor on separate disks because you typically want to separate it from your storage...in case you need to mess with your ESXi install. That way no harm comes to the VMs. It's just best practice, but isn't required. Since you're using ESXi, you don't need to use your disks, but you can use USB sticks to install it on. That frees up your HDs. You have the option to change the block size of your datastore, but off-hand, I can't recall if you're able to do so during the install if you install the hypervisor on the same disks as your datastore. Even if not, you can remove (delete) your datastore and re-add it with the proper block size you're requiring. What the block size determines is the max virtual disk (volume) that can be allocated to a VM.
1MB => 256GB max
2MB => 512GB max
4MB => 1TB max
8MB => 2TB max

Regards,
~coolsport00
0
 
LVL 28

Expert Comment

by:bgoering
ID: 33512538
RAID 5 works fine for me in all my VMware servers. As coolsport00 indicated formatting of the datastore blocksize will dictate the maximum size for a single virtual hard drive (file) on the datastore.

RAID 5 suffers a small penalty on write performance as compared to RAID 10.
I always recommend configuring a hot spare in any RAID setup - that would leave you with an odd number of drives, not conducive to RAID 10

I would recommend 7x300 in RAID 5 plus one hot spare. That would give you 1.8 TB usable

If you went 8x300 in RAID 5 you would be at 2.1 TB, slightly over the 2TB limit for ESX datastore

If you went 8x300 in RAID 10 You will have 1.2 TB usable

In any event be sure your RAID controller supports "write back" caching for writes.

Good Luck
0
Get your Conversational Ransomware Defense e‑book

This e-book gives you an insight into the ransomware threat and reviews the fundamentals of top-notch ransomware preparedness and recovery. To help you protect yourself and your organization. The initial infection may be inevitable, so the best protection is to be fully prepared.

 

Author Comment

by:cansib
ID: 33512809
and where does the ESXi install go?

I don't really want to rely on a memory stick just because I'm worried it would die sooner than a hard drive would.

bgoering, you said you'd recommend 7x300 in a RAID 5 config with a hot spare, so in that example, you're then saying to put ESXi on that same array, as I would have no other array to put it on.  So with that, I would have a 1MB block size, with 256GB of maximum allocatable storage for each VM, correct?  So, if I did it that way, and I created a Windows 2003 server VM, the maximum hard drive space I could give that server is 256GB, which could be done all in one drive or in 2 drives, or whatever, but added up it won't be more 256GB total space for that VM.  I'm just trying to make sure I understand this.  Sorry.

Mark
0
 
LVL 40

Expert Comment

by:coolsport00
ID: 33512841
If you were to use a USB stick, the install would go on that. The footprint for the install is fairly small. A 2GB would be all you needed. You can make a simple copy of the USB for failover. Now, it's not like a RAID1 where if you have 1 disk fail, you're still up and can replace the failed drive. There is slight downtime...the time it would take to unplug the failed USB and plug in the copy. If it's after hours, the recovery time would obviously be longer.

~coolsport00
0
 

Author Comment

by:cansib
ID: 33513087
I see what you're saying coolsport00.

But how about this, if I create 2 arrays, one that's 2 x 300GB mirrored for the OS, then one that's 6 x 300GB in a RAID5 (or 5 x 300GB with hot spare), couldn't I still allocate the leftover space to a VM on the OS array?  So that one VM will have the 256GB limit, but I could have the other array with a 2MB or 4MB block size so I could have higher capacity VM's if I needed it.  What do you think of that?
0
 
LVL 40

Expert Comment

by:coolsport00
ID: 33513178
Yep...you sure can; keep in mind the *only* reason behind my suggesting installing on USB is 1. to save a drive or 2 and, 2. to separate your ESXi install from datastore storage.

You're suggestion would certainly work fine.

Regards,
~coolsport00
0
 
LVL 28

Expert Comment

by:bgoering
ID: 33514417
A couple of reasons I would recommend the USB stick (which is the way I am running my ESXi) is that the install process to disk will sometimes wipe out the datastore when you go to install the next version. That is why I converted to USB. My ESXi is also on a R710 Dell, and there is an internal USB port in the front left corner (as you face the server) that is easily accessable.

Just get a good quality USB Media (or SD card) for the install. In any event if you lose the USB it is pretty easy to plug in another, re-run the install, and restore your configuration from backup. Wasting 2x300 drives for a fault tolerent ESXi Install disk is overkill (in my not so humble opinio) - Get a USB and add those to your 7x300 RAID 5.

Good Luck
0
 

Author Comment

by:cansib
ID: 33532766
So, when or where during the ESXi install (or is it during the VM install) do you specify the block size?
0
 
LVL 28

Accepted Solution

by:
bgoering earned 1000 total points
ID: 33532898
You specify block size when a datastore is created -- select server, configuration tab, then storage. If the datastore is already there you cannot change block size unless you delete it (losing all data) and readd it back in.
0
 
LVL 40

Assisted Solution

by:coolsport00
coolsport00 earned 1000 total points
ID: 33583772
You cannot specify block size during the ESXi/ESX install if you're installing the hypervisor on the same RAID/array as what you're datastore will be on. These KBs tell how you can do so, though not easy:
http://kb.vmware.com/kb/1013210
http://kb.vmware.com/kb/1012683

The best thing you can do is separate your ESX/i install from datastore storage.

Regards,
~coolsport00
0
 

Author Closing Comment

by:cansib
ID: 33591317
Well, I decided to go with 2 drives configured with RAID1 for the OS, and the rest in a RAID10.  I think I could have been just fine with the RAID5, but my bosses are 22 doctors and performance is a big deal to them.  For what we're doing, I think I'll be fine.  Thanks for the help!
0

Featured Post

Office 365 Training for Admins - 7 Day Trial

Learn how to provision tenants, synchronize on-premise Active Directory, implement Single Sign-On, customize Office deployment, and protect your organization with eDiscovery and DLP policies.  Only from Platform Scholar.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In this article, I will show you HOW TO: Create your first Windows Virtual Machine on a VMware vSphere Hypervisor 6.5 (ESXi 6.5) Host Server, the Windows OS we will install is Windows Server 2016.
In this article, I will show you HOW TO: Install VMware Tools for Windows on a VMware Windows virtual machine on a VMware vSphere Hypervisor 6.5 (ESXi 6.5) Host Server, using the VMware Host Client. The virtual machine has Windows Server 2016 instal…
Teach the user how to use create log bundles for vCenter Server or ESXi hosts Open vSphere Web Client: Generate vCenter Server and ESXi host log bundle:  Open vCenter Server Appliance Web Management interface and generate log bundle: Open vCenter Se…
This Micro Tutorial walks you through using a remote console to access a server and install ESXi 5.1. This example is showing remote access and installation using a Dell server. The hypervisor is the very first component of your virtual infrastructu…
Suggested Courses

765 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question