Sean Rhudy
asked on
Recommendations for new VMWare setup
Hi everyone,
We want to replace our 8 Dell Tower servers with a VMWare setup. I have some ideas but want to get some recommendations from the community. We have 3 terminal servers (1 for production Workstations and 2 for administrative PC's).
Server 1: DC
Server 2: Symantec Endpoint/SQL/File & Print
Server 3: SQL
Server 4: Misc. Software
Server 5: Syncs Data with Remote Location DC
We actually have a 9th server that does image backups with shadow protect
Anyone have recommendations on how many servers, backups, etc?
We want to replace our 8 Dell Tower servers with a VMWare setup. I have some ideas but want to get some recommendations from the community. We have 3 terminal servers (1 for production Workstations and 2 for administrative PC's).
Server 1: DC
Server 2: Symantec Endpoint/SQL/File & Print
Server 3: SQL
Server 4: Misc. Software
Server 5: Syncs Data with Remote Location DC
We actually have a 9th server that does image backups with shadow protect
Anyone have recommendations on how many servers, backups, etc?
ASKER
Yes, we will purchase VMWare. What is the best way to provide redundancy?
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
The VSA shared storage means that 2-host systems must have double the required storage installed. An 3-host system needs treble. So, if you want each host to have 4TB, you'll need 8TB usable or 12TB usable installed on _each_ host.
At some point, a cheap SAN with something like a Drobo, Netgear, or Synology might be more efficient to manage. On a home- or SMB-budget, you can get a VMware-ready 4-drive Synology NAS bare for $700. Link-aggregation on dual-gig ports gets you 150+MB/sec, depending on RAID level and drive type.
A SAN can be replicated to another SAN. Can't do the same with VSA shared local drives.
At some point, a cheap SAN with something like a Drobo, Netgear, or Synology might be more efficient to manage. On a home- or SMB-budget, you can get a VMware-ready 4-drive Synology NAS bare for $700. Link-aggregation on dual-gig ports gets you 150+MB/sec, depending on RAID level and drive type.
A SAN can be replicated to another SAN. Can't do the same with VSA shared local drives.
ASKER
We have a "corporate" budget and would rather do it the best way.
If you require redundancy, VMware vSphere licenses and a Storage Array Network or NAS are required, but not necessary.
It really depends, on how much downtime, can the business afford?
none, 1 min, 1 hour, 4 hours, 8 hours or 1 day?
It really depends, on how much downtime, can the business afford?
none, 1 min, 1 hour, 4 hours, 8 hours or 1 day?
ASKER
Sorry guys, I was out of town last week. As for downtime, I'd say none - 1 minute. This is a manufacturing facility so any downtime would really hurt the bottom line.
ASKER
I'm leaning towards vSphere with HA and a Dell iSCSI SAN. Can someone explain the difference between using 2 or 3 hosts? Either way, would 1 server hold all of the VM's? Also, if I use HA, will I need a second SAN that is replicated?
ASKER
And would the other 1 or 2 servers need matched hardware to the main server?
HA with VMware runs a ghost machine in parallel (hopefully on a separate hardware host). Memory is replicated between the two, and each machine is processing the same info. Only one machine performs the writes to the SAN. The failover occurs to the ghost machine with the exact same memory state. It's good for host failure. If the OS crashes, the ghost machine will crash from the exact same problem.
3 hosts allows you to take down one for maintenance (or crash) and still maintain hardware redundancy. You can keep HA with separate hosts. If the maintenance is extended time, you still have the ability to load balance or handle another hardware failure without being 100% down. The Essentials bundle includes 3 hosts for that reason. It's the most basic building block.
SAN replication is another idea altogether. Has nothing to do directly with the VMware environment.
3 hosts allows you to take down one for maintenance (or crash) and still maintain hardware redundancy. You can keep HA with separate hosts. If the maintenance is extended time, you still have the ability to load balance or handle another hardware failure without being 100% down. The Essentials bundle includes 3 hosts for that reason. It's the most basic building block.
SAN replication is another idea altogether. Has nothing to do directly with the VMware environment.
Hosts do not have to match, except that mixing Intel and AMD may limit some options for vMotion. But you could have Dell, HP, Cisco, white-box, as long as you have enough sockets and cores to handle the guest VMs.
For instance, if you have a guest with 4 socket x 2 cores each, you couldn't move it to a 2CPU host. Better to provision your guests with minimal sockets and cores and test if they really need that much horsepower. Some people will spec SQL with extra CPUs and cores because they're used to getting a single hardware server without take chance to upgrade for 3-5 years. They over buy at te beginning. With virtualization, upgrading is a bit easier, so you can start smaller.
For instance, if you have a guest with 4 socket x 2 cores each, you couldn't move it to a 2CPU host. Better to provision your guests with minimal sockets and cores and test if they really need that much horsepower. Some people will spec SQL with extra CPUs and cores because they're used to getting a single hardware server without take chance to upgrade for 3-5 years. They over buy at te beginning. With virtualization, upgrading is a bit easier, so you can start smaller.
You may need to think again, VMware HA, might just be outside, of 1 minute availability, if a Host should fail.
Was that an actual 1-minute goal, or "we measure downtime in $/min"?
Some measure in $/5min or $/hr.
Some measure in $/5min or $/hr.
ASKER
It could be longer than 1 minute, but we would need to get up and running very quickly. So I understand that HA would replicate any OS issues to the ghost machine. So could I add something to protect against host OS failure? I was planning on adding 2 SAN's that are replicated.
I think you need to look at things from several points of view:
HA - Is for host failure rather than vm failure.
FT - Is vm failure focused [This is where you have a FT VM (ghost)]
I would prefer in your case to have:
1. HA/DRS cluster with 3 hosts as I said before [Better load distribution and will not cause your cluster to become invalid as a result of 1 host failure]
2. VSS/Application aware backups [Explained better below] [Continuous data protection will allow you to restore to before a corruption occurred]
3. Storage snapshot/replication
For host level failures HA will remedy but with a 5 min overhead, for application data corruption a full vm restore is overkill hence application data backups are needed, this works better for such scenarios, and lastly for storage failures, the ability to either fail over to another DC [manually] as DR is best.
One other very nice solution would be to use Veaam backup, I believe this now offers granular support for backup/restore of application data, as well as performing vm level backup/restores.
HA - Is for host failure rather than vm failure.
FT - Is vm failure focused [This is where you have a FT VM (ghost)]
I would prefer in your case to have:
1. HA/DRS cluster with 3 hosts as I said before [Better load distribution and will not cause your cluster to become invalid as a result of 1 host failure]
2. VSS/Application aware backups [Explained better below] [Continuous data protection will allow you to restore to before a corruption occurred]
3. Storage snapshot/replication
For host level failures HA will remedy but with a 5 min overhead, for application data corruption a full vm restore is overkill hence application data backups are needed, this works better for such scenarios, and lastly for storage failures, the ability to either fail over to another DC [manually] as DR is best.
One other very nice solution would be to use Veaam backup, I believe this now offers granular support for backup/restore of application data, as well as performing vm level backup/restores.
No, VMware HA, restarts the Virtual Machine on other hosts, and can take 1-2 minutes before a VM is back online.
That's a Host Failure! (not shutdown or controlled shutdown!)
OS Failure is VMware FT, but you need to be careful here, because if the OS has a fault, this is also replicated to the secondary VM, so it will also fail!
That's a Host Failure! (not shutdown or controlled shutdown!)
OS Failure is VMware FT, but you need to be careful here, because if the OS has a fault, this is also replicated to the secondary VM, so it will also fail!
Sorry, I mixed the term HA with FT. FT replicates to a ghost machine...app/OS crash will happen on both VMs. Limited to small VMs (1 CPU, 1 core in ESX 4-5).
Even if you turn everything down to 5-10 seconds, you might miss a sub-one-minute spawn if another VM. Even on SSDs, a VM with Server 2008 takes ~30-45 seconds, then other services have to launch and stabilize.
Even if you turn everything down to 5-10 seconds, you might miss a sub-one-minute spawn if another VM. Even on SSDs, a VM with Server 2008 takes ~30-45 seconds, then other services have to launch and stabilize.
ASKER
If I purchase Essentials Plus which allows 3 hosts w/ 2 CPU's each, how can I allocate those 2 CPU's across 9 VM's?
So will you be having 9 vm's per host? 27 vm's altogether? Just asking because you should reserve capacity for failure mitigation.
You create a VM, and assign 1 vCPU per VM.
roughly you can assign 5-6 VMs per core of the physical processor.
The Hypervisor will then schedule the workload, and move it across the physical cores on the physical processors.
You do not really assign 1 physical cpu to 1 VM, there is not a one to one relationship.
roughly you can assign 5-6 VMs per core of the physical processor.
The Hypervisor will then schedule the workload, and move it across the physical cores on the physical processors.
You do not really assign 1 physical cpu to 1 VM, there is not a one to one relationship.
Yes, the NUMA scheduler will load balance the CPU load effectively. Do you know the total guest count?
http://pubs.vmware.com/vsphere-4-esx-vcenter/index.jsp?topic=/com.vmware.vsphere.resourcemanagement.doc_41/using_numa_systems_with_esx_esxi/c_how_esx_esxi_numa_scheduling_works.html
http://pubs.vmware.com/vsphere-4-esx-vcenter/index.jsp?topic=/com.vmware.vsphere.resourcemanagement.doc_41/using_numa_systems_with_esx_esxi/c_how_esx_esxi_numa_scheduling_works.html
ASKER
I planned on 1 host with 9 VM's and the other 2 hosts for redundancy. The existing servers are using a total of 36GB of RAM and 2.23 TB of Data. All 9 existing servers have 3Ghz Xeon CPU's.
Wow that's a lot of horse power, but I guess this is in line with the guest workload. Yes you look good from where I'm standing.
You could spread your vm workload across the 3 servers, DRS should help here.
http://www.vmware.com/files/pdf/VMware-Distributed-Resource-Scheduler-DRS-DS-EN.pdf
You could spread your vm workload across the 3 servers, DRS should help here.
http://www.vmware.com/files/pdf/VMware-Distributed-Resource-Scheduler-DRS-DS-EN.pdf
DRS doesn't exist in the Essentials bundle/kit. Or storage vMotion.
You'll have to move the VMs across the hosts manually.
You'll have to move the VMs across the hosts manually.
Very true! No DRS/vMotion in essentials, manual load balancing will be the way. I would look at comparing the essentials package with the VSPP approach to see which is cheaper for you long term, that is, if you are a service provider that is.
http://www.vmware.com/uk/partners/service-provider.html
http://www.vmware.com/uk/partners/service-provider.html
VMware also told us that we can't attach "Essentials" host to our Standard vCenter server. They can only be managed by the vCenter server that comes with the bundle. So, no expansion to your environment is available. Not a big issue for many small environments. I'm sure there's an upgrade path if you have money and you stay current on support.
Essentials plus I find is a bit better as it offers more features including DRS, as it's corporate..... :-) I doubt it would be an issue with a few .ppt presentations.
ASKER
So just to clarify, would all 3 hosts load balance AND be available for to use with VMWare HA? Or do I need a dedicated host for VMware HA?
You add all 3 hosts to an HA cluster.
Unless you have DRS, your load balancing will be done manually by you monitoring the loads and vMotion-ing between hosts.
Unless you have DRS, your load balancing will be done manually by you monitoring the loads and vMotion-ing between hosts.
ASKER
Does DRS come with the Essentials Plus kit?
No. The kits don't have DRS.
DRS comes with "Enterprise" and "Enterprise Plus"
Storage DRS comes with "Enterprise Plus"
vSphere Essentials and Essentials Plus kits support up to three ESX hosts. Essentials Plus supports vMotion and HA for clustering, but without DRS.
DRS comes with "Enterprise" and "Enterprise Plus"
Storage DRS comes with "Enterprise Plus"
NO DRS I'm afraid.
ASKER
So I'm looking at pricing on vmware.com and it looks like VMware vSphere Enterprise is $2,875. And that's what includes DRS? Do I need anything in addition to that regarding vmware?
ASKER
And would that license cover all 3 hosts?
One license covers 1 host for up to 2 sockets. (It's a 2-socket pack.). If you have four sockets, you need 2 licenses.
Then, do the same math for each additional host.
There's no limit to number of cores or RAM.
Then, add support. Either 10x5 or 24x7. For each host.
Then, do the same math for each additional host.
There's no limit to number of cores or RAM.
Then, add support. Either 10x5 or 24x7. For each host.
ASKER
So if I wanted to save some money, I "could" do this using 2 hosts.
ASKER
Also, I saw a vCenter Converter for migrating my physical servers to VM. I'm assuming there is an additional cost as well. What's the easiest way without breaking the bank?
Yes, using 2 hosts would save you licensing for VMware, Microsoft Server and the cost if the physical box. But if one host goes down, you may overload the last host, and will be running without redundancy.
I've done P2V with their free tools, and using Paragon HD Mgr for Server 2000 and 2003 boxes that don't complete with Vmware's converter.
I've done P2V with their free tools, and using Paragon HD Mgr for Server 2000 and 2003 boxes that don't complete with Vmware's converter.
see my EE Articles, Step by Step Tutorials with Instructions:-
VMware vCenter Converter Standalone 5.1 is FREE
HOW TO: Synchronize changes when completing a P2V or V2V with VMware vCenter Converter Standalone 5.1
HOW TO: P2V, V2V for FREE - VMware vCenter Converter Standalone 5.1
HOW TO: Improve the transfer rate of a Physical to Virtual (P2V), Virtual to Virtual Conversion (V2V) using VMware vCenter Converter Standalone 5.0
see also:-
Part 1: HOW TO: Install and Configure VMware vSphere Hypervisor 5.1 (ESXi 5.1)
Part 2: HOW TO: Connect to the VMware vSphere Hypervisor 5.1 (ESXi 5.1) using the vSphere Client
Part 3: HOW TO: Create an ISO CD-ROM/DVD-ROM image (*.iso), and MD5 checksum signature, for use with VMware vSphere Hypervisor 5.1 (ESXi 5.1)
Part 4: HOW TO: Upload an ISO CD-ROM/DVD-ROM image to a VMware datastore for use with VMware vSphere Hypervisor 5.1 (ESXi 5.1) using the vSphere Client, and checking its MD5 checksum signature is correct.
Part 5: HOW TO: Enable SSH Remote Access on a VMware vSphere Hypervisor 5.1 (ESXi 5.1)
Part 6: HOW TO: Create your first Linux Virtual Machine on a VMware vSphere Hypervisor 5.1 (ESXi 5.1) Host Server
Part 7: HOW TO: Create your first Windows Virtual Machine on a VMware vSphere Hypervisor 5.1 (ESXi 5.1) Host Server
Part 8: HOW TO: Install VMware Tools for Windows on a VMware Windows virtual machine on a VMware vSphere Hypervisor 5.1 (ESXi 5.1) Host Server
VMware vCenter Converter Standalone 5.1 is FREE
HOW TO: Synchronize changes when completing a P2V or V2V with VMware vCenter Converter Standalone 5.1
HOW TO: P2V, V2V for FREE - VMware vCenter Converter Standalone 5.1
HOW TO: Improve the transfer rate of a Physical to Virtual (P2V), Virtual to Virtual Conversion (V2V) using VMware vCenter Converter Standalone 5.0
see also:-
Part 1: HOW TO: Install and Configure VMware vSphere Hypervisor 5.1 (ESXi 5.1)
Part 2: HOW TO: Connect to the VMware vSphere Hypervisor 5.1 (ESXi 5.1) using the vSphere Client
Part 3: HOW TO: Create an ISO CD-ROM/DVD-ROM image (*.iso), and MD5 checksum signature, for use with VMware vSphere Hypervisor 5.1 (ESXi 5.1)
Part 4: HOW TO: Upload an ISO CD-ROM/DVD-ROM image to a VMware datastore for use with VMware vSphere Hypervisor 5.1 (ESXi 5.1) using the vSphere Client, and checking its MD5 checksum signature is correct.
Part 5: HOW TO: Enable SSH Remote Access on a VMware vSphere Hypervisor 5.1 (ESXi 5.1)
Part 6: HOW TO: Create your first Linux Virtual Machine on a VMware vSphere Hypervisor 5.1 (ESXi 5.1) Host Server
Part 7: HOW TO: Create your first Windows Virtual Machine on a VMware vSphere Hypervisor 5.1 (ESXi 5.1) Host Server
Part 8: HOW TO: Install VMware Tools for Windows on a VMware Windows virtual machine on a VMware vSphere Hypervisor 5.1 (ESXi 5.1) Host Server
Will you be purchasing a SAN or Shared Storage?
You will need this for DRS?
Do you need DRS ?
You will need this for DRS?
Do you need DRS ?
ASKER
I'll be purchasing a SAN, and Yes, I'd like to use DRS.
I have a question about the hosts... Since I'll be using a SAN, do I need any Hard drives in the hosts?
I have a question about the hosts... Since I'll be using a SAN, do I need any Hard drives in the hosts?
ASKER
And I don't need an OS for the hosts, correct?
Host OS is ESXi from VMware.
They can boot from SAN, so local drives not required (IIRC).
They can boot from SAN, so local drives not required (IIRC).
no local disks required in the hosts, you can install ESXi OS onto SD cards or USB flash drives.
ESXi installs on bare metal.
Do not BOOT from SAN, SAN storage is too expensive for this.
Here is the VMware KB on installing 5.0 on USB/SD:
http://kb.vmware.com/kb/2004784
ESXi installs on bare metal.
Do not BOOT from SAN, SAN storage is too expensive for this.
Here is the VMware KB on installing 5.0 on USB/SD:
http://kb.vmware.com/kb/2004784
as for hardware, Dell will give you a good price, on entry level hosts.