If anyone has experience with VMware HA, the textbook answer to this question does not work.
Problem: Our customer has a VCenter and ESX hosts in an HA Cluster. Twice encountered was a problem where switches dropped links to the network which leave the switches online (link status positive) but without routes, and the ESX hosts entered into host isolation mode even though all ESX servers were online. Likewise the VMs were unable to communicate on the network because of the network isolation split brain for 15 minutes. The customer asked us to validate their new configuration and make recommendation for best practice.
Scenario 1 The faulty configuration
Service Console VLAN 1 - 10.1.1.1
Uplinks 2 Active uplinks on VLAN 1 connected to separate physical switches
Switches run Spanning Tree
Scenario 2 Alternative
Service Console - VLAN 1 - 10.1.1.1
Service Console 2 VLAN 2 - 10.1.2.1
Uplinks 2 Active on VLAN 1 and 2 Standby on VLAN 2
Switches run Spanning Tree and PortFast has been enabled
Is Scenario 2 the best config?