Exchange 2013 Databases Dismounted - DAG cannot failover - ExPerfWiz Help

Our entire Exchange 2013 environment (7 x Exchange 2013 servers) just had and outage for about 30mins. All our databases were dismounted and the DAG couldn't fail over Databases to other copies, assuming because all servers were not able to see or connect to the passive database copies.

Luckily enough I was running the Experfwiz during this time. Now all I am wanting to drill down to the times and specific exchange services so I can see what may have caused the issue... what services would I look at specifically during the 30 minute time frame?

I see logs pointing toward network disconnection to our neat attached storage.

The common Critical alert  I see on the servers is:

--------------------
Log Name:      System
Source:        Microsoft-Windows-FailoverClustering
Date:          7/30/2015 11:34:11 AM
Event ID:      1177
Task Category: Quorum Manager
Level:         Critical
Keywords:      
User:          SYSTEM
Computer:      exserver09.domain.local
Description:
The Cluster service is shutting down because quorum was lost. This could be due to the loss of network connectivity between some or all nodes in the cluster, or a failover of the witness disk.
Run the Validate a Configuration wizard to check your network configuration. If the condition persists, check for hardware or software errors related to the network adapter. Also check for failures in any other network components to which the node is connected such as hubs, switches, or bridges.
--------------------
Log Name:      System
Source:        Microsoft-Windows-FailoverClustering
Date:          7/30/2015 11:34:15 AM
Event ID:      1135
Task Category: Node Mgr
Level:         Critical
Keywords:      
User:          SYSTEM
Computer:      exserver05.domain.local
Description:
Cluster node 'exserver09' was removed from the active failover cluster membership. The Cluster service on this node may have stopped. This could also be due to the node having lost communication with other active nodes in the failover cluster. Run the Validate a Configuration wizard to check your network configuration. If the condition persists, check for hardware or software errors related to the network adapters on this node. Also check for failures in any other network components to which the node is connected such as hubs, switches, or bridges.
--------------------
Christian HansAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Will SzymkowskiSenior Solution ArchitectCommented:
I would be looking at the logs first and if it does state that it was a network outage then that is a good indicator why your Exchange servers did not failover properly. If you do not have fault tolerant networks in please then that is your weak point in your design.

A network issue could be exactly why Exchange was not working.

Will.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Christian HansAuthor Commented:
Turns out we started seeing a 'All Paths Down (APD)' alert on the VMware infrastructure side... along with a identifier number.
0
Will SzymkowskiSenior Solution ArchitectCommented:
Why that could definitely do it. Network infrasturucture is typically a weak point, if you do not have redundant routes.

Will.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Exchange

From novice to tech pro — start learning today.