Solved

Exchange 2013 - Powering off old mailbox servers caused 100% cpu on CAS servers :-(

Posted on 2016-10-26
6
28 Views
Last Modified: 2016-11-01
We recently build new mailbox servers on newer hardware and added them to the DAG. Databases were moved off the old servers, connectors copied etc, connectors disabled on the old servers.

Today we planned to power these servers off for 7 days. Was a bit of a disaster - both our CAS servers went to 100%. Slowly recovering now because we powered back on.

I must admit I thought they were dead. Or would they still have been processing client requests? Whats the best way to decomm these servers? Or should I have removed from DAG?
0
Comment
Question by:paulfoel
  • 4
  • 2
6 Comments
 

Author Comment

by:paulfoel
ID: 41860064
Hmm. Looks like windows clustering had something to do with it. We left 4 mailbox servers on and powered off 5 of them.

Looks like some of the windows clusters stayed in a failed state.
0
 
LVL 63

Assisted Solution

by:Simon Butler (Sembee)
Simon Butler (Sembee) earned 500 total points
ID: 41860324
The power off and see what breaks method doesn't work for Exchange.
Exchange expects the servers to be there and gets upset when they are not.
Therefore the "results" of tests like that are void because you will see problems.

If you have removed all of the mailboxes and taken the servers out of the DAG, then remove the databases and remove Exchange using add/remove programs. If something is still using them then the installer will tell you and not let you continue.
0
 

Author Comment

by:paulfoel
ID: 41861740
No we hadnt removed them from the DAG. I think that was the problem - windows cluster got in a right state.

So you would recommend removing from the DAG maybe one at a time?
0
Free book by J.Peter Bruzzese, Microsoft MVP

Are you using Office 365? Trying to set up email signatures but you’re struggling with transport rules and connectors? Let renowned Microsoft MVP J.Peter Bruzzese show you how in this exclusive e-book on Office 365 email signatures. Better yet, it’s free!

 

Author Comment

by:paulfoel
ID: 41861741
I still dont understand why windows clustering got in such a state though? Surely if we'd legitiimately lost half our servers it should still be able to run?
0
 
LVL 63

Accepted Solution

by:
Simon Butler (Sembee) earned 500 total points
ID: 41861845
If the plan is to remove the servers for a power off scenario then you should have removed them from the DAG.
How many servers in total do you have? Do you have an FSW? It could be that it lost quorum.
The cluster should have stayed active and may well have done - your post though is referring to CAS role. A little more control over the servers is required before powering them off.
0
 

Author Comment

by:paulfoel
ID: 41861945
2 CAS (one of which is the DAG witness).

4 mailbox servers that we're keeping (and have got all the databases on). 5 mailbox servers we turned off.

What then happened was the CPU went to 100% on both of the CAS servers, effectively locking users out. We powered the 5 servers back on but the failover cluster seemed to be in a bit of a state so we had to manually correct that.

Going forward our plan is going to be - one server at a time, remove from dag.
0

Featured Post

Too many email signature changes to deal with?

Are you constantly being asked to update your organization's email signatures? Do they take up too much of your time? Wouldn't you love to be able to manage all signatures from one central location, easily design them and deploy them quickly to users. Well, you can!

Join & Write a Comment

Resolve Outlook connectivity issues after moving mailbox to new Exchange 2016 server
Follow this checklist to learn more about the 15 things you should never include in an email signature from personal quotes, animated gifs and out-of-date marketing content.
In this video we show how to create a User Mailbox in Exchange 2013. We show this process by using the Exchange Admin Center. Log into Exchange Admin Center.: First we need to log into the Exchange Admin Center. Navigate to the Recipients >> Mailb…
In this video we show how to create a mailbox database in Exchange 2013. We show this process by using the Exchange Admin Center. Log into Exchange Admin Center.: First we need to log into the Exchange Admin Center. Navigate to the Servers >> Data…

743 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

11 Experts available now in Live!

Get 1:1 Help Now