Failed Exchange 2016 CU9 Install

On my Exchange 2016, CU9 failed to install. Now MS Exchange Replication service (MSExchcangeRepl) will not stay running and MS Exchange RPC Client Access (MSExchangeRPC) will not start.

When setup (with /m:upgrade) is ran from command prompt the upgrade fails with a critical error at the end of the Mailbox Service section of the Upgrade. The setup log shows that there is an error when trying to mount mailbox database - specifically:
[2] Failed to mount database "MDB01". Error: An Active Manager operation failed. Error: The Microsoft Exchange Replication service may not be running on server Server16.McKeand.local. Specific RPC error message: Error 0x6d9 (There are no more endpoints available from the endpoint mapper) from cli_MountDatabase3 [Server: Server16.McKeand.local]

Restore from backup is not an option.

The questions are:
  1. Will Setup /m:RecoverServer do anything to the information store?
  2. Should I copy the .edb elsewhere before running the RecoverServer?
  3. Is there anything else I should try before running the RecoverServer?
James McKeandTechnical ConsultantAsked:
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

FOXActive Directory/Exchange EngineerCommented:
Were your server(s) put in maintenance mode before installing the CU9?
James McKeandTechnical ConsultantAuthor Commented:
As the update was first ran by Windows Update (silly me), No it was not.

I will try to put it in maintenance mode.
James McKeandTechnical ConsultantAuthor Commented:
In maintenance mode I get:
[05/12/2018 23:45:55.0320] [2] An Active Manager operation failed. Error: Invalid Active Manager configuration. Error: Active Manager hasn't completed configuration initialization. [Database: MDB01, Server: Server16.McKeand.local]

So the database won't mount.
Big Business Goals? Which KPIs Will Help You

The most successful MSPs rely on metrics – known as key performance indicators (KPIs) – for making informed decisions that help their businesses thrive, rather than just survive. This eBook provides an overview of the most important KPIs used by top MSPs.

FOXActive Directory/Exchange EngineerCommented:
Does the path 'C:\Program Files\Microsoft\Exchange Server\V14\Mailbox\Mailbox Database MDB01' exist? If not create it.
James McKeandTechnical ConsultantAuthor Commented:
The path to the database is located at C:\Program Files\Microsoft\Exchange Server\V15\Mailbox\MDB01

I'll create the path and report back.
James McKeandTechnical ConsultantAuthor Commented:
Back to the orginal error message.

When MSExchangeRepl service tries to start I get a message in the event log:
Watson report about to be sent for process id: 10496, with parameters: E12, c-RTL-AMD64, 15.01.1466.003, msexchangerepl, M.E.Cluster.Replay, M.E.C.A.AmHelper.HandleKnownExceptions, S.IO.FileNotFoundException, 7374-dumptidset, 15.01.1466.003.
ErrorReportingEnabled: True

I think I am done for this evening.
MAS (MVE)EE Solution Guide - Technical Dept HeadCommented:
Hi James McKand,
Please make sure your database clean shutdown.   If the database is in clean shutdown and still you have error you can go ahead and recover.
Please use this command to check the database status/health.
 eseutil /mh "D:\database\Mailbox Database 0436312751.edb"

Open in new window

And when you recover you can specify the path.
James McKeandTechnical ConsultantAuthor Commented:
The solution to my issue was that there were several .dlls missing from my bin directory. I had to copy from the mounted iso to the bin directory. I don't know if the update was interrupted while copying or not.

The biggest issue was that I could not find what file was missing. I found a report from one of the Error 4999 that the MSExchangeRepl was throwing that pointed to what file was missing. I also had to copy a couple dlls for the MSExchangeRPC service to be able to run.

Lesson learned - Microsoft Update cannot install CUs for Exchange. Why does it even try?

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
MAS (MVE)EE Solution Guide - Technical Dept HeadCommented:
Glad to know you found a solution and thanks for sharing the solution.
James McKeandTechnical ConsultantAuthor Commented:
I was able to get the services running and allow the update to complete successfully. The contributors did give me some hints on how to get the update to run, but most of the leg work was mine.
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today

From novice to tech pro — start learning today.