Exchange 2013 just stopped receiving emails

I installed windows updates this morning and right after that, exchange now longer is receiving emails.  Outbound is fine.  Here's what I did so far.
1. Rebooted the server twice.
2. Individually restarted the transport and IS services.
3. I checked to make sure the databases are mounted.
4. I can log into the ECP just fine, all receive and outbound connectors are there.
5. Checked on mxtoolbox, and everything is fine, no DNS changes made.
6. I checked my firewall, and it's receiving the external emails and it's passing the email to exchange.

Short of uninstalling the windows updates, not sure what else to do.
DanNetwork EngineerAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

DanNetwork EngineerAuthor Commented:
I tried to access the queue viewer, but I get this message:

queue viewer
DanNetwork EngineerAuthor Commented:
after pressing ok, it just keeps popping up every 10 seconds or so
DanNetwork EngineerAuthor Commented:
now after trying to click on different options in the event viewer, I get this message
get exchange
Has anyone encountered this strange behavior before?
CompTIA Network+

Prepare for the CompTIA Network+ exam by learning how to troubleshoot, configure, and manage both wired and wireless networks.

Hemil AquinoNetwork Security EngineerCommented:
You are having issue with the transport services.  Are they up and running? Did you change any IP address?
DanNetwork EngineerAuthor Commented:
I ran this test:

And here's where it failed, and the error it gave me.

Additional Details
The server returned status code 451 - Error in processing. The server response was: Temporary local problem, please try again!
Exception details:
Message: Error in processing. The server response was: Temporary local problem, please try again!
Type: System.Net.Mail.SmtpException
Stack trace:
at System.Net.Mail.DataStopCommand.CheckResponse(SmtpStatusCode statusCode, String serverResponse)
at System.Net.Mail.DataStopCommand.Send(SmtpConnection conn)
at System.Net.Mail.SmtpClient.Send(MailMessage message)
at Microsoft.Exchange.Tools.ExRca.Tests.SmtpMessageTest.PerformTestReally()
Elapsed Time: 1698 ms.
DanNetwork EngineerAuthor Commented:
yes, the transport service is up and running, and no, I have not made any changes to any IP addresses on the server
I have restarted the transport service manually as well 3 or 4 times
DanNetwork EngineerAuthor Commented:
looks like internal emails are not working either
Scott CSenior EngineerCommented:
Outgoing is working but incoming is not.  Sounds like BackPressure.

Check your drive space.  If you are running out of space, Exchange will protect itself by no allowing incoming emails.

Look in your Application Logs for 15004, 15005, 15006, and/or 15007.  If you see those then it's backpressure.  You'll need to free up space.

Also make sure all Exchange services are running.
DanNetwork EngineerAuthor Commented:
so I can send external emails, but I can't send internal emails
Scott CSenior EngineerCommented:
Try rebooting the Exchange server.  Sometimes an update will be installed, but sort of hangs Exchange until a reboot is performed and the update can finish installing.
Hemil AquinoNetwork Security EngineerCommented:
Try this:

go to this folder: C:\Program Files\Microsoft\Exchange Server\V15\TransportRoles\data

You will see a folder called "Queue"
Rename that folder and reboot both transport services and see if it works
DanNetwork EngineerAuthor Commented:
I have over 200GB of space on my C drive and over 500GB of free space on my E drive, database drive

alll services are running

Checking event viewer now
DanNetwork EngineerAuthor Commented:
I have restarted the server 3 times, and still no go
Scott CSenior EngineerCommented:
With that much free space it isn't backpressure then.  What version and patch level are you at?

Run "Get-ExchangeServer | Format-List Name, Edition, AdminDisplayVersion" in and Exchange PS command window.

You should be at least CU17 or CU18.
Scott CSenior EngineerCommented:
At this point I'd remove the Windows Updates and see if that has any effect.  Windows updates have been known to break Exchange every now and then.

What .NET version are you running?
DanNetwork EngineerAuthor Commented:
when I type that command, I get this error: "the term 'get-exchangeserver' is not recognized as the name or operable program"
DanNetwork EngineerAuthor Commented:
all my receive connectors are enabled
Hemil AquinoNetwork Security EngineerCommented:
Did you try this?

go to this folder: C:\Program Files\Microsoft\Exchange Server\V15\TransportRoles\data

You will see a folder called "Queue"
Rename that folder and reboot both transport services and see if it works
DanNetwork EngineerAuthor Commented:
Im seeing event ID 40025 numerous times in my app log, even before I did the windows updates.  Is that a reason to be concerned?
DanNetwork EngineerAuthor Commented:
ill try that now
DanNetwork EngineerAuthor Commented:
I just tried that, and a new queue folder was automatically created.

I'm waiting now to see if emails start coming in, nothing yet, but it's only been about 1 min.
DanNetwork EngineerAuthor Commented:
it's been about 3, no emails still
Hemil AquinoNetwork Security EngineerCommented:
open the queue-viewer and see what you have, andy errors?
DanNetwork EngineerAuthor Commented:
I opened the queue-viewer and i get this message: "the term get-queue is not recognized as the name of a cmdlet, etc......
Hemil AquinoNetwork Security EngineerCommented:
I think something is wrong in your transport services. I had this issue before.
Here is what you need to check

1- Are you using IMAP or POP3 services? if you do then check the binding of those services and make sure you have the right IP address.
2- Check your SMTP connectors see if you have different IP address.
3- Check the DNS as well, on the ECP panel go to Server>Server>Double click to name of the server DNS lookup and also IMAP and POP3.

But honestly you problem it's your transport rule
DanNetwork EngineerAuthor Commented:
So I ran this command: Add-PSSnapin Microsoft.Exchange.Management.PowerShell.SnapIn;
and that allowed me to actually type the get- commands

Why is this happening, as I ran across this at least 3 or 4 months ago, and it's been happening now for over a year now.

I'm running the standard edition
Version 15.0 (build 1156.6)
DanNetwork EngineerAuthor Commented:
give me a min, let me check  what you just said to do
DanNetwork EngineerAuthor Commented:
Im using both pop and imap
DanNetwork EngineerAuthor Commented:
where do I check the bindings?
Hemil AquinoNetwork Security EngineerCommented:
Login to the ECP Servers>Name of the server>DNS lookup> and you will see the IP address binding the ports.
Do the same with IMAP and POP3
DanNetwork EngineerAuthor Commented:
in ECP, under servers, after I edit my server, both pop3 and imap4 , have "all available IPv4 and IPv6" for TLS and SSL for the connections
DanNetwork EngineerAuthor Commented:
under DNS lookups, for both external and internal, it just says "all network adapters, all available IPv4"
Hemil AquinoNetwork Security EngineerCommented:
User your internal dns

On imap use your exchange IP.
Same if pop3

Also check all your incoming connectors make sure they span your exchange server.

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
DanNetwork EngineerAuthor Commented:
I looked into the message tracking log and here's a snippit of it, what is a shadow server?

I looked at the other logs and this started right after windows updates today

#Software: Microsoft Exchange Server
#Version: 15.00.1156.000
#Log-type: Message Tracking Log
#Date: 2017-11-02T18:00:40.526Z
#Fields: date-time,client-ip,client-hostname,server-ip,server-hostname,source-context,connector-id,source,event-id,internal-message-id,message-id,network-message-id,recipient-address,recipient-status,total-bytes,recipient-count,related-recipient-address,reference,message-subject,sender-address,return-path,message-info,directionality,tenant-id,original-client-ip,original-server-ip,custom-data
2017-11-02T18:00:40.526Z,,,,elijah,No suitable shadow servers,,SMTP,HAREDIRECTFAIL,140574279598081,<>,9b9dcae1-0f34-4387-15e3-08d5221ba113,,,86243,1,,,Entercom makes deals with radio groups as CBS Radio merger approaches,,,,Originating,,,,S:DeliveryPriority=Normal;;
2017-11-02T18:00:40.635Z,,,,elijah,08D5221999748E3F;2017-11-02T17:54:15.999Z;8,ELIJAH\Default ELIJAH,SMTP,RECEIVE,140574279598081,<>,9b9dcae1-0f34-4387-15e3-08d5221ba113,,,86243,1,,,Entercom makes deals with radio groups as CBS Radio merger approaches,,,0cI: ,Originating,,,,;S:ProxiedClientIPAddress=;;;S:DeliveryPriority=Normal;;
2017-11-02T18:00:40.713Z,,elijah,,,,,AGENT,AGENTINFO,140574279598081,<>,9b9dcae1-0f34-4387-15e3-08d5221ba113,,,93441,1,,,Entercom makes deals with radio groups as CBS Radio merger approaches,,,,Originating,,,,S:AMA=SUM|v=0|action=|error=|atch=0;S:AMA=EV|engine=M|v=0|sig=|name=|file=;S:CompCost=|AMA=0|ETR=0;S:DeliveryPriority=Normal;;
2017-11-02T18:00:44.932Z,,,,elijah,No suitable shadow servers,,SMTP,HAREDIRECTFAIL,140574279598082,<>,527b74f2-6c9d-42e2-93f8-08d5221ba3ba,,,89434,1,,,Do You: Assets or Content? Register Now!,,,,Originating,,,,S:DeliveryPriority=Normal;;
2017-11-02T18:00:45.107Z,,,,elijah,08D5221999748E3F;2017-11-02T17:54:15.999Z;8,ELIJAH\Default ELIJAH,SMTP,RECEIVE,140574279598082,<>,527b74f2-6c9d-42e2-93f8-08d5221ba3ba,,,89434,1,,,Do You: Assets or Content? Register Now!,,,0cI: ,Originating,,,,;S:ProxiedClientIPAddress=;;;S:DeliveryPriority=Normal;;
2017-11-02T18:00:45.135Z,,,,elijah,/o=mydomain/ou=First Administrative Group/cn=Recipients/cn=DougG,,ROUTING,RESOLVE,140574279598082,<>,527b74f2-6c9d-42e2-93f8-08d5221ba3ba,,,89628,1,,,Do You: Assets or Content? Register Now!,,,,Originating,,,,S:DeliveryPriority=Normal;;
2017-11-02T18:00:45.135Z,,,,elijah,No suitable shadow servers,,SMTP,HAREDIRECTFAIL,140574279598083,<31a9f65c5b4948e0a1c6035fba7ca94a@225508597>,6218517b-9dd6-4153-f229-08d5221ba3db,,,109984,1,,,Hurry — snag a budget-friendly home for the holidays!,,,,Originating,,,,S:DeliveryPriority=Normal;;
2017-11-02T18:00:45.198Z,,elijah,,,,,AGENT,AGENTINFO,140574279598082,<>,527b74f2-6c9d-42e2-93f8-08d5221ba3ba,,,93544,1,,,Do You: Assets or Content? Register Now!,,,,Originating,,,,S:AMA=SUM|v=0|action=|error=|atch=0;S:AMA=EV|engine=M|v=0|sig=|name=|file=;S:CompCost=|AMA=0|ETR=0;S:DeliveryPriority=Normal;;
2017-11-02T18:00:45.244Z,,,,elijah,08D5221999748E4E;2017-11-02T18:00:45.088Z;0,ELIJAH\Default ELIJAH,SMTP,RECEIVE,140574279598083,<31a9f65c5b4948e0a1c6035fba7ca94a@225508597>,6218517b-9dd6-4153-f229-08d5221ba3db,,,109984,1,,,Hurry — snag a budget-friendly home for the holidays!,,,0cI: ,Originating,,,,;S:ProxiedClientIPAddress=;;;S:DeliveryPriority=Normal;;
2017-11-02T18:00:45.276Z,,,,elijah,/o=mydomain/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Recipients/cn=cquedzuweit,,ROUTING,RESOLVE,140574279598083,<31a9f65c5b4948e0a1c6035fba7ca94a@225508597>,6218517b-9dd6-4153-f229-08d5221ba3db,,,110188,1,,,Hurry — snag a budget-friendly home for the holidays!,,,,Originating,,,,S:DeliveryPriority=Normal;;
2017-11-02T18:00:45.309Z,,elijah,,,,,AGENT,AGENTINFO,140574279598083,<31a9f65c5b4948e0a1c6035fba7ca94a@225508597>,6218517b-9dd6-4153-f229-08d5221ba3db,,,114041,1,,,Hurry — snag a budget-friendly home for the holidays!,,,,Originating,,,,S:AMA=SUM|v=0|action=|error=|atch=0;S:AMA=EV|engine=M|v=0|sig=|name=|file=;S:CompCost=|AMA=0|ETR=0;S:DeliveryPriority=Normal;;
2017-11-02T18:00:46.229Z,,,,elijah,No suitable shadow servers,,SMTP,HAREDIRECTFAIL,140574279598084,<>,32f7b426-841e-433b-111a-08d5221ba47e,,,11136,1,,,AIM Notes - Correspondence,,,,Originating,,,,S:DeliveryPriority=Normal;
2017-11-02T18:00:46.338Z,,,,elijah,08D5221999748E4F;2017-11-02T18:00:46.197Z;0,ELIJAH\Default ELIJAH,SMTP,RECEIVE,140574279598084,<>,32f7b426-841e-433b-111a-08d5221ba47e,,,11136,1,,,AIM Notes - Correspondence,,,0cI: ,Originating,,,fe80::97d:771a:ed09:476%12,;S:DeliveryPriority=Normal;
2017-11-02T18:00:46.385Z,,elijah,,,,,AGENT,AGENTINFO,140574279598084,<>,32f7b426-841e-433b-111a-08d5221ba47e,,,15605,1,,,AIM Notes - Correspondence,,,,Originating,,,fe80::97d:771a:ed09:476%12,S:AMA=SUM|v=0|action=|error=|atch=0;S:AMA=EV|engine=M|v=0|sig=|name=|file=;S:CompCost=|AMA=0|ETR=0;S:DeliveryPriority=Normal;
2017-11-02T18:01:08.463Z,,,,elijah,No suitable shadow servers,,SMTP,HAREDIRECTFAIL,140574279598085,<>,c345557f-653d-452f-831e-08d5221bb1c3,,,11029,1,,,Expert Comment: Exchange 2013 just stopped receiving emails,,,,Originating,,,,S:DeliveryPriority=Normal;;
2017-11-02T18:01:08.572Z,,,,elijah,08D5221999748E4E;2017-11-02T18:00:45.088Z;0,ELIJAH\Default ELIJAH,SMTP,RECEIVE,140574279598085,<>,c345557f-653d-452f-831e-08d5221bb1c3,,,11029,1,,,Expert Comment: Exchange 2013 just stopped receiving emails,,,0cI: ,Originating,,,,;S:ProxiedClientIPAddress=;;;S:DeliveryPriority=Normal;;
2017-11-02T18:01:08.651Z,,elijah,,,,,AGENT,AGENTINFO,140574279598085,<>,c345557f-653d-452f-831e-08d5221bb1c3,,,14178,1,,,Expert Comment: Exchange 2013 just stopped receiving emails,,,,Originating,,,,S:AMA=SUM|v=0|action=|error=|atch=0;S:AMA=EV|engine=M|v=0|sig=|name=|file=;S:CompCost=|AMA=0|ETR=0;S:DeliveryPriority=Normal;;
2017-11-02T18:02:04.963Z,,,,elijah,No suitable shadow servers,,SMTP,HAREDIRECTFAIL,140574279598086,<>,87822d36-9dda-4578-beed-08d5221bd370,,,12760,1,,,Re: Environmental Questionnaires,,,,Originating,,,,S:DeliveryPriority=Normal;
2017-11-02T18:02:05.088Z,,,,elijah,08D5221999748E4E;2017-11-02T18:00:45.088Z;0,ELIJAH\Default ELIJAH,SMTP,RECEIVE,140574279598086,<>,87822d36-9dda-4578-beed-08d5221bd370,,,12760,1,,,Re: Environmental Questionnaires,,,0cI: ,Originating,,,,;S:ProxiedClientIPAddress=;;;S:DeliveryPriority=Normal;
DanNetwork EngineerAuthor Commented:
in regards to the pop3 and imap4 sections, shouldn't those just be "all available IP addresses", as I think that's setting who has access to email the exchange server, right?

DanNetwork EngineerAuthor Commented:
Im going to uninstall the windows updates
DanNetwork EngineerAuthor Commented:
sweet, after I added the DNS entries, emails are now coming in, but I had not seen that, and restarted the server, ouch  :(
Oh well, at least I believe it's fixed, I'll see what happens after the restart.
Hemil AquinoNetwork Security EngineerCommented:
As I said it's just dns binding.

It will be ok afterwards
DanNetwork EngineerAuthor Commented:
yes, thanks, it's working now, but the problem is, all the emails from 6 am to 11:50 am are gone, how do I get all those emails people sent us to come in?
Hemil AquinoNetwork Security EngineerCommented:
Emails have a 1 hour TTL to be delivered. If it doesn't reach the destination will be dropped.

So you won't get those email.
Now what I can recommend to you is eat a third party email continuity and filter to hold your emails if it something happen to your exchange.

This company provides good service.
DanNetwork EngineerAuthor Commented:
so besides they check for viruses, I suppose we can have them store our emails for days/weeks, before they are deleted, just in case something like this happens again?
DanNetwork EngineerAuthor Commented:
But I don't think management wants another company to have access to all our emails.
Hemil AquinoNetwork Security EngineerCommented:
All the incoming email will be filtered by spam, virus and whatnot.

You need to have your backup on point in your exchange in case people delete something you can recover it.
DanNetwork EngineerAuthor Commented:
we're already doing backup, through a datacenter.
Hemil AquinoNetwork Security EngineerCommented:
So you're good. Just get the filter service it's cheap
DanNetwork EngineerAuthor Commented:
thanks guys for helping me get this fixed.
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today

From novice to tech pro — start learning today.