Link to home
Start Free TrialLog in
Avatar of Dan
DanFlag for United States of America

asked on

Exchange 2013 just stopped receiving emails

I installed windows updates this morning and right after that, exchange now longer is receiving emails.  Outbound is fine.  Here's what I did so far.
1. Rebooted the server twice.
2. Individually restarted the transport and IS services.
3. I checked to make sure the databases are mounted.
4. I can log into the ECP just fine, all receive and outbound connectors are there.
5. Checked on mxtoolbox, and everything is fine, no DNS changes made.
6. I checked my firewall, and it's receiving the external emails and it's passing the email to exchange.

Short of uninstalling the windows updates, not sure what else to do.
Avatar of Dan
Dan
Flag of United States of America image

ASKER

I tried to access the queue viewer, but I get this message:

User generated image
Avatar of Dan

ASKER

after pressing ok, it just keeps popping up every 10 seconds or so
Avatar of Dan

ASKER

now after trying to click on different options in the event viewer, I get this message
User generated image
Has anyone encountered this strange behavior before?
You are having issue with the transport services.  Are they up and running? Did you change any IP address?
Avatar of Dan

ASKER

I ran this test: https://testconnectivity.microsoft.com

And here's where it failed, and the error it gave me.

Additional Details
       
The server returned status code 451 - Error in processing. The server response was: Temporary local problem, please try again!
Exception details:
Message: Error in processing. The server response was: Temporary local problem, please try again!
Type: System.Net.Mail.SmtpException
Stack trace:
at System.Net.Mail.DataStopCommand.CheckResponse(SmtpStatusCode statusCode, String serverResponse)
at System.Net.Mail.DataStopCommand.Send(SmtpConnection conn)
at System.Net.Mail.SmtpClient.Send(MailMessage message)
at Microsoft.Exchange.Tools.ExRca.Tests.SmtpMessageTest.PerformTestReally()
Elapsed Time: 1698 ms.
Avatar of Dan

ASKER

yes, the transport service is up and running, and no, I have not made any changes to any IP addresses on the server
I have restarted the transport service manually as well 3 or 4 times
Avatar of Dan

ASKER

looks like internal emails are not working either
Avatar of Scott C
Outgoing is working but incoming is not.  Sounds like BackPressure.

Check your drive space.  If you are running out of space, Exchange will protect itself by no allowing incoming emails.

Look in your Application Logs for 15004, 15005, 15006, and/or 15007.  If you see those then it's backpressure.  You'll need to free up space.

Also make sure all Exchange services are running.
Avatar of Dan

ASKER

so I can send external emails, but I can't send internal emails
Try rebooting the Exchange server.  Sometimes an update will be installed, but sort of hangs Exchange until a reboot is performed and the update can finish installing.
Try this:

go to this folder: C:\Program Files\Microsoft\Exchange Server\V15\TransportRoles\data

You will see a folder called "Queue"
Rename that folder and reboot both transport services and see if it works
Avatar of Dan

ASKER

I have over 200GB of space on my C drive and over 500GB of free space on my E drive, database drive

alll services are running

Checking event viewer now
Avatar of Dan

ASKER

I have restarted the server 3 times, and still no go
With that much free space it isn't backpressure then.  What version and patch level are you at?

Run "Get-ExchangeServer | Format-List Name, Edition, AdminDisplayVersion" in and Exchange PS command window.

You should be at least CU17 or CU18.
SOLUTION
Avatar of Scott C
Scott C
Flag of United States of America image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of Dan

ASKER

when I type that command, I get this error: "the term 'get-exchangeserver' is not recognized as the name or operable program"
Avatar of Dan

ASKER

all my receive connectors are enabled
Did you try this?

go to this folder: C:\Program Files\Microsoft\Exchange Server\V15\TransportRoles\data

You will see a folder called "Queue"
Rename that folder and reboot both transport services and see if it works
Avatar of Dan

ASKER

Im seeing event ID 40025 numerous times in my app log, even before I did the windows updates.  Is that a reason to be concerned?
Avatar of Dan

ASKER

ill try that now
Avatar of Dan

ASKER

I just tried that, and a new queue folder was automatically created.

I'm waiting now to see if emails start coming in, nothing yet, but it's only been about 1 min.
Avatar of Dan

ASKER

it's been about 3, no emails still
open the queue-viewer and see what you have, andy errors?
Avatar of Dan

ASKER

I opened the queue-viewer and i get this message: "the term get-queue is not recognized as the name of a cmdlet, etc......
I think something is wrong in your transport services. I had this issue before.
Here is what you need to check

1- Are you using IMAP or POP3 services? if you do then check the binding of those services and make sure you have the right IP address.
2- Check your SMTP connectors see if you have different IP address.
3- Check the DNS as well, on the ECP panel go to Server>Server>Double click to name of the server DNS lookup and also IMAP and POP3.

But honestly you problem it's your transport rule
Avatar of Dan

ASKER

So I ran this command: Add-PSSnapin Microsoft.Exchange.Management.PowerShell.SnapIn;
and that allowed me to actually type the get- commands

Why is this happening, as I ran across this at least 3 or 4 months ago, and it's been happening now for over a year now.

I'm running the standard edition
Version 15.0 (build 1156.6)
Avatar of Dan

ASKER

give me a min, let me check  what you just said to do
Avatar of Dan

ASKER

Im using both pop and imap
Avatar of Dan

ASKER

where do I check the bindings?
Login to the ECP Servers>Name of the server>DNS lookup> and you will see the IP address binding the ports.
Do the same with IMAP and POP3
Avatar of Dan

ASKER

in ECP, under servers, after I edit my server, both pop3 and imap4 , have "all available IPv4 and IPv6" for TLS and SSL for the connections
Avatar of Dan

ASKER

under DNS lookups, for both external and internal, it just says "all network adapters, all available IPv4"
ASKER CERTIFIED SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of Dan

ASKER

I looked into the message tracking log and here's a snippit of it, what is a shadow server?

I looked at the other logs and this started right after windows updates today

#Software: Microsoft Exchange Server
#Version: 15.00.1156.000
#Log-type: Message Tracking Log
#Date: 2017-11-02T18:00:40.526Z
#Fields: date-time,client-ip,client-hostname,server-ip,server-hostname,source-context,connector-id,source,event-id,internal-message-id,message-id,network-message-id,recipient-address,recipient-status,total-bytes,recipient-count,related-recipient-address,reference,message-subject,sender-address,return-path,message-info,directionality,tenant-id,original-client-ip,original-server-ip,custom-data
2017-11-02T18:00:40.526Z,,,,elijah,No suitable shadow servers,,SMTP,HAREDIRECTFAIL,140574279598081,<bounce--euubtsjavex9iv0u@send.smartbrief.com>,9b9dcae1-0f34-4387-15e3-08d5221ba113,wleman@mydomain.org,,86243,1,,,Entercom makes deals with radio groups as CBS Radio merger approaches,nab@smartbrief.com,newsletters--nab@send.smartbrief.com,,Originating,,,,S:DeliveryPriority=Normal;S:OriginalFromAddress=newsletters--nab@send.smartbrief.com;S:AccountForest=mydomain.org
2017-11-02T18:00:40.635Z,192.168.100.131,ELIJAH.mydomain.org,192.168.100.131,elijah,08D5221999748E3F;2017-11-02T17:54:15.999Z;8,ELIJAH\Default ELIJAH,SMTP,RECEIVE,140574279598081,<bounce--euubtsjavex9iv0u@send.smartbrief.com>,9b9dcae1-0f34-4387-15e3-08d5221ba113,wleman@mydomain.org,,86243,1,,,Entercom makes deals with radio groups as CBS Radio merger approaches,nab@smartbrief.com,newsletters--nab@send.smartbrief.com,0cI: ,Originating,,192.168.100.3,192.168.100.131,S:FirstForestHop=ELIJAH.mydomain.org;S:ProxiedClientIPAddress=192.168.100.3;S:ProxiedClientHostname=mail.mydomain.org;S:ProxyHop1=ELIJAH.mydomain.org(192.168.100.131);S:DeliveryPriority=Normal;S:OriginalFromAddress=newsletters--nab@send.smartbrief.com;S:AccountForest=mydomain.org
2017-11-02T18:00:40.713Z,,elijah,,,,,AGENT,AGENTINFO,140574279598081,<bounce--euubtsjavex9iv0u@send.smartbrief.com>,9b9dcae1-0f34-4387-15e3-08d5221ba113,wleman@mydomain.org,,93441,1,,,Entercom makes deals with radio groups as CBS Radio merger approaches,nab@smartbrief.com,newsletters--nab@send.smartbrief.com,,Originating,,192.168.100.3,192.168.100.131,S:AMA=SUM|v=0|action=|error=|atch=0;S:AMA=EV|engine=M|v=0|sig=1.257.24.0|name=|file=;S:CompCost=|AMA=0|ETR=0;S:DeliveryPriority=Normal;S:OriginalFromAddress=newsletters--nab@send.smartbrief.com;S:AccountForest=mydomain.org
2017-11-02T18:00:44.932Z,,,,elijah,No suitable shadow servers,,SMTP,HAREDIRECTFAIL,140574279598082,<635f1f4fc56e72995c84c1495.cb5585e5f4.20171102175958.522609ee09.83f00f91@mail50.atl31.mcdlv.net>,527b74f2-6c9d-42e2-93f8-08d5221ba3ba,dougg@mydomain.org,,89434,1,,,Do You: Assets or Content? Register Now!,info@insightxnetwork.com,bounce-mc.us14_66262305.419439-dougg=mydomain.org@mail50.atl31.mcdlv.net,,Originating,,,,S:DeliveryPriority=Normal;S:OriginalFromAddress=bounce-mc.us14_66262305.419439-dougg=mydomain.org@mail50.atl31.mcdlv.net;S:AccountForest=mydomain.org
2017-11-02T18:00:45.107Z,192.168.100.131,ELIJAH.mydomain.org,192.168.100.131,elijah,08D5221999748E3F;2017-11-02T17:54:15.999Z;8,ELIJAH\Default ELIJAH,SMTP,RECEIVE,140574279598082,<635f1f4fc56e72995c84c1495.cb5585e5f4.20171102175958.522609ee09.83f00f91@mail50.atl31.mcdlv.net>,527b74f2-6c9d-42e2-93f8-08d5221ba3ba,dougg@mydomain.org,,89434,1,,,Do You: Assets or Content? Register Now!,info@insightxnetwork.com,bounce-mc.us14_66262305.419439-dougg=mydomain.org@mail50.atl31.mcdlv.net,0cI: ,Originating,,192.168.100.3,192.168.100.131,S:FirstForestHop=ELIJAH.mydomain.org;S:ProxiedClientIPAddress=192.168.100.3;S:ProxiedClientHostname=mail.mydomain.org;S:ProxyHop1=ELIJAH.mydomain.org(192.168.100.131);S:DeliveryPriority=Normal;S:OriginalFromAddress=bounce-mc.us14_66262305.419439-dougg=mydomain.org@mail50.atl31.mcdlv.net;S:AccountForest=mydomain.org
2017-11-02T18:00:45.135Z,,,,elijah,/o=mydomain/ou=First Administrative Group/cn=Recipients/cn=DougG,,ROUTING,RESOLVE,140574279598082,<635f1f4fc56e72995c84c1495.cb5585e5f4.20171102175958.522609ee09.83f00f91@mail50.atl31.mcdlv.net>,527b74f2-6c9d-42e2-93f8-08d5221ba3ba,DGarcia@mydomain.org,,89628,1,dougg@mydomain.org,,Do You: Assets or Content? Register Now!,info@insightxnetwork.com,bounce-mc.us14_66262305.419439-dougg=mydomain.org@mail50.atl31.mcdlv.net,,Originating,,,,S:DeliveryPriority=Normal;S:OriginalFromAddress=bounce-mc.us14_66262305.419439-dougg=mydomain.org@mail50.atl31.mcdlv.net;S:AccountForest=mydomain.org
2017-11-02T18:00:45.135Z,,,,elijah,No suitable shadow servers,,SMTP,HAREDIRECTFAIL,140574279598083,<31a9f65c5b4948e0a1c6035fba7ca94a@225508597>,6218517b-9dd6-4153-f229-08d5221ba3db,cathyq@mydomain.org,,109984,1,,,Hurry — snag a budget-friendly home for the holidays!,HomeAway@elq.homeaway.com,feedback@elq-trv.haspf.com,,Originating,,,,S:DeliveryPriority=Normal;S:OriginalFromAddress=feedback@elq-trv.haspf.com;S:AccountForest=mydomain.org
2017-11-02T18:00:45.198Z,,elijah,,,,,AGENT,AGENTINFO,140574279598082,<635f1f4fc56e72995c84c1495.cb5585e5f4.20171102175958.522609ee09.83f00f91@mail50.atl31.mcdlv.net>,527b74f2-6c9d-42e2-93f8-08d5221ba3ba,DGarcia@mydomain.org,,93544,1,,,Do You: Assets or Content? Register Now!,info@insightxnetwork.com,bounce-mc.us14_66262305.419439-dougg=mydomain.org@mail50.atl31.mcdlv.net,,Originating,,192.168.100.3,192.168.100.131,S:AMA=SUM|v=0|action=|error=|atch=0;S:AMA=EV|engine=M|v=0|sig=1.257.24.0|name=|file=;S:CompCost=|AMA=0|ETR=0;S:DeliveryPriority=Normal;S:OriginalFromAddress=bounce-mc.us14_66262305.419439-dougg=mydomain.org@mail50.atl31.mcdlv.net;S:AccountForest=mydomain.org
2017-11-02T18:00:45.244Z,192.168.100.131,ELIJAH.mydomain.org,192.168.100.131,elijah,08D5221999748E4E;2017-11-02T18:00:45.088Z;0,ELIJAH\Default ELIJAH,SMTP,RECEIVE,140574279598083,<31a9f65c5b4948e0a1c6035fba7ca94a@225508597>,6218517b-9dd6-4153-f229-08d5221ba3db,cathyq@mydomain.org,,109984,1,,,Hurry — snag a budget-friendly home for the holidays!,HomeAway@elq.homeaway.com,feedback@elq-trv.haspf.com,0cI: ,Originating,,192.168.100.3,192.168.100.131,S:FirstForestHop=ELIJAH.mydomain.org;S:ProxiedClientIPAddress=192.168.100.3;S:ProxiedClientHostname=mail.mydomain.org;S:ProxyHop1=ELIJAH.mydomain.org(192.168.100.131);S:DeliveryPriority=Normal;S:OriginalFromAddress=feedback@elq-trv.haspf.com;S:AccountForest=mydomain.org
2017-11-02T18:00:45.276Z,,,,elijah,/o=mydomain/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Recipients/cn=cquedzuweit,,ROUTING,RESOLVE,140574279598083,<31a9f65c5b4948e0a1c6035fba7ca94a@225508597>,6218517b-9dd6-4153-f229-08d5221ba3db,cquedzuweit@mydomain.org,,110188,1,cathyq@mydomain.org,,Hurry — snag a budget-friendly home for the holidays!,HomeAway@elq.homeaway.com,feedback@elq-trv.haspf.com,,Originating,,,,S:DeliveryPriority=Normal;S:OriginalFromAddress=feedback@elq-trv.haspf.com;S:AccountForest=mydomain.org
2017-11-02T18:00:45.309Z,,elijah,,,,,AGENT,AGENTINFO,140574279598083,<31a9f65c5b4948e0a1c6035fba7ca94a@225508597>,6218517b-9dd6-4153-f229-08d5221ba3db,cquedzuweit@mydomain.org,,114041,1,,,Hurry — snag a budget-friendly home for the holidays!,HomeAway@elq.homeaway.com,feedback@elq-trv.haspf.com,,Originating,,192.168.100.3,192.168.100.131,S:AMA=SUM|v=0|action=|error=|atch=0;S:AMA=EV|engine=M|v=0|sig=1.257.24.0|name=|file=;S:CompCost=|AMA=0|ETR=0;S:DeliveryPriority=Normal;S:OriginalFromAddress=feedback@elq-trv.haspf.com;S:AccountForest=mydomain.org
2017-11-02T18:00:46.229Z,,,,elijah,No suitable shadow servers,,SMTP,HAREDIRECTFAIL,140574279598084,<9e4670456b4f4b429994ef8048b04f5e@elijah.mydomain.org>,32f7b426-841e-433b-111a-08d5221ba47e,mhaas@mydomain.org,,11136,1,,,AIM Notes - Correspondence,dcossentine@mydomain.org,dcossentine@mydomain.org,,Originating,,,,S:DeliveryPriority=Normal;S:AccountForest=mydomain.org
2017-11-02T18:00:46.338Z,192.168.100.131,ELIJAH.mydomain.org,192.168.100.131,elijah,08D5221999748E4F;2017-11-02T18:00:46.197Z;0,ELIJAH\Default ELIJAH,SMTP,RECEIVE,140574279598084,<9e4670456b4f4b429994ef8048b04f5e@elijah.mydomain.org>,32f7b426-841e-433b-111a-08d5221ba47e,mhaas@mydomain.org,,11136,1,,,AIM Notes - Correspondence,dcossentine@mydomain.org,dcossentine@mydomain.org,0cI: ,Originating,,192.168.102.32,fe80::97d:771a:ed09:476%12,S:FirstForestHop=ELIJAH.mydomain.org;S:DeliveryPriority=Normal;S:AccountForest=mydomain.org
2017-11-02T18:00:46.385Z,,elijah,,,,,AGENT,AGENTINFO,140574279598084,<9e4670456b4f4b429994ef8048b04f5e@elijah.mydomain.org>,32f7b426-841e-433b-111a-08d5221ba47e,mhaas@mydomain.org,,15605,1,,,AIM Notes - Correspondence,dcossentine@mydomain.org,dcossentine@mydomain.org,,Originating,,192.168.102.32,fe80::97d:771a:ed09:476%12,S:AMA=SUM|v=0|action=|error=|atch=0;S:AMA=EV|engine=M|v=0|sig=1.257.24.0|name=|file=;S:CompCost=|AMA=0|ETR=0;S:DeliveryPriority=Normal;S:AccountForest=mydomain.org
2017-11-02T18:01:08.463Z,,,,elijah,No suitable shadow servers,,SMTP,HAREDIRECTFAIL,140574279598085,<0100015f7de4ba9f-5456447a-7569-4aec-ba7e-42c5374b36eb-000000@email.amazonses.com>,c345557f-653d-452f-831e-08d5221bb1c3,dandries@mydomain.org,,11029,1,,,Expert Comment: Exchange 2013 just stopped receiving emails,noreply@experts-exchange.com,0100015f7de4ba9f-5456447a-7569-4aec-ba7e-42c5374b36eb-000000@amazonses.com,,Originating,,,,S:DeliveryPriority=Normal;S:OriginalFromAddress=0100015f7de4ba9f-5456447a-7569-4aec-ba7e-42c5374b36eb-000000@amazonses.com;S:AccountForest=mydomain.org
2017-11-02T18:01:08.572Z,192.168.100.131,ELIJAH.mydomain.org,192.168.100.131,elijah,08D5221999748E4E;2017-11-02T18:00:45.088Z;0,ELIJAH\Default ELIJAH,SMTP,RECEIVE,140574279598085,<0100015f7de4ba9f-5456447a-7569-4aec-ba7e-42c5374b36eb-000000@email.amazonses.com>,c345557f-653d-452f-831e-08d5221bb1c3,dandries@mydomain.org,,11029,1,,,Expert Comment: Exchange 2013 just stopped receiving emails,noreply@experts-exchange.com,0100015f7de4ba9f-5456447a-7569-4aec-ba7e-42c5374b36eb-000000@amazonses.com,0cI: ,Originating,,192.168.100.3,192.168.100.131,S:FirstForestHop=ELIJAH.mydomain.org;S:ProxiedClientIPAddress=192.168.100.3;S:ProxiedClientHostname=mail.mydomain.org;S:ProxyHop1=ELIJAH.mydomain.org(192.168.100.131);S:DeliveryPriority=Normal;S:OriginalFromAddress=0100015f7de4ba9f-5456447a-7569-4aec-ba7e-42c5374b36eb-000000@amazonses.com;S:AccountForest=mydomain.org
2017-11-02T18:01:08.651Z,,elijah,,,,,AGENT,AGENTINFO,140574279598085,<0100015f7de4ba9f-5456447a-7569-4aec-ba7e-42c5374b36eb-000000@email.amazonses.com>,c345557f-653d-452f-831e-08d5221bb1c3,dandries@mydomain.org,,14178,1,,,Expert Comment: Exchange 2013 just stopped receiving emails,noreply@experts-exchange.com,0100015f7de4ba9f-5456447a-7569-4aec-ba7e-42c5374b36eb-000000@amazonses.com,,Originating,,192.168.100.3,192.168.100.131,S:AMA=SUM|v=0|action=|error=|atch=0;S:AMA=EV|engine=M|v=0|sig=1.257.24.0|name=|file=;S:CompCost=|AMA=0|ETR=0;S:DeliveryPriority=Normal;S:OriginalFromAddress=0100015f7de4ba9f-5456447a-7569-4aec-ba7e-42c5374b36eb-000000@amazonses.com;S:AccountForest=mydomain.org
2017-11-02T18:02:04.963Z,,,,elijah,No suitable shadow servers,,SMTP,HAREDIRECTFAIL,140574279598086,<rmhvi1ebyw9y274bfsnlw8lk.1509645243115@email.android.com>,87822d36-9dda-4578-beed-08d5221bd370,mteh@mydomain.org,,12760,1,,,Re: Environmental Questionnaires,dschirmer@hiroshimadaggett.com,dschirmer@hiroshimadaggett.com,,Originating,,,,S:DeliveryPriority=Normal;S:AccountForest=mydomain.org
2017-11-02T18:02:05.088Z,192.168.100.131,ELIJAH.mydomain.org,192.168.100.131,elijah,08D5221999748E4E;2017-11-02T18:00:45.088Z;0,ELIJAH\Default ELIJAH,SMTP,RECEIVE,140574279598086,<rmhvi1ebyw9y274bfsnlw8lk.1509645243115@email.android.com>,87822d36-9dda-4578-beed-08d5221bd370,mteh@mydomain.org,,12760,1,,,Re: Environmental Questionnaires,dschirmer@hiroshimadaggett.com,dschirmer@hiroshimadaggett.com,0cI: ,Originating,,192.168.100.3,192.168.100.131,S:FirstForestHop=ELIJAH.mydomain.org;S:ProxiedClientIPAddress=192.168.100.3;S:ProxiedClientHostname=mail.mydomain.org;S:ProxyHop1=ELIJAH.mydomain.org(192.168.100.131);S:DeliveryPriority=Normal;S:AccountForest=mydomain.org
2017-1
Avatar of Dan

ASKER

in regards to the pop3 and imap4 sections, shouldn't those just be "all available IP addresses", as I think that's setting who has access to email the exchange server, right?

User generated image
Avatar of Dan

ASKER

Im going to uninstall the windows updates
Avatar of Dan

ASKER

sweet, after I added the DNS entries, emails are now coming in, but I had not seen that, and restarted the server, ouch  :(
Oh well, at least I believe it's fixed, I'll see what happens after the restart.
As I said it's just dns binding.

It will be ok afterwards
Avatar of Dan

ASKER

yes, thanks, it's working now, but the problem is, all the emails from 6 am to 11:50 am are gone, how do I get all those emails people sent us to come in?
Emails have a 1 hour TTL to be delivered. If it doesn't reach the destination will be dropped.

So you won't get those email.
Now what I can recommend to you is eat a third party email continuity and filter to hold your emails if it something happen to your exchange.

This company provides good service.
Securense.com
Avatar of Dan

ASKER

so besides they check for viruses, I suppose we can have them store our emails for days/weeks, before they are deleted, just in case something like this happens again?
Avatar of Dan

ASKER

But I don't think management wants another company to have access to all our emails.
All the incoming email will be filtered by spam, virus and whatnot.

You need to have your backup on point in your exchange in case people delete something you can recover it.
Avatar of Dan

ASKER

we're already doing backup, through a datacenter.
So you're good. Just get the filter service it's cheap
Avatar of Dan

ASKER

thanks guys for helping me get this fixed.