Solved

Exchange 2010 Stretched DAG Copy Fails

Posted on 2013-06-06
16
618 Views
Last Modified: 2013-06-16
We've got Exchange 2010 SP3 in a 2 node active/active DAG stretched across 2 locations (350 miles apart, connected by 100 meg link) and every time I add a database copy, on any of our 20 databases, it fails with either "a log file missing on the active copy" or a "source-side 0xfffffae7" error.

If I run Update-MailboxDatabaseCopy -DeleteExistingFiles it will work, but only directly after a backup has run...if I try to seed a copy the next day, it fails.

Any clues as to why my window of opportunity is right after a backup?
Thanks!
0
Comment
Question by:exchangeedg
  • 9
  • 7
16 Comments
 
LVL 41

Expert Comment

by:Amit
Comment Utility
Can you run and post results for below command

Test-Servicehealth
Test-replicationhealth
0
 

Author Comment

by:exchangeedg
Comment Utility
Test-ServiceHealth:

Role                                     : Mailbox Server Role
RequiredServicesRunning : True
ServicesRunning                 : {IISAdmin, MSExchangeADTopology, MSExchangeIS, MSExchangeMailboxAssistants, MSExchangeMailSubmission, MSExchangeRepl, MSExchangeRPC, MSExchangeSA, MSExchangeSearch, MSExchangeServiceHost, MSExchangeThrottling, MSExchangeTransportLogSearch, W3Svc, WinRM}
ServicesNotRunning            : {}

Test-replicationhealth:


Server               Check                              Result     Error                                                            
------                   -----                                  ------        -----                                                            
HOMBX1          ClusterService                 Passed                                                                      
HOMBX1          ReplayService                  Passed                                                                      
HOMBX1          ActiveManager                 Passed                                                                      
HOMBX1          TasksRpcListener             Passed                                                                      
HOMBX1          TcpListener                       Passed                                                                      
HOMBX1          ServerLocatorService       Passed                                                                      
HOMBX1          DagMembersUp               Passed                                                                      
HOMBX1          ClusterNetwork                Passed                                                                      
HOMBX1          QuorumGroup                 Passed                                                                      
HOMBX1          FileShareQuorum            Passed                                                                      
HOMBX1          DBCopySuspended          Passed                                                                      
HOMBX1          DBCopy                             Failed         Error : Continuous Replication for database 'LAFAYETTE\HOMBX1' is in a 'Failed' state on machine 'HOMBX1'. The specific message is: The required log file 30798 for LAFAYETTE\HOMBX1 is missing on the active copy. If you removed the log file, please replace it. If the log file is lost, the database copy will need to be reseeded using Update-MailboxDatabaseCopy.
HOMBX1          DBInitializing                     Passed                                                                      
HOMBX1          DBDisconnected                Passed                                                                      
HOMBX1          DBLogCopyKeepingUp      Passed                                                                      
HOMBX1          DBLogReplayKeepingUp   Passed
0
 
LVL 41

Expert Comment

by:Amit
Comment Utility
Have you excluded Exchange binaries, folders and logs from the AV scanning. If not, please do so first. AV are known for deleting log files. Check AV logs also, if you can see any logs deleted by AV.
0
 

Author Comment

by:exchangeedg
Comment Utility
We don't have A/V on any of the mail servers
0
 
LVL 41

Expert Comment

by:Amit
Comment Utility
Are you sure? You don't have any Antivirus? If yes, then you are running at a virus risk. If might be possible that you server is virus infected. Install AV ASAP and scan your servers.
0
 

Author Comment

by:exchangeedg
Comment Utility
We have the Barracuda A/V Agent running, since there's little reason for file-level scanning on Exchange. Anyhow, I highly doubt an infection would cause the DAG copy issues we are having.

Note: I have tried with the 'cuda agent disabled as well.
0
 
LVL 41

Expert Comment

by:Amit
Comment Utility
Ok, run Cluster Validation Wizard using cluster snap-in and check if any error's shows up.
0
 

Author Comment

by:exchangeedg
Comment Utility
This is the only Warning I see of note:

-Nodes are not consistently configured with IPv4 and/or IPv6 addresses on network adapters
that are usable by the cluster.

-Node HOMBX1.edg.net is configured with IP addresses from protocol IPv4 only.

-Node NOMBX1.edg.net is configured with IP addresses from protocol IPv4 and IPv6.
0
Top 6 Sources for Identifying Threat Actor TTPs

Understanding your enemy is essential. These six sources will help you identify the most popular threat actor tactics, techniques, and procedures (TTPs).

 
LVL 41

Expert Comment

by:Amit
Comment Utility
Error indicates log file missing. So, reseed is the only option to fix it. Next, are you taking Passive DB backup?
0
 
LVL 41

Expert Comment

by:Amit
Comment Utility
Also check if VSS writers are stable.
0
 

Author Comment

by:exchangeedg
Comment Utility
Reseed only works directly after the backup has run.
We are backing up the passive copy, using Commvault, with no errors.
0
 
LVL 41

Expert Comment

by:Amit
Comment Utility
In this case, i would disable the backup for a day and see if same issue happens again, if not then you need to focus on backup software, better to open a case with backup vendor.
0
 

Author Comment

by:exchangeedg
Comment Utility
Alright I'll try that, thanks
0
 

Author Comment

by:exchangeedg
Comment Utility
The copy on that database from yesterday completed, but all the others I've tried today failed with the same error.
I've opened a case with MS PSS...we're based in New Orleans and kinda need to get the DAG healthy before the storms start rolling in.
0
 

Accepted Solution

by:
exchangeedg earned 0 total points
Comment Utility
PSS had me dismount each DB, move the logs to a different folder, then remount. After that they all seeded correctly.
Not sure why all the DB's had log file corruption, but its fixed now.
0
 

Author Closing Comment

by:exchangeedg
Comment Utility
Had to contact MS support to rectify the situation.
0

Featured Post

How your wiki can always stay up-to-date

Quip doubles as a “living” wiki and a project management tool that evolves with your organization. As you finish projects in Quip, the work remains, easily accessible to all team members, new and old.
- Increase transparency
- Onboard new hires faster
- Access from mobile/offline

Join & Write a Comment

We are happy to announce a brand new addition to our line of acclaimed email signature management products – CodeTwo Email Signatures for Office 365.
Marketers need statistics and metrics like everybody else needs oxygen. In this article we explain how to enable marketing campaign statistics for Microsoft Exchange mail.
In this video we show how to create an email address policy in Exchange 2013. We show this process by using the Exchange Admin Center. Log into Exchange Admin Center.:  First we need to log into the Exchange Admin Center. Navigate to the Mail Flow…
To show how to create a transport rule in Exchange 2013. We show this process by using the Exchange Admin Center. Log into Exchange Admin Center.: First we need to log into the Exchange Admin Center. Navigate to the Mail Flow >> Rules tab.:  To cr…

771 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

14 Experts available now in Live!

Get 1:1 Help Now