Solved

Exchange 2010 Stretched DAG Copy Fails

Posted on 2013-06-06
16
619 Views
Last Modified: 2013-06-16
We've got Exchange 2010 SP3 in a 2 node active/active DAG stretched across 2 locations (350 miles apart, connected by 100 meg link) and every time I add a database copy, on any of our 20 databases, it fails with either "a log file missing on the active copy" or a "source-side 0xfffffae7" error.

If I run Update-MailboxDatabaseCopy -DeleteExistingFiles it will work, but only directly after a backup has run...if I try to seed a copy the next day, it fails.

Any clues as to why my window of opportunity is right after a backup?
Thanks!
0
Comment
Question by:exchangeedg
  • 9
  • 7
16 Comments
 
LVL 42

Expert Comment

by:Amit
ID: 39226244
Can you run and post results for below command

Test-Servicehealth
Test-replicationhealth
0
 

Author Comment

by:exchangeedg
ID: 39226293
Test-ServiceHealth:

Role                                     : Mailbox Server Role
RequiredServicesRunning : True
ServicesRunning                 : {IISAdmin, MSExchangeADTopology, MSExchangeIS, MSExchangeMailboxAssistants, MSExchangeMailSubmission, MSExchangeRepl, MSExchangeRPC, MSExchangeSA, MSExchangeSearch, MSExchangeServiceHost, MSExchangeThrottling, MSExchangeTransportLogSearch, W3Svc, WinRM}
ServicesNotRunning            : {}

Test-replicationhealth:


Server               Check                              Result     Error                                                            
------                   -----                                  ------        -----                                                            
HOMBX1          ClusterService                 Passed                                                                      
HOMBX1          ReplayService                  Passed                                                                      
HOMBX1          ActiveManager                 Passed                                                                      
HOMBX1          TasksRpcListener             Passed                                                                      
HOMBX1          TcpListener                       Passed                                                                      
HOMBX1          ServerLocatorService       Passed                                                                      
HOMBX1          DagMembersUp               Passed                                                                      
HOMBX1          ClusterNetwork                Passed                                                                      
HOMBX1          QuorumGroup                 Passed                                                                      
HOMBX1          FileShareQuorum            Passed                                                                      
HOMBX1          DBCopySuspended          Passed                                                                      
HOMBX1          DBCopy                             Failed         Error : Continuous Replication for database 'LAFAYETTE\HOMBX1' is in a 'Failed' state on machine 'HOMBX1'. The specific message is: The required log file 30798 for LAFAYETTE\HOMBX1 is missing on the active copy. If you removed the log file, please replace it. If the log file is lost, the database copy will need to be reseeded using Update-MailboxDatabaseCopy.
HOMBX1          DBInitializing                     Passed                                                                      
HOMBX1          DBDisconnected                Passed                                                                      
HOMBX1          DBLogCopyKeepingUp      Passed                                                                      
HOMBX1          DBLogReplayKeepingUp   Passed
0
 
LVL 42

Expert Comment

by:Amit
ID: 39226313
Have you excluded Exchange binaries, folders and logs from the AV scanning. If not, please do so first. AV are known for deleting log files. Check AV logs also, if you can see any logs deleted by AV.
0
 

Author Comment

by:exchangeedg
ID: 39226320
We don't have A/V on any of the mail servers
0
 
LVL 42

Expert Comment

by:Amit
ID: 39226333
Are you sure? You don't have any Antivirus? If yes, then you are running at a virus risk. If might be possible that you server is virus infected. Install AV ASAP and scan your servers.
0
 

Author Comment

by:exchangeedg
ID: 39226520
We have the Barracuda A/V Agent running, since there's little reason for file-level scanning on Exchange. Anyhow, I highly doubt an infection would cause the DAG copy issues we are having.

Note: I have tried with the 'cuda agent disabled as well.
0
 
LVL 42

Expert Comment

by:Amit
ID: 39226525
Ok, run Cluster Validation Wizard using cluster snap-in and check if any error's shows up.
0
 

Author Comment

by:exchangeedg
ID: 39226595
This is the only Warning I see of note:

-Nodes are not consistently configured with IPv4 and/or IPv6 addresses on network adapters
that are usable by the cluster.

-Node HOMBX1.edg.net is configured with IP addresses from protocol IPv4 only.

-Node NOMBX1.edg.net is configured with IP addresses from protocol IPv4 and IPv6.
0
Is Your AD Toolbox Looking More Like a Toybox?

Managing Active Directory can get complicated.  Often, the native tools for managing AD are just not up to the task.  The largest Active Directory installations in the world have relied on one tool to manage their day-to-day administration tasks: Hyena. Start your trial today.

 
LVL 42

Expert Comment

by:Amit
ID: 39226633
Error indicates log file missing. So, reseed is the only option to fix it. Next, are you taking Passive DB backup?
0
 
LVL 42

Expert Comment

by:Amit
ID: 39226636
Also check if VSS writers are stable.
0
 

Author Comment

by:exchangeedg
ID: 39226648
Reseed only works directly after the backup has run.
We are backing up the passive copy, using Commvault, with no errors.
0
 
LVL 42

Expert Comment

by:Amit
ID: 39226680
In this case, i would disable the backup for a day and see if same issue happens again, if not then you need to focus on backup software, better to open a case with backup vendor.
0
 

Author Comment

by:exchangeedg
ID: 39226693
Alright I'll try that, thanks
0
 

Author Comment

by:exchangeedg
ID: 39229185
The copy on that database from yesterday completed, but all the others I've tried today failed with the same error.
I've opened a case with MS PSS...we're based in New Orleans and kinda need to get the DAG healthy before the storms start rolling in.
0
 

Accepted Solution

by:
exchangeedg earned 0 total points
ID: 39237879
PSS had me dismount each DB, move the logs to a different folder, then remount. After that they all seeded correctly.
Not sure why all the DB's had log file corruption, but its fixed now.
0
 

Author Closing Comment

by:exchangeedg
ID: 39251044
Had to contact MS support to rectify the situation.
0

Featured Post

Can’t get the mobile email signature right?

Not having any luck when trying to create an email signature for mobile devices? Does the formatting keep messing up? Make sure you have great email signatures on all devices by using Exclaimer Cloud - Signatures for Office 365.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

We are happy to announce a brand new addition to our line of acclaimed email signature management products – CodeTwo Email Signatures for Office 365.
This article aims to explain the working of CircularLogArchiver. This tool was designed to solve the buildup of log file in cases where systems do not support circular logging or where circular logging is not enabled
In this video we show how to create an Address List in Exchange 2013. We show this process by using the Exchange Admin Center. Log into Exchange Admin Center.: First we need to log into the Exchange Admin Center. Navigate to the Organization >> Ad…
To show how to create a transport rule in Exchange 2013. We show this process by using the Exchange Admin Center. Log into Exchange Admin Center.: First we need to log into the Exchange Admin Center. Navigate to the Mail Flow >> Rules tab.:  To cr…

895 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

13 Experts available now in Live!

Get 1:1 Help Now