MS Exchange 2010  DAG second Server add errors

pathix
pathix used Ask the Experts™
on
I'm trying to setup DAG's on our new exchange 2010 organizaiton, and running int o errors.. I can create the DAG on the first exchange server, server, wait for everything to replicate to the second server, then attempt to add the second server(which is in another site, another subdomain of the forest)  and am getting the folllowing error below, anyone have any ideas ?
i've checked the local admin membership on both servers and it does contain exchange trusted subsystem group etc.

MS Exchange DAG second Server add errors
--------------------------------------------------------------------------------


here is the exchange  setup log:

add-databaseavailabiltygroupserver started on machine VA-CORP-EX1.
[2011-05-19T16:16:36] add-dagserver started
[2011-05-19T16:16:36] commandline:         $scriptCmd = {& $wrappedCmd @PSBoundParameters }
[2011-05-19T16:16:36] Option 'Identity' = 'DAG-STJ-SUM'.
[2011-05-19T16:16:36] Option 'MailboxServer' = 'PE-EXCHANGE'.
[2011-05-19T16:16:36] Option 'DatabaseAvailabilityGroupIpAddresses' = ''.
[2011-05-19T16:16:36] Option 'WhatIf' = ''.
[2011-05-19T16:16:36] Process: w3wp w3wp.exe:5796.
[2011-05-19T16:16:36] User context = 'NT AUTHORITY\SYSTEM'.
[2011-05-19T16:16:36]   Member of group 'Everyone'.
[2011-05-19T16:16:36]   Member of group 'BUILTIN\Users'.
[2011-05-19T16:16:36]   Member of group 'NT AUTHORITY\SERVICE'.
[2011-05-19T16:16:36]   Member of group 'CONSOLE LOGON'.
[2011-05-19T16:16:36]   Member of group 'NT AUTHORITY\Authenticated Users'.
[2011-05-19T16:16:36]   Member of group 'NT AUTHORITY\This Organization'.
[2011-05-19T16:16:36]   Member of group 'BUILTIN\IIS_IUSRS'.
[2011-05-19T16:16:36]   Member of group 'LOCAL'.
[2011-05-19T16:16:36]   Member of group 'IIS APPPOOL\MSExchangePowerShellAppPool'.
[2011-05-19T16:16:36]   Member of group 'BUILTIN\Administrators'.
[2011-05-19T16:16:36] Updated Progress 'Validating the parameters.' 2%.
[2011-05-19T16:16:36] Working
[2011-05-19T16:16:36] Mailbox server: value passed in = PE-EXCHANGE, mailboxServer.Name = PE-EXCHANGE, mailboxServer.Fqdn = PE-EXCHANGE.ESA.vector.dom
[2011-05-19T16:16:36] LogClussvcState: clussvc is Stopped on PE-EXCHANGE.ESA.vector.dom. Exception (if any) = none
[2011-05-19T16:16:36] The IP addresses for the DAG are (blank means DHCP):
[2011-05-19T16:16:36] Looking up IP addresses for DAG-STJ-SUM.
[2011-05-19T16:16:36]   DAG-STJ-SUM = [ 192.168.254.125 ].
[2011-05-19T16:16:36] Looking up IP addresses for pe-exchange.
[2011-05-19T16:16:36]   pe-exchange = [ 172.28.1.43 ].
[2011-05-19T16:16:36] Looking up IP addresses for PE-EXCHANGE.ESA.vector.dom.
[2011-05-19T16:16:36]   PE-EXCHANGE.ESA.vector.dom = [ 172.28.1.43 ].
[2011-05-19T16:16:36] DAG DAG-STJ-SUM has 1 servers:
[2011-05-19T16:16:36] DAG DAG-STJ-SUM contains server VA-CORP-EX1.
[2011-05-19T16:16:36] Updated Progress 'Checking if Mailbox server 'PE-EXCHANGE' is in a database availability group.' 4%.
[2011-05-19T16:16:36] Working
[2011-05-19T16:16:36] GetRemoteCluster() for the mailbox server failed with exception = An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"OpenCluster(PE-EXCHANGE.ESA.vector.dom) failed with 0x6d9. Error: There are no more endpoints available from the endpoint mapper"' failed... This is OK.
[2011-05-19T16:16:36] Ignoring previous error, as it is acceptable if the cluster does not exist yet.
[2011-05-19T16:16:36] DumpClusterTopology: Opening remote cluster DAG-STJ-SUM.
[2011-05-19T16:16:36] Dumping the cluster by connecting to: DAG-STJ-SUM.
[2011-05-19T16:16:36] The cluster's name is: DAG-STJ-SUM.
[2011-05-19T16:16:36] Groups
[2011-05-19T16:16:36]     group: Available Storage [not a CMS]
[2011-05-19T16:16:36]         OwnerNode: VA-CORP-EX1.vatg.vector.dom
[2011-05-19T16:16:36]         State: Offline
[2011-05-19T16:16:36]     group: Cluster Group [Cluster Main Group]
[2011-05-19T16:16:36]         OwnerNode: VA-CORP-EX1.vatg.vector.dom
[2011-05-19T16:16:36]         State: Online
[2011-05-19T16:16:36]             Resource: Cluster IP Address [Online, type = IP Address, PossibleOwners = VA-CORP-EX1 ]
[2011-05-19T16:16:36]                 Address = [192.168.254.125]
[2011-05-19T16:16:36]                     EnableDhcp = [1]
[2011-05-19T16:16:36]                     Network = [Cluster Network 1]
[2011-05-19T16:16:36]             Resource: Cluster Name [Online, type = Network Name, PossibleOwners = VA-CORP-EX1 ]
[2011-05-19T16:16:36]                 NetName = [DAG-STJ-SUM]
[2011-05-19T16:16:36] Nodes
[2011-05-19T16:16:36]     node: VA-CORP-EX1.vatg.vector.dom [ state = Up ]
[2011-05-19T16:16:36] Subnets
[2011-05-19T16:16:37]     Name(Cluster Network 1), Mask(192.168.254.0/24), Role(ClusterNetworkRoleInternalAndClient)
[2011-05-19T16:16:37]         NIC 192.168.254.88 on Node VA-CORP-EX1 in State=Up
[2011-05-19T16:16:37] Opening the cluster on nodes [va-corp-ex1].
[2011-05-19T16:16:37] Other mailbox servers in the DAG are already members of cluster 'DAG-STJ-SUM'
[2011-05-19T16:16:37] The server PE-EXCHANGE does not belong to a cluster, and the other servers belong to DAG-STJ-SUM.
[2011-05-19T16:16:37] Successfully resolved the servers based on the stopped servers list.
[2011-05-19T16:16:37] The following servers are in the StartedServers list (The list is the StartedServers property of the DAG in AD):
[2011-05-19T16:16:37] The following servers are in the StoppedServers list:
[2011-05-19T16:16:37] Verifiying that the members of database availability group 'DAG-STJ-SUM' are also members of the cluster.
[2011-05-19T16:16:37] Verifying that the members of cluster 'DAG-STJ-SUM' are also members of the database availability group.
[2011-05-19T16:16:37] According to GetNodeClusterState(), the server PE-EXCHANGE is NotConfigured.
[2011-05-19T16:16:37] The CNO is currently Online.
[2011-05-19T16:16:37] InternalValidate() done.
[2011-05-19T16:16:37] Updated Progress 'Adding server 'PE-EXCHANGE' to database availability group 'DAG-STJ-SUM'.' 6%.
[2011-05-19T16:16:37] Working
[2011-05-19T16:16:37] Updated Progress 'Adding server 'PE-EXCHANGE' to the cluster.' 8%.
[2011-05-19T16:16:37] Working
[2011-05-19T16:16:38] The following log entry comes from a different process that's running on machine 'VA-CORP-EX1.vatg.vector.dom'. BEGIN
[2011-05-19T16:16:38] [2011-05-19T16:16:37] Opening a local AmCluster handle.
[2011-05-19T16:16:37] Updated Progress 'Adding server 'pe-exchange' to database availability group 'DAG-STJ-SUM'.' 2%.
[2011-05-19T16:16:37] Working
[2011-05-19T16:16:37] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateNodeState, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 12, szObjectName = PE-EXCHANGE, dwStatus = 0x0 )
[2011-05-19T16:16:38] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateNodeState, ePhaseType = ClusterSetupPhaseContinue, ePhaseSeverity = ClusterSetupPhaseFatal, dwPercentComplete = 12, szObjectName = PE-EXCHANGE, dwStatus = 0x800706d3 )
[2011-05-19T16:16:38] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateNodeState, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseFatal, dwPercentComplete = 12, szObjectName = PE-EXCHANGE, dwStatus = 0x800706d3 )
[2011-05-19T16:16:38] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseFailureCleanup, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 12, szObjectName = PE-EXCHANGE, dwStatus = 0x0 )
[2011-05-19T16:16:38] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseFailureCleanup, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 12, szObjectName = , dwStatus = 0x0 )

[2011-05-19T16:16:38] The preceding log entry comes from a different process running on computer 'VA-CORP-EX1.vatg.vector.dom'. END
[2011-05-19T16:16:38] The operation wasn't successful because an error was encountered. You may find more details in log file "C:\ExchangeSetupLogs\DagTasks\dagtask_2011-05-19_16-16-36.193_add-databaseavailabiltygroupserver.log".
[2011-05-19T16:16:38] WriteError! Exception = Microsoft.Exchange.Cluster.Replay.DagTaskOperationFailedException: A server-side database availability group administrative operation failed. Error: The operation failed. CreateCluster errors may result from incorrectly configured static addresses. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"AddClusterNode() (MaxPercentage=12) failed with 0x800706d3. Error: The authentication service is unknown"' failed. ---> Microsoft.Exchange.Cluster.Replay.AmClusterApiException: An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"AddClusterNode() (MaxPercentage=12) failed with 0x800706d3. Error: The authentication service is unknown"' failed.. ---> System.ComponentModel.Win32Exception: The authentication service is unknown
   --- End of inner exception stack trace ---
   at Microsoft.Exchange.Cluster.ClusApi.AmCluster.AddNodeToCluster(AmServerName nodeName, IClusterSetupProgress setupProgress, IntPtr context, Exception& errorException, Boolean throwExceptionOnFailure)
   at Microsoft.Exchange.Cluster.Replay.DagHelper.AddDagClusterNode(AmServerName mailboxServerName, String& verboseLog)
   --- End of inner exception stack trace (Microsoft.Exchange.Cluster.Replay.AmClusterApiException) ---
   at Microsoft.Exchange.Cluster.Replay.DagHelper.ThrowDagTaskOperationWrapper(Exception exception)
   at Microsoft.Exchange.Cluster.Replay.DagHelper.AddDagClusterNode(AmServerName mailboxServerName, String& verboseLog)
   at Microsoft.Exchange.Cluster.ReplayService.ReplayRpcServer.<>c__DisplayClass34.<RpcsAddNodeToCluster>b__33()
   at Microsoft.Exchange.Data.Storage.Cluster.HaRpcExceptionWrapperBase`2.RunRpcServerOperation(String databaseName, RpcServerOperation rpcOperation)
   --- End of stack trace on server (VA-CORP-EX1.vatg.vector.dom) ---
   at Microsoft.Exchange.Data.Storage.Cluster.HaRpcExceptionWrapperBase`2.ClientRethrowIfFailed(String databaseName, String serverName, RpcErrorExceptionInfo errorInfo)
   at Microsoft.Exchange.Cluster.Replay.ReplayRpcClientWrapper.RunRpcOperationDbName(AmServerName serverName, String databaseName, Int32 timeoutMs, IHaRpcExceptionWrapper rpcExceptionWrapperInstance, InternalRpcOperation rpcOperation)
   at Microsoft.Exchange.Cluster.Replay.ReplayRpcClientWrapper.RunRpcOperation(AmServerName serverName, Nullable`1 dbGuid, Int32 timeoutMs, IHaRpcExceptionWrapper rpcExceptionWrapperInstance, InternalRpcOperation rpcOperation)
   at Microsoft.Exchange.Cluster.Replay.ReplayRpcClientWrapper.RunAddNodeToCluster(AmServerName serverName, AmServerName newNode, String& verboseLog)
   at Microsoft.Exchange.Management.SystemConfigurationTasks.AddDatabaseAvailabilityGroupServer.JoinNodeToCluster()
[2011-05-19T16:16:38] Updated Progress 'Done!' 100%.
[2011-05-19T16:16:38] COMPLETED
add-databaseavailabiltygroupserver explicitly called CloseTempLogFile().
Comment
Watch Question

Do more with

Expert Office
EXPERT OFFICE® is a registered trademark of EXPERTS EXCHANGE®
Adam BrownSenior Systems Admin
Top Expert 2010

Commented:
What version of windows are the two servers running?

Commented:
Please enabled the IPv6 on DAG member servers.

Seconldy disable tcpchimney and rss on all DAG member servers.
netsh int tcp set global rss=disabled
netsh int tcp set global chimney=disabled

To enable or disable TCP Chimney Offload on NIC, follow these steps:

Open Device Manager.
Under Network Adapters, double-click the network adapter that you want.
On the Advanced tab, click Enabled or Disabled in the box next to the TCP offload entry.
Commented:
Please note that we spoke to Microsoft on this, and their Tech lead came back and told us that DAG's cannot run across subdomains in a forest.. lovely... now We have to scratch our exchange servers and start again to impelemnt the DAG...

Author

Commented:
This answer has resolved this note as it was informational from Microsoft to other experts.

Do more with

Expert Office
Submit tech questions to Ask the Experts™ at any time to receive solutions, advice, and new ideas from leading industry professionals.

Start 7-Day Free Trial