clustered mailbox shows error

i have two mail box servers clustered using ccr. When i move the resources from mailbox 1 to mailbox2. it shows failed to bring up the storage. And i could see errors in the event viewer of mailbox 2

Event Type:      Error
Event Source:      MSExchangeRepl
Event Category:      Service
Event ID:      2073
Date:            4/23/2009
Time:            5:08:21 PM
User:            N/A
Computer:      UOB-SRV-MBX02
Description:
The Microsoft Exchange Replication Service is unable to create required directory F:\SG11Logs\inspector for uobe2k7ccr\SG11 dsr. Please check the file system permissions. The specific error code returned is: System.IO.DirectoryNotFoundException: Could not find a part of the path 'F:\SG11Logs\inspector'.
   at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
   at System.IO.Directory.InternalCreateDirectory(String fullPath, String path, DirectorySecurity dirSecurity)
   at System.IO.Directory.CreateDirectory(String path, DirectorySecurity directorySecurity)
   at Microsoft.Exchange.Cluster.Replay.ReplicaInstance.CreateDirectories(String[] directoriesToCreate, EventTuple eventTuple).

For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.


Event Type:      Error
Event Source:      MSExchange Search Indexer
Event Category:      General
Event ID:      104
Date:            4/23/2009
Time:            5:09:10 PM
User:            N/A
Computer:      UOB-SRV-MBX02
Description:
Exchange Search Indexer failed to enable the Mailbox Database SG1 admin\Mailbox Database admin (GUID = 5c6fb935-048c-4523-97a9-7ec9deefd5db) after 1 tries. The last failure was: System.IO.DirectoryNotFoundException: Could not find a part of the path 'I:\SG1Data\CatalogData-5c6fb935-048c-4523-97a9-7ec9deefd5db-111eba70-4e19-4054-af4f-e8a54dc525e8'.
   at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
   at System.IO.Directory.InternalCreateDirectory(String fullPath, String path, DirectorySecurity dirSecurity)
   at System.IO.Directory.CreateDirectory(String path, DirectorySecurity directorySecurity)
   at Microsoft.Exchange.Search.Globals.CreateCatalog(CatalogState state)
   at Microsoft.Exchange.Search.Globals.RecreateCatalogAndPropertyStore(CatalogState catalogInfo)
   at Microsoft.Exchange.Search.Globals.CheckAndInitializeCatalog(CatalogState catalogInfo)
   at Microsoft.Exchange.Search.Driver.MonitorAndUpdateMDBList(). It will retry after 0 minutes.

For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
mishalkAsked:
Who is Participating?
 
kdagliConnect With a Mentor Commented:
1. Suspend replication for the storage group by running the following command:
Suspend-StorageGroupCopy -Identity:<Server\StorageGroupName> (public)

2. Remove database files, all log files, and checkpoint files from the passive
node. Remove *.log, *.jrs, *.chk, and the .edb files from the configured
directories (logs directory, the system files directory, and the directory hosting
the database file).
3. Run the following command to seed the storage group copy on the passive node:
Update-StorageGroupCopy -Identity:<Server\StorageGroupName>
Above step will copy the .edb and .log files from Active to
Passive node, so wait for the completion.

4. Resume-StorageGroupCopy -Identity:<Server>\<StorageGroupName>
5. Wait for replication to complete and run Get- StorageGroupCopy
-Identity:<Server>\<StorageGroupName>
6. Make sure that CopyQueueLength and ReplayQueueLength is set to 0.
7. Step 6 can take some longer time. Once the you see that CopyQueueLength and
ReplayQueueLength is set to 0, test the failover.
8. Following above steps should fix the issue.
0
 
kdagliCommented:
Fail all the resources on mailbox 1. Reboot mailbox 2.
run test-replicationhealth command to check the status of replication.
If there is divergence in the database / logs, suspend replication suspend-storagegroupcopy and finally re-seed database.
0
 
mishalkAuthor Commented:
Fail all the resources on mailbox 2, not in mailbox 1. when i move to mailbox 1 , it is ok.  it brings everything fine
0
Has Powershell sent you back into the Stone Age?

If managing Active Directory using Windows Powershell® is making you feel like you stepped back in time, you are not alone.  For nearly 20 years, AD admins around the world have used one tool for day-to-day AD management: Hyena. Discover why.

 
mishalkAuthor Commented:
pls find the result after running the replication health

                                                      The Microsoft Exchange Re
                                                      plication Service is unab
                                                      le to create required dir
                                                      ectory F:\SG12Logs\inspec
                                                      tor for uobe2k7ccr\SG12 p
                                                      ublic. Please check the f
                                                      ile system permissions. T
                                                      he specific error code re
                                                      turned is: System.IO.Dire
                                                      ctoryNotFoundException: C
                                                      ould not find a part of t
                                                      he path 'F:\SG12Logs\insp
                                                      ector'.
                                                         at System.IO.__Error.W
                                                      inIOError(Int32 errorCode
                                                      , String maybeFullPath)
                                                         at System.IO.Directory
                                                      .InternalCreateDirectory(
                                                      String fullPath, String p
                                                      ath, DirectorySecurity di
                                                      rSecurity)
                                                         at System.IO.Directory
                                                      .CreateDirectory(String p
                                                      ath, DirectorySecurity di
                                                      rectorySecurity)
                                                         at Microsoft.Exchange.
                                                      Cluster.Replay.ReplicaIns
                                                      tance.CreateDirectories(S
                                                      tring[] directoriesToCrea
                                                      te, EventTuple eventTuple
                                                      ).

                                                          Cluster Continuous Re
                                                      plication for storage gro
                                                      up 'uobe2k7ccr\SG5 itc' i
                                                      s in a 'Failed' state on
                                                      server 'UOB-SRV-MBX02'. T
                                                      he error message is: The
                                                      Microsoft Exchange Replic
                                                      ation Service is unable t
                                                      o create required directo
                                                      ry F:\SG5Logs\inspector f
                                                      or uobe2k7ccr\SG5 itc. Pl
                                                      ease check the file syste
                                                      m permissions. The specif
                                                      ic error code returned is
                                                      : System.IO.DirectoryNotF
                                                      oundException: Could not
                                                      find a part of the path '
                                                      F:\SG5Logs\inspector'.
                                                         at System.IO.__Error.W
                                                      inIOError(Int32 errorCode
                                                      , String maybeFullPath)
                                                         at System.IO.Directory
                                                      .InternalCreateDirectory(
                                                      String fullPath, String p
                                                      ath, DirectorySecurity di
                                                      rSecurity)
                                                         at System.IO.Directory
                                                      .CreateDirectory(String p
                                                      ath, DirectorySecurity di
                                                      rectorySecurity)
                                                         at Microsoft.Exchange.
                                                      Cluster.Replay.ReplicaIns
                                                      tance.CreateDirectories(S
                                                      tring[] directoriesToCrea
                                                      te, EventTuple eventTuple
                                                      ).

                                                          Cluster Continuous Re
                                                      plication for storage gro
                                                      up 'uobe2k7ccr\SG6 edu' i
                                                      s in a 'Failed' state on
                                                      server 'UOB-SRV-MBX02'. T
                                                      he error message is: The
                                                      Microsoft Exchange Replic
                                                      ation Service is unable t
                                                      o create required directo
                                                      ry F:\SG6Logs\inspector f
                                                      or uobe2k7ccr\SG6 edu. Pl
                                                      ease check the file syste
                                                      m permissions. The specif
                                                      ic error code returned is
                                                      : System.IO.DirectoryNotF
                                                      oundException: Could not
                                                      find a part of the path '
                                                      F:\SG6Logs\inspector'.
                                                         at System.IO.__Error.W
                                                      inIOError(Int32 errorCode
                                                      , String maybeFullPath)
                                                         at System.IO.Directory
                                                      .InternalCreateDirectory(
                                                      String fullPath, String p
                                                      ath, DirectorySecurity di
                                                      rSecurity)
                                                         at System.IO.Directory
                                                      .CreateDirectory(String p
                                                      ath, DirectorySecurity di
                                                      rectorySecurity)
                                                         at Microsoft.Exchange.
                                                      Cluster.Replay.ReplicaIns
                                                      tance.CreateDirectories(S
                                                      tring[] directoriesToCrea
                                                      te, EventTuple eventTuple
                                                      ).

                                                          Cluster Continuous Re
                                                      plication for storage gro
                                                      up 'uobe2k7ccr\SG7 buss'
                                                      is in a 'Failed' state on
                                                       server 'UOB-SRV-MBX02'.
                                                      The error message is: The
                                                       Microsoft Exchange Repli
                                                      cation Service is unable
                                                      to create required direct
                                                      ory F:\SG7Logs\inspector
                                                      for uobe2k7ccr\SG7 buss.
                                                      Please check the file sys
                                                      tem permissions. The spec
                                                      ific error code returned
                                                      is: System.IO.DirectoryNo
                                                      tFoundException: Could no
                                                      t find a part of the path
                                                       'F:\SG7Logs\inspector'.
                                                         at System.IO.__Error.W
                                                      inIOError(Int32 errorCode
                                                      , String maybeFullPath)
                                                         at System.IO.Directory
                                                      .InternalCreateDirectory(
                                                      String fullPath, String p
                                                      ath, DirectorySecurity di
                                                      rSecurity)
                                                         at System.IO.Directory
                                                      .CreateDirectory(String p
                                                      ath, DirectorySecurity di
                                                      rectorySecurity)
                                                         at Microsoft.Exchange.
                                                      Cluster.Replay.ReplicaIns
                                                      tance.CreateDirectories(S
                                                      tring[] directoriesToCrea
                                                      te, EventTuple eventTuple
                                                      ).

                                                          Cluster Continuous Re
                                                      plication for storage gro
                                                      up 'uobe2k7ccr\SG8 asc' i
                                                      s in a 'Failed' state on
                                                      server 'UOB-SRV-MBX02'. T
                                                      he error message is: The
                                                      Microsoft Exchange Replic
                                                      ation Service is unable t
                                                      o create required directo
                                                      ry F:\SG8Logs\inspector f
                                                      or uobe2k7ccr\SG8 asc. Pl
                                                      ease check the file syste
                                                      m permissions. The specif
                                                      ic error code returned is
                                                      : System.IO.DirectoryNotF
                                                      oundException: Could not
                                                      find a part of the path '
                                                      F:\SG8Logs\inspector'.
                                                         at System.IO.__Error.W
                                                      inIOError(Int32 errorCode
                                                      , String maybeFullPath)
                                                         at System.IO.Directory
                                                      .InternalCreateDirectory(
                                                      String fullPath, String p
                                                      ath, DirectorySecurity di
                                                      rSecurity)
                                                         at System.IO.Directory
                                                      .CreateDirectory(String p
                                                      ath, DirectorySecurity di
                                                      rectorySecurity)
                                                         at Microsoft.Exchange.
                                                      Cluster.Replay.ReplicaIns
                                                      tance.CreateDirectories(S
                                                      tring[] directoriesToCrea
                                                      te, EventTuple eventTuple
                                                      ).

                                                          Cluster Continuous Re
                                                      plication for storage gro
                                                      up 'uobe2k7ccr\SG9 law' i
                                                      s in a 'Failed' state on
                                                      server 'UOB-SRV-MBX02'. T
                                                      he error message is: The
                                                      Microsoft Exchange Replic
                                                      ation Service is unable t
                                                      o create required directo
                                                      ry F:\SG9Logs\inspector f
                                                      or uobe2k7ccr\SG9 law. Pl
                                                      ease check the file syste
                                                      m permissions. The specif
                                                      ic error code returned is
                                                      : System.IO.DirectoryNotF
                                                      oundException: Could not
                                                      find a part of the path '
                                                      F:\SG9Logs\inspector'.
                                                         at System.IO.__Error.W
                                                      inIOError(Int32 errorCode
                                                      , String maybeFullPath)
                                                         at System.IO.Directory
                                                      .InternalCreateDirectory(
                                                      String fullPath, String p
                                                      ath, DirectorySecurity di
                                                      rSecurity)
                                                         at System.IO.Directory
                                                      .CreateDirectory(String p
                                                      ath, DirectorySecurity di
                                                      rectorySecurity)
                                                         at Microsoft.Exchange.
                                                      Cluster.Replay.ReplicaIns
                                                      tance.CreateDirectories(S
                                                      tring[] directoriesToCrea
                                                      te, EventTuple eventTuple
                                                      ).

                                                          Cluster Continuous Re
                                                      plication for storage gro
                                                      up 'uobe2k7ccr\SG10 btc'
                                                      is in a 'Failed' state on
                                                       server 'UOB-SRV-MBX02'.
                                                      The error message is: The
                                                       Microsoft Exchange Repli
                                                      cation Service is unable
                                                      to create required direct
                                                      ory F:\SG10Logs\inspector
                                                       for uobe2k7ccr\SG10 btc.
                                                       Please check the file sy
                                                      stem permissions. The spe
                                                      cific error code returned
                                                       is: System.IO.DirectoryN
                                                      otFoundException: Could n
                                                      ot find a part of the pat
                                                      h 'F:\SG10Logs\inspector'
                                                      .
                                                         at System.IO.__Error.W
                                                      inIOError(Int32 errorCode
                                                      , String maybeFullPath)
                                                         at System.IO.Directory
                                                      .InternalCreateDirectory(
                                                      String fullPath, String p
                                                      ath, DirectorySecurity di
                                                      rSecurity)
                                                         at System.IO.Directory
                                                      .CreateDirectory(String p
                                                      ath, DirectorySecurity di
                                                      rectorySecurity)
                                                         at Microsoft.Exchange.
                                                      Cluster.Replay.ReplicaIns
                                                      tance.CreateDirectories(S
                                                      tring[] directoriesToCrea
                                                      te, EventTuple eventTuple
                                                      ).

                                                          Cluster Continuous Re
                                                      plication for storage gro
                                                      up 'uobe2k7ccr\SG11 dsr'
                                                      is in a 'Failed' state on
                                                       server 'UOB-SRV-MBX02'.
                                                      The error message is: The
                                                       Microsoft Exchange Repli
                                                      cation Service is unable
                                                      to create required direct
                                                      ory F:\SG11Logs\inspector
                                                       for uobe2k7ccr\SG11 dsr.
                                                       Please check the file sy
                                                      stem permissions. The spe
                                                      cific error code returned
                                                       is: System.IO.DirectoryN
                                                      otFoundException: Could n
                                                      ot find a part of the pat
                                                      h 'F:\SG11Logs\inspector'
                                                      .
                                                         at System.IO.__Error.W
                                                      inIOError(Int32 errorCode
                                                      , String maybeFullPath)
                                                         at System.IO.Directory
                                                      .InternalCreateDirectory(
                                                      String fullPath, String p
                                                      ath, DirectorySecurity di
                                                      rSecurity)
                                                         at System.IO.Directory
                                                      .CreateDirectory(String p
                                                      ath, DirectorySecurity di
                                                      rectorySecurity)
                                                         at Microsoft.Exchange.
                                                      Cluster.Replay.ReplicaIns
                                                      tance.CreateDirectories(S
                                                      tring[] directoriesToCrea
                                                      te, EventTuple eventTuple
                                                      ).


UOB-SRV-MBX02   SGInitializing             Passed
UOB-SRV-MBX02   SGCopyQueueLength          Passed
UOB-SRV-MBX02   SGReplayQueueLength        Passed


[PS] C:\Documents and Settings\administrator.ADS>
0
 
mishalkAuthor Commented:
Dear Daqli
can help me or guide me to do
if there is divergence in the database / logs, suspend replication suspend-storagegroupcopy and finally re-seed database.
0
 
mishalkAuthor Commented:

[PS] C:\Documents and Settings\administrator.ADS>Get-StorageGroupCopyStatus

Name                      SummaryCopySt CopyQueueLeng ReplayQueueL LastInspecte
                          atus          th            ength        dLogTime
----                      ------------- ------------- ------------ ------------
First Storage Group       Healthy       0             0            4/25/2009...
SG1 admin                 Failed        0             0
SG2 arts                  Failed        0             0
SG3 eng                   Failed        0             0
SG4 sci                   Failed        0             0
SG12 public               Failed        0             0
SG5 itc                   Failed        0             0
SG6 edu                   Failed        0             0
SG7 buss                  Failed        0             0
SG8 asc                   Failed        0             0
SG9 law                   Failed        0             0
SG10 btc                  Failed        0             0
SG11 dsr                  Failed        0             0
0
 
mishalkAuthor Commented:
hi
i just wanted to give an idea..i am clustered my mailboxes using ccr, two nodes. shared with a san Storage. Hope shared san storage wont be a problem in ccr clustering
0
 
kdagliCommented:
Fail resources over to mailbox1. Run the command suspend-storagegroupcopy "Name of the storage Group". You need to run this command on each of the storage groups.
Open Exchange Management Console and check if the status is showing as suspended.
Go to passive node mailbox 2, stop "Exchange File Replication Service", Exchange Search Service. Renamed all the log files and databaes files folder. Create new folders with the same name.
From the passive node, open Exchange Management Console, right click storage group, click on "Update Storage Group", you will get the wizard, which will ask you to "Delete existing logs", check the box and proceed with re-seed. Once the re-seeding is done, right the same storage group and click on resume. You need to follow the procedure for each of the storage group. After which your problem should get resolve.
0
 
mishalkAuthor Commented:
dear kdagli,

i found one problem that both nodes where pointing to the same san of db folders and log files. So now i have a seperate space allocated for node 2. and created db folders and log files. could you assist me from here onwards
0
 
kdagliCommented:
Go to node1 and suspend the replication. Right click each of the storage group and click on "Suspend".
Then go to node2, right click on "Update Storage Group", you will get a wizard, put a check mark on "Delete Existing Log files" and proceed with the wizard. Once re-seeding is done, resume the suspended replication. Right click the storage group and click on "Resume Replication". You need to follow this procedure for each of the storage group you have.
0
 
mishalkAuthor Commented:
dear kdagli

i followed your suggestions, but still it shows failed
0
 
kdagliCommented:
Could you please post the latest event ID's pertaining to failed replicatin?
0
 
mishalkAuthor Commented:
Event Type:      Error
Event Source:      MSExchangeRepl
Event Category:      Service
Event ID:      2073
Date:            4/30/2009
Time:            1:31:11 PM
User:            N/A
Computer:      UOB-SRV-MBX02
Description:
The Microsoft Exchange Replication Service is unable to create required directory F:\SG11Logs\inspector for uobe2k7ccr\SG11 dsr. Please check the file system permissions. The specific error code returned is: System.IO.DirectoryNotFoundException: Could not find a part of the path 'F:\SG11Logs\inspector'.
   at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
   at System.IO.Directory.InternalCreateDirectory(String fullPath, String path, DirectorySecurity dirSecurity)
   at System.IO.Directory.CreateDirectory(String path, DirectorySecurity directorySecurity)
   at Microsoft.Exchange.Cluster.Replay.ReplicaInstance.CreateDirectories(String[] directoriesToCreate, EventTuple eventTuple).

For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
0
 
mishalkAuthor Commented:
Event Type:      Error
Event Source:      MSExchangeRepl
Event Category:      Service
Event ID:      2073
Date:            4/30/2009
Time:            1:31:11 PM
User:            N/A
Computer:      UOB-SRV-MBX02
Description:
The Microsoft Exchange Replication Service is unable to create required directory F:\SG7Logs\inspector for uobe2k7ccr\SG7 buss. Please check the file system permissions. The specific error code returned is: System.IO.DirectoryNotFoundException: Could not find a part of the path 'F:\SG7Logs\inspector'.
   at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
   at System.IO.Directory.InternalCreateDirectory(String fullPath, String path, DirectorySecurity dirSecurity)
   at System.IO.Directory.CreateDirectory(String path, DirectorySecurity directorySecurity)
   at Microsoft.Exchange.Cluster.Replay.ReplicaInstance.CreateDirectories(String[] directoriesToCreate, EventTuple eventTuple).

For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
0
 
kdagliCommented:
Is it showing failed for all the storage group?
Are the log files folder shared on CCR nodes? If they are shared, could you please let me know the NTFS and Shared permissions on those folders?

0
 
kdagliCommented:
Go to the Properties of the Share, Click on Permissions and Click on the NTFS
Permission.

By Default, It should have the following Group and the repective permissions:

1. System --> Full Control
2. System Administrator --> Full Control
3. 'Exchange Servers' Group ---> Read or Special
a. List Folders / Read Data
b. Read Attributes
c. Read Extended Attributes
d. Read Permissions
0
 
mishalkAuthor Commented:
yes ,it shows all the groups except the defualt first storage group which is residing locally

all log folders on the active node shows shared. Do we have to share  log files folders on both nodes

when we go to the shared permissions on the first node of the logs folders
we could see one group exchange servers group ,but without any permissions selected


ntfs permissions  shows three groups,
administrators-full permission
exchange servers- No permissions
system-full permission
0
 
kdagliCommented:
Does it mean your default first storage group is showing up as "Healthy"? but not the others?
Folders MUST be shared on both the nodes.
Exchange Servers Group must have permission i mentiond in my previous post, so ahead and assign it.






0
 
mishalkAuthor Commented:
yes, the defalut storage group is showing healthy. So i will share on both nodes and do as you said
0
 
mishalkAuthor Commented:
hi
now it shows healthy but not able to mount . event id 454
0
 
kdagliCommented:
Great!
now may I know where exactly are you not able to mount store? I mean on which node?
Event Id 454 indicate problem with database corruption or hardware problem.
We will need to diagnose this further.
I would appreciate if you elaborate the problem further here.
0
 
mishalkAuthor Commented:
hi
i can mount all the db's but still it shows some of the storage group shows failed

event id
Event Type:      Error
Event Source:      MSExchangeRepl
Event Category:      Service
Event ID:      2147
Date:            5/4/2009
Time:            1:43:16 PM
User:            N/A
Computer:      UOB-SRV-MBX01
Description:
There was a problem with 'uob-srv-mbx02', which is an alternate name for 'UOB-SRV-MBX02'. The list of aliases is now 'uob-srv-mbx02', and the alias 'was' removed from the list. The specific problem is 'Continuous replication operation aborted.'.

Event Type:      Error
Event Source:      MSExchangeRepl
Event Category:      Service
Event ID:      2104
Date:            5/4/2009
Time:            1:42:54 PM
User:            N/A
Computer:      UOB-SRV-MBX01
Description:
Log file action LogInspector failed for storage group uobe2k7ccr\SG3 eng. Reason: Unable to parse logfile line LRDI, 00000000035909E5, FDetachDB, 1, J:\SG3Data\Mailbox Database eng.edb. Regular expression was ^LRDI\s*,\s*(?<Checksum>[0-9A-F]+)\s*,\s*(?i:(?<Operation>(createdb|attachdb|detachdb)))\s*,\s*(?<DatabaseId>[0-9A-F]+)\s*,\s*(?<Database>.+?)\s*$.

For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.


For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
0
 
mishalkAuthor Commented:
kdagli:
i am seeing some strange stuff on the active node

my log files are in F drive which is having a 130 GB space,,and i am seeing one more drive in the same system as N drive with same size 130 GB and all the log folders there too. How this could happen
0
 
mishalkAuthor Commented:
microsoft says that you cannot keep your mail box db on a mapped drive. We need to change it. So i already moved to another drive. Stilll i have the error ,copy status as failed
0
 
mishalkAuthor Commented:
dear kdagli, thanks in advance for doing a great work for me to resolve this issue..I salute you
0
 
kdagliCommented:
You are welcome.
That is correct. You cannot keep database and logs files on a mapped drive. You need to make sure folders on the active and passive node are shared and have the required permission we discussed earlier.
Folder on the both the nodes must not be on mapped drive.
Once this is done, you will need to 'Re-seed" the database on the passive node by - "update storage group". Once this done, you should be all set.
I hope you remember how to re-seed the database (Update storage group"). Last time it failed because of insufficient permission on the folders and secondly, folders were not shared.
0
 
mishalkAuthor Commented:
dear kdagli:
error while mounting
--------------------------------------------------------
Microsoft Exchange Error
--------------------------------------------------------
Failed to mount database 'Exec'.

Exec
Failed
Error:
Failed to mount database 'uobe2k7ccr\sgexec\Exec' after a lossy failover occurred because of the current setting for AutoDatabaseMountDial. You must run Restore-StorageGroupCopy before you can mount the database.




--------------------------------------------------------
OK
--------------------------------------------------------
0
 
kdagliCommented:
Dear Mishalk,
This is a know issue and generally happens when the number of required log files missing are more than 6 / 9. Here, I would like to know on which did mounting of store failed? Node 1 or Node2?

If it has failed on node 2, then like I said, in my previous post, you MUST reseed the database (Update Storage Group) on the passive node, selec the option "delete existing transaction log files". Re-seeding will copy the database from active node to passive node. It will also copy the log files. Once all the storage gropu are re-seeded, it should resolve your problem.

Note:- if you run the command restore-storagegroupcopy that will make your passive database as "Active" which we DON"T want to do. Because, as far as I know, your active node is just okay, right?
0
 
mishalkAuthor Commented:
its mounting on node 1, but when i do reseed on node 2 it shows healthy and again back to failed. please note that this is the public folder storage
0
 
kdagliCommented:
So does it mean you have problem only with Public Folder Store? are all the other mailbox store fine?

How many exchange servers do we have?
0
 
mishalkAuthor Commented:
only with public folder store. Rest i followed your instructions and it worked. But now problem with public folder store only

0
 
mishalkAuthor Commented:
we have two nodes
0
 
kdagliCommented:
If you have more than one Public Folder Store in the Exchange Organziation, then Public Folder Store on CCR cluster is NOT supported. This is by design.
You can have Public Folder Store on a CCR cluster if there ONLY one and only one public folder in the entire exchange organization.

If you have only one public folder store, then you need to follow the exact same instruction for public folder store as well.
0
 
mishalkAuthor Commented:
dear kdagli
node 1 , i have one drive called G, there is a folder called public store. And the same thing i have it in the node 2, called G , there is a public folder called public store. if i keep only one public folder in one of the node , how can it replicate with another node? sorry if am asking basic question. could you elaborate it
0
 
kdagliCommented:
Sure, what I meant was....say you one exchange 2003 or 2007 server already having One public folder store up and running. Then you set up exchange 2007 CCR cluster and if you are attempting to get another public folder store on CCR cluster that is unsupported because, you cannot have public folder store on CCR if you already have public folder store up and running on some other exchange server.
0
 
kdagliCommented:
You need to follow the exact same instruction that we did for other store. Check for permission on the shared folders for public folder store, re-seed the database making sure you check the box "delete existing transaction log files".
If it is failing with an error, post the error message along with the event ID + description.

I am going to bed, its 12:30 AM here :-) so will reply in the morning.
0
 
mishalkAuthor Commented:
i have 300 gb free on my CAS/HUB server, can i use that for public folder db..if yes how can i ?
0
 
mishalkAuthor Commented:
i tried
today morning i saw one sg is failed and public store as well. I followed your instructions. But still same. No errors in the event viewer. The one storage which is failing was created for a test purpose , i dont mind removing that..how can i remove that storage from the both nodes. And public store, i have one public store. but i have created in both nodes. i think which is not suggested in ccr clustered.right ?
0
 
kdagliCommented:
You can create store and storage group only on the Mailbox Role. In order to delete store and storage group, right click the database and click on "remove database", perform the same step on "storage group" as well.

CCR and public folder replication are two very different forms of replication built into Exchange. Due to interoperability limitations between continuous replication and public folder replication, if more than one Mailbox server in the Exchange organization has a public folder database, public folder replication is enabled and public folder databases should not be hosted in CCR environments.

The following are the recommended configurations for using public folder databases and CCR in your Exchange organization:

If you have a single Mailbox server in your Exchange organization and that Mailbox server is a clustered mailbox server in a CCR environment, the Mailbox server can host a public folder database. In this configuration, there is a single public folder database in the Exchange organization. Thus, public folder replication is disabled. In this scenario, public folder database redundancy is achieved using CCR; CCR maintains two copies of your public folder database.

If you have multiple Mailbox servers you can host a public folder database in a CCR environment provided that there is only one public folder database in the entire Exchange organization. In this scenario, public folder database redundancy is also achieved by using CCR. In this configuration, there is a single public folder database in the Exchange organization. Thus, public folder replication is disabled.

If you are migrating public folder data into a CCR environment, you can use public folder replication to move the contents of a public folder database from a stand-alone Mailbox server or a clustered mailbox server in an SCC to a clustered mailbox server in a CCR environment. After you create the public folder database in a CCR environment, the additional public folder databases should only be present until your public folder data has fully replicated to the CCR environment. When replication has completed successfully, all public folder databases outside of the CCR environment should be removed, and you should not host any other public folder databases in the Exchange organization.

If you are migrating public folder data out of a CCR environment, you can use public folder replication to move the contents of a public folder database from a clustered mailbox server in a CCR environment to a stand-alone Mailbox server or a clustered mailbox server in an SCC. After you create the additional public folder database outside of the CCR environment, the public folder database in the CCR environment should only be present until your public folder data has fully replicated to the additional public folder databases. When replication has completed successfully, all public folder databases inside of all CCR environments should be removed and all subsequent public folder databases should not be hosted in storage groups that are enabled for continuous replication.

During any period where more than one public folder database exists in the Exchange organization and one or more public folder databases are hosted in a CCR environment (such as the migration scenarios described previously), consider the differences in behavior for scheduled (Lossless) and unscheduled (lossy) outages:

If a successful scheduled Lossless outage occurs, the public folder database will come online and public folder replication should continue as expected.

If an unscheduled outage occurs, the public folder database will not come online until the original server is available and all logs for the storage group hosting the public folder database are available. If any data is lost as a result of the outage, CCR will not allow the public folder database to come online when public folder replication is enabled. In this event, the original node must be brought online to ensure no data loss, or the public folder database must be re-created on the clustered mailbox server in the CCR environment and its content must be recovered using public folder replication from public folder databases that are outside the CCR environment.

0
 
mishalkAuthor Commented:
hi
so to remove the storage group and db store, i could just removing using console Do i need to remove any other files .
I only have one PF, but i dont know where the problem is .

event viewer shows

Event Type:      Error
Event Source:      MSExchangeRepl
Event Category:      Service
Event ID:      2073
Date:            5/7/2009
Time:            10:12:24 AM
User:            N/A
Computer:      UOB-SRV-MBX02
Description:
The Microsoft Exchange Replication Service is unable to create required directory K:\SG12Data for uobe2k7ccr\SG12 public. Please check the file system permissions. The specific error code returned is: System.IO.DirectoryNotFoundException: Could not find a part of the path 'K:\SG12Data'.
   at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
   at System.IO.Directory.InternalCreateDirectory(String fullPath, String path, DirectorySecurity dirSecurity)
   at System.IO.Directory.CreateDirectory(String path, DirectorySecurity directorySecurity)
   at Microsoft.Exchange.Cluster.Replay.ReplicaInstance.CreateDirectories(String[] directoriesToCreate, EventTuple eventTuple).

For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.

0
 
kdagliCommented:
Event ID that I see the same and is talking about the permission problem on the public folder logs folder. Make sure you have shared logs folder of the Public Folder Store and have the required permission. Yes, after you delete the storage group and database, you need to manually navigate to the path where the files are stored and delete it if you don't need those database files any more.
0
 
mishalkAuthor Commented:
hi
i checked the permissions..it is fine.  if you look at the event viwer it is trying to create
create required directory K:\SG12Data for uobe2k7ccr\SG12 public. there is no k drive .
0
 
kdagliCommented:
what is the path on active node for public folder store logs and database? It is K: drive?
0
 
mishalkAuthor Commented:
not k drive , logs are in F drive and database is in H:\SG12Data
0
 
kdagliCommented:
hmmm. I am just wondering why reseeding of database is going in K: drive. Did we have K: drive on passive node ever before?
I need some time to dig in to this issue.
Best would be if I can remote in to your server :-)
0
 
mishalkAuthor Commented:
Did we have K: drive on passive node ever before?
yes, you are right. we had K drive before
0
 
kdagliCommented:
Follow this link.

http://technet.microsoft.com/en-us/library/aa997646.aspx

NOTE:- Define PUBLIC FOLDER STORAGE GROUP to change the path.
0
 
mishalkAuthor Commented:
do i need to do in both nodes or only in active node
0
 
mishalkAuthor Commented:
in node 1 the status of public foder storage shows online. WHen i move to node 2 it shows failed.
0
 
mishalkAuthor Commented:
hi
i followed the same, what is happening is it is not copying the log files or .edb from the active node to passive. I will wait some more time to see it is going to happen or not. Its only copied two folders without any content , ignoredlogs and inspector..this was happening before too.

0
 
kdagliCommented:
did the command failed with an error in "red"? what was the error? after you run the command, did it try to reseed the database on k: drive? event ID should tell you where exactly it tried to seed the database.
could you please post the screenshots?
0
 
mishalkAuthor Commented:
yes, it is trying to reseed in k drive
Event Type:      Error
Event Source:      MSExchangeRepl
Event Category:      Service
Event ID:      2073
Date:            5/10/2009
Time:            6:21:56 AM
User:            N/A
Computer:      UOB-SRV-MBX02
Description:
The Microsoft Exchange Replication Service is unable to create required directory K:\SG12Data for uobe2k7ccr\SG12 public. Please check the file system permissions. The specific error code returned is: System.IO.DirectoryNotFoundException: Could not find a part of the path 'K:\SG12Data'.
   at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
   at System.IO.Directory.InternalCreateDirectory(String fullPath, String path, DirectorySecurity dirSecurity)
   at System.IO.Directory.CreateDirectory(String path, DirectorySecurity directorySecurity)
   at Microsoft.Exchange.Cluster.Replay.ReplicaInstance.CreateDirectories(String[] directoriesToCreate, EventTuple eventTuple).

For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
0
 
mishalkAuthor Commented:
the command didnt failed. but when i resume the replication it shows the copy status again failed
0
 
kdagliCommented:
well, I would suggest you to manage k: drive on the passive node and seed the database again. We are doing just for troubleshooting purpose.
0
 
mishalkAuthor Commented:
dear kdagli:
what do u think if we move the resources to the other node where the K drive was live before. And go to the second node which is now passive node and see the db again.
0
 
kdagliCommented:
well, actually when you move database and logs or i would say change path on the CCR cluster active node, by design, you must move the database on the passive node as well. I mean, if on active node, your database in c:\database\pub1.edb then on the passive node as well database has to be on c:\database\pub1.edb.
Secondly, when you change path on the active node, must manually move database on the passive node as well so that the path is in sync.
One thing we can do here,
delete the public folder storage group from the active node.
create a new storage group on the active node and mount your original database.
finally re-seed the database on passive node and check if it is still looking for the old path i.e k: drive.
0
 
mishalkAuthor Commented:
why dont we change the active node . Shift entire resoources to the other node. and do the same
0
 
kdagliCommented:
yup..go ahead and try that....
0
 
mishalkAuthor Commented:
Dear kdagli:
before i close this problem, i would like to extend my great appreciation to you for helping me to resolve this issue, it was not just resolving the issue..it helped me get a lot of ideas from your side which was really a value added to my knowledge as well.

now everything shows fine in regards to the storage group and public folders
0
 
mishalkAuthor Commented:
superb!!!
0
 
kdagliCommented:
Glad to know your issue is resolved. It was my pleasure working with you :-)
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.