Learn how to a build a cloud-first strategyRegister Now

x
?
Solved

Offline defragmentation Exchange database - some mails from last week are not showing

Posted on 2011-05-04
26
Medium Priority
?
654 Views
Last Modified: 2012-05-11
Hi all,

I had the problem that the Exchange Information Store was disconnected on numerous mornings 2 weeks ago and I discovered that the Store had grown over its current configured size of 40 GB.

So I archived lots of user’s old mails last week and did an offline defragmentation at the end of last week - after all the archiving was finished to immediately free up some space in the Exchange database!

The offices were closed for the construction holls so it did not interfere with anybody.

This week we are back and I have some people reporting that they are missing some mails in Outlook that came in last week that were for example designated to multiple recipients but others do see them (i archived some of the users old mails but only from last year and older!) and there is one mailbox for road open licensing e-mails which shows that 13 mails were received last week - the Inbox under Mail Folders overview on the left part shows actually the brackets with the number but the individual mails are not shown on the right side. I did not archive the licensing mailbox!

I checked the mail logs already and in both cases the mails show in the Exchange logs!

I also send a test mail to the licensing mailbox and that one shows up again on the right side.

It looks like the mails arrived before I did the offline defragmentation of the database!

Has anybody an idea of what is going wrong/what gone wrong here?

Thanks so much
Regards
Andre
0
Comment
Question by:bilboo969
  • 16
  • 10
26 Comments
 
LVL 5

Expert Comment

by:SaadAhmedFarooqui
ID: 35688905
You mentioned " designated to multiple recipients but others do see them " were all these users on the same mailbox store or on different?

Can you confirm from the sender if emails were bounced because the store was offline?
0
 

Author Comment

by:bilboo969
ID: 35689003
Thanks for your help offer, SaadAhmedFarooqui!

Yes some recipients that did see the mail in their Outlook, that this particular peron did not see, are on the same mailbox store!

I also noticed that my OWA and OMA have stopped working - obviously also since last week as 2 OMA Users just reported!? What the hach happend here!

Regards and Thanks
Andre
0
 
LVL 5

Expert Comment

by:SaadAhmedFarooqui
ID: 35689326
I would recommend running the ISINTEG tool to check the integrity of the databases.

This tool will report errors in the mail database such as corrupt views.

Below link could be helpful:

http://www.msexchange.org/tutorials/exchange-isinteg-eseutil.html
0
Concerto Cloud for Software Providers & ISVs

Can Concerto Cloud Services help you focus on evolving your application offerings, while delivering the best cloud experience to your customers? From DevOps to revenue models and customer support, the answer is yes!

Learn how Concerto can help you.

 

Author Comment

by:bilboo969
ID: 35696476
Hi all,

I ran isinteg last night as per instruction on the link you send - tnx for that again.

Here is the output:

C:\Documents and Settings\Administrator>isinteg -s sbs2003 -test folder
Databases for server sbs2003:
Only databases marked as Offline can be checked

Index  Status       Database-Name
Storage Group Name: First Storage Group
  1    Offline      Mailbox Store (SBS2003)
  2    Online       Public Folder Store (SBS2003)
Enter a number to select a database or press Return to exit.
1
You have selected First Storage Group / Mailbox Store (SBS2003).
Continue?(Y/N)y
Test reference table construction result: 0 error(s); 0 warning(s); 0 fix(es); 0
 row(s); time: 0h:0m:0s
Test Folder result: 0 error(s); 774 warning(s); 0 fix(es); 6311 row(s); time: 0h
:1m:30s
Now in test   3(reference count verification) of total   3 tests; 100% complete.

C:\Documents and Settings\Administrator>

i ran it then again with the -fix option and here is that output:

Test reference table construction result: 0 error(s); 0 warning(s); 0 fix(es); 0
 row(s); time: 0h:0m:0s
Test Folder result: 0 error(s); 79 warning(s); 762 fix(es); 6311 row(s); time: 0
h:1m:29s
Now in test   3(reference count verification) of total   3 tests; 100% complete.

i did run it another time then and no more error or warnings are displayed!

In addition i also ran the ESEUTIL /G:

C:\Program Files\Exchsrvr\MDBDATA>ESEUTIL /G priv1.edb

Microsoft(R) Exchange Server Database Utilities
Version 6.5
Copyright (C) Microsoft Corporation. All Rights Reserved.

Initiating INTEGRITY mode...
        Database: priv1.edb
  Streaming File: priv1.STM
  Temp. Database: TEMPINTEG6548.EDB

Checking database integrity.

                     Scanning Status (% complete)

          0    10   20   30   40   50   60   70   80   90  100
          |----|----|----|----|----|----|----|----|----|----|
          ...................................................

Integrity check completed.
Database is CORRUPTED, the last full backup of this database was on 05/04/2011 22:58:44

Operation terminated with error -1206 (JET_errDatabaseCorrupted, Non database file or corrupted db)
after 1651.63 seconds.

C:\Program Files\Exchsrvr\MDBDATA>

So I guess it is does not look too good - It is obviously a good question no when the DB corruption occurred.

I still have the original Exchange database files - the ones before the defragmentation.

should I check them on their integrity and if they are ok how will I merge the previous DB with the latest changes / mails that came in since then?

Thanks so much for your help in advance
Regards
Andre

0
 
LVL 5

Expert Comment

by:SaadAhmedFarooqui
ID: 35696535
- Yes I beleive you should restore the last good backup.

- In my opinion you will need to use Exmerge utility to export and then import the emails from the mailboxes. In exmerge you can define the Date as a parameter so you will be able to export emails that are missing.

- The easier way of doing this would have been to mount the current database in recovery storage group and merge the data but it may not work since the database is corrupt but you should give it a try anyway.
0
 

Author Comment

by:bilboo969
ID: 35696618
Tnx a mill again for your help, SaadAhmedFarooqui.

The current "corrupted" database / information store mounts fine in Exchange Manager and is currently mounted!? So should i try to mount it in in recovery storage group and try to merge?

Any good instructions here you would recommend how to do this?

I just had a report of a user and all his folders structure in his Outlook have disappeared!

Tnx a mill
Andre
0
 

Author Comment

by:bilboo969
ID: 35696625
Should I first check the integrity of the previous (copy from before defragmentation) Exchange database I have ?

Tnx a mill
0
 
LVL 5

Accepted Solution

by:
SaadAhmedFarooqui earned 2000 total points
ID: 35696947
Yes I think you should try to mount teh current database in recovery storage group.

You can refer to this article, its very helpful

http://www.petri.co.il/restoring_exchange_mailbox_recovery_storage_group_part1.htm
0
 

Author Comment

by:bilboo969
ID: 35697556
Tnx, will check out article. Also found Ms article: How to use Recovery Storage Groups in Exchange Server 2003  - http://support.microsoft.com/kb/824126 .

Just did ESEUTIL /G on both old Exchange Database I had from last week (28th - before 1st defrag and 30th - before 2nd defrag) and both are clean. Output for both times below.

Do I still also have to run the isinteg Integrity check or can I just start with the Restoring via the Recovery Storage Group procedure

Tnx a mill
Regards
Andre

Output:
F:\>cd F:\MDBDATA-Copy\

F:\MDBDATA-Copy>ESEUTIL /G "F:\MDBDATA-Copy\priv1-old.edb"

Microsoft(R) Exchange Server Database Utilities
Version 6.5
Copyright (C) Microsoft Corporation. All Rights Reserved.

Initiating INTEGRITY mode...
        Database: F:\MDBDATA-Copy\priv1-old.edb
  Streaming File: F:\MDBDATA-Copy\priv1-old.STM
  Temp. Database: TEMPINTEG10348.EDB

Checking database integrity.

                     Scanning Status (% complete)

          0    10   20   30   40   50   60   70   80   90  100
          |----|----|----|----|----|----|----|----|----|----|
          ...................................................

Integrity check successful.

Operation completed successfully in 1718.312 seconds.


F:\MDBDATA-Copy>ESEUTIL /G "F:\MDBDATA-Copy\priv1-old2.edb"

Microsoft(R) Exchange Server Database Utilities
Version 6.5
Copyright (C) Microsoft Corporation. All Rights Reserved.

Initiating INTEGRITY mode...
        Database: F:\MDBDATA-Copy\priv1-old2.edb
  Streaming File: F:\MDBDATA-Copy\priv1-old2.STM
  Temp. Database: TEMPINTEG6916.EDB

Checking database integrity.

                     Scanning Status (% complete)

          0    10   20   30   40   50   60   70   80   90  100
          |----|----|----|----|----|----|----|----|----|----|
          ...................................................

Integrity check successful.

Operation completed successfully in 409.78 seconds.
0
 
LVL 5

Expert Comment

by:SaadAhmedFarooqui
ID: 35697578
No you dont need to run isinteg at these databases.
0
 

Author Comment

by:bilboo969
ID: 35698143
Will it be safer to take the original Exchange database before doing any defragmenattion or will the one i defraged once do?

Sorry for all that questioning but this is the first time i have these issues!?

Tnx
Andre
0
 

Author Comment

by:bilboo969
ID: 35699045
I am a bit stuck / not sure how too continue:

I created the Recovery Storage Group and added (restored / in fact copied one of the previous Exchange Database files - that i integrity checked in the previous step and it showed up as clean.

How do i continue now: do is use the exmerge or how does this Recover Mailbox Data procedure work - where do i find this.

Obviusly what I am trying to do now is to pull the just restored working copy as much uptodate as possible - what ever mails arrived into the old store since the date of the restored db.

Please urgently help? Anybody

Tnx so much
Andre
0
 

Author Comment

by:bilboo969
ID: 35700283
Hi all,

I found instructions which step by step recover data from the restored database in the Recovery Storage Group into a .pst file via the 2 Step Procedure and from there it merges them into the original Exchange database.

As the integrity test on my original database has failed I obviously don't want to keep that one and want to replace it with the clean restored one but am not too sure how to proceed here.

Will I have to first replace the live/current exchange database with the restored one and load the ex-live database then into the Recovery Storage Group to be able to exmerge from the RSG into the newly restored live database?

Tnx so much
Regards
Andre
0
 

Author Comment

by:bilboo969
ID: 35700511
here is the article - sorry forgot to include that earlier!

http://www.outlookexchange.com/articles/HenrikWalther/RSG.asp
0
 
LVL 5

Expert Comment

by:SaadAhmedFarooqui
ID: 35704075
Yes you will first have to replace the live database with the DB from backup, then you will mount the current corrupt database to the RSG. Whe the databse is mounted in RSG it will show disconnected mailboxes but when you right click any mailbox you will see the option to merge emails with the live database.
0
 

Author Comment

by:bilboo969
ID: 35704496
Tnx again. Will I better use the DB before any defrag or will the one after 1st defrag - which integrity check was successfull - do? Or won't it matter as long as iti is a good one?

As you are the only one replying - tnx a mill for all the help - and you seem to de in a different time zone for how much longer can i get you ;)

I am allowing the users this mornign to catch up un their e-mails before i diogg in again!

Tnx
Andre


0
 
LVL 5

Expert Comment

by:SaadAhmedFarooqui
ID: 35704810
-  It won't matter as long as it is a good one.

Yes it seems that I am the only one participating. I am located in Pakistan GMT + 5.

I have to go for a meeting so I am only available for another 45 minutes.




0
 

Author Comment

by:bilboo969
ID: 35704856
Tnx a mill! How will I have to prceed: first of all i have to ask how do I stop all outlook clients from connetcion to the mail store and try to send e-mails? I will disable the SMTP port on my firewall to stop new e-mails from comming in - my external spam provider server will queue them for me up to 48h unti li re-open the port.

Then dismount mail stores, shut down exchange services swap the stores, start servcies, mount stores and merge mailboxes - can you do multiple mailboxes via the right click?

Tnx so much man for your help!
Andre
0
 
LVL 5

Expert Comment

by:SaadAhmedFarooqui
ID: 35704895
You dont need to disable port on your firewall. Just dismount the mailbox store swap the files (be very careful with it) and mount the database.

Yes you can select multiple mailboxes for merge.

when are you plannning this activity? if you want I can come on skype and guide you through the process.

 
0
 

Author Comment

by:bilboo969
ID: 35704927
was hoping to start this afternoon @ 12:00 Irish times (GMT +0).Tnx for the offer but I think I should manage. Just my first time i have to do somethuing like this so want to make sure i understand exactly what i have to do!

What do you mean by be very carefull when swapping the files - do you mean not too mix them up or what else can happen?

Tnx
0
 

Author Comment

by:bilboo969
ID: 35704941
Can it not cause issues if i leave the outlook clients connected / have new mails comming in all the times?

And if i merge the mails into the new store will the outlook clients ost file refresh themselfs or will i have to delete and recreate them?

Guess the merge will copy mails and folder structure, correct?

Cheers
Andre
0
 
LVL 5

Expert Comment

by:SaadAhmedFarooqui
ID: 35704956
- Yes I mean dont mix them up (since they will have the same name)

- Emails that are coming when the store is dismounted will remain in queue and will be delivered after the store is up.

- Yes the merge will copy the mails and folder structure.
0
 

Author Comment

by:bilboo969
ID: 35705260
Knew I forgot to ask something! Do I just copy the db files - what about all those log files and other stuff? Will copy them as they belong to live / corrupted store!

Hope that is the right thing to do!
0
 

Author Comment

by:bilboo969
ID: 35706258
FYI: left log file where tey were - in the original database location and just swapped database files.

Seem all to have worked fine. Also merged first 2 mailboxes and seem ta have worked fine as well
0
 

Author Comment

by:bilboo969
ID: 35727583
quick update: everything is back to normal, all mailboxes merged and teh lates integrity check o nthe database was successfull! Tnx a mill again for your help and top score for all your effords, SaadAhmedFarooqu! Thumb up!

Just one last question: am back to the stage where the IS is disconnects in the morning due to it being over its configured max size! I am going to increase temp its size but would like to bring its size down by archiving lots more of users mails. That was what i have done actually already last week (approx 5-6 GB archived)  but the size doesn't really decrease. That was why I ran the defragmentation last time in the hope to free up all the disk space but it only caused the issues i was having.

Looking at and adding the individual sizes of all mail boxes i only get just below 12GB in the total Mailbox size vut my edb and stm file add up to over 40 GB!? Is that normal?

I ran the eseutil /ms and here are parts of teh output:

****************
..... lots of more before that but too much to paste here - lots of with less stars also!
........
5089792           95    0   0 417  **************************
5090304         113    0   0 399  ************************
5090816         153    0   0 359  **********************
5091328             7    0   0 505  *******************************
5091840           15    0   0 497  *******************************
5092352           92    0   0 420  **************************
5092864         122  64   0 326  ************************
5093376           45    0   0 467  *****************************
5093888             1    0   0 511  *******************************
5094400         128    0   0 384  ************************
5094912           49    0   0 463  ****************************
============================================================================
TOTALS:
         Free:           29144
     Reserved:         6495
      Deleted:                32
    Committed:    5059241
      Unknown:               0
                      -------------
                         5094912
****************************************************************************


******************************** SPACE DUMP ***********************************

Name                   Type   ObjidFDP    PgnoFDP  PriExt      Owned  Available
===============================================================================
C:\Program Files\Exchsr Db           1          1   256-m    5728784      45214
<SLV Avail Map>         SLV          6         33    32-m        384         10
<SLV Owner Map>         SLV          7         65    32-m      45966         11

1-103496                Tbl         97     300949    10-s         10          5
  MsgFolderIndex7       Idx         98     300950     1-s          1          0
  MsgFolderIndexPtagDel Idx        101     300953     1-s          1          0
  MsgFolderIndexURLComp Idx        100     300952     1-s          1          0
  RuleMsgFolderIndex    Idx         99     300951     1-s          1          0
1-10349C                Tbl        102     300959     8-m         12          1
  ?B6708?T668f+B67aa+B8 Idx        105     300962     1-s          1          0
  ?B6708?T668f+B67aa+B8 Idx        104     300961     1-s          1          0
  ?B6708?T668f+B67aa+B8 Idx        103     300960     1-s          1          0
  ?B6708?T668f+B67aa-T3 Idx      21773    5720683     1-s          1          0
  MsgFolderIndex7       Idx        106     300963     1-s          1          0
  MsgFolderIndexPtagDel Idx        109     300966     1-s          1          0
  MsgFolderIndexURLComp Idx        108     300965     1-s          1          0
  RuleMsgFolderIndex    Idx        107     300964     1-s          1          0
1-1034A2 ..........

lots more - too much to paste here but next line give you the total of Available

----------------------------------------------------------------------------------------
                                                                                                           67622

Operation completed successfully in 40.234 seconds.
****************

Any idea ehy and how to properly shrink the IS?

Tnx
Andre
0
 
LVL 5

Expert Comment

by:SaadAhmedFarooqui
ID: 35735397
I really have no clue for the anomaly you have just mentioned above, but you if you have hard disk space you can increase the limit of your storage group to upto 75GB. You will have to change the registry setting here is the article from microsoft:

http://technet.microsoft.com/en-us/library/aa998066(EXCHG.65).aspx

Tip: you should apply mailbox quota on users and enforce send receive restriction, the users will learn to archive their emails and you will not have to worry about the size again.
0

Featured Post

NEW Veeam Agent for Microsoft Windows

Backup and recover physical and cloud-based servers and workstations, as well as endpoint devices that belong to remote users. Avoid downtime and data loss quickly and easily for Windows-based physical or public cloud-based workloads!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

If you have come across a situation where you need to find some EDB mailbox recovery techniques, then here you will find the same. In this article, we will take you through three techniques using which you will be able to perform EDB recovery. You …
Exchange administrators are always vigilant about Exchange crashes and disasters that are possible any time. It is quite essential to identify the symptoms of a possible Exchange issue and be prepared with a proper recovery plan. There are multiple…
In this video we show how to create an email address policy in Exchange 2013. We show this process by using the Exchange Admin Center. Log into Exchange Admin Center.:  First we need to log into the Exchange Admin Center. Navigate to the Mail Flow…
This video shows how to quickly and easily deploy an email signature for all users in Office 365 and prevent it from being added to replies and forwards. (the resulting signature is applied on the server level in Exchange Online) The email signat…
Suggested Courses
Course of the Month20 days, 21 hours left to enroll

810 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question