undyshelts
asked on
exchange backup: database element is corrupt
Hey all,
Using Windows Small Business Server 2003 with Exchange Server 2003
Backing up using Veritas Backup Exec 9.1
Every day my backup fails, it started with 1 corrupt file in a mailbox, now it appears to have increased to more, which can be seen from the job history below...
The backup Job History has the following information:
Backup - \\CBS1\Microsoft Exchange Mailboxes
WARNING: "\\CBS1\Microsoft Exchange Mailboxes\Cassie [cassie]Top of Information StoreSync IssuesServer FailuresŒ 336;ӑ 6;〰 〰&# 14182;
 412;স 9;愳 ㄲ&# 13881;
 667;স 4;戹 㔵&# 13924; 131;ָ 9;㉡ ㈳&# 14178; 128;ӑ 6;㕦 ㄶ&# 12600; 134;ৰ 2;㠲 㜸&# 13620; 393;ਸ 7;㐶 㥦&# 25698; 187;ਞ 5;ぢ 〰&# 12336; 336;ӫ 2;㠵 㐷&# 12336; 336;՗ 0;ㄶ ㄸ&# 14134; 442;֞ 6;㜸 㔴&# 14393; 167;Ը 6;㥦 摢&# 25187; 905;Ӗ 6;〰 〰&# 12336;
 616;Ӓ 4;㔳 〰&# 12336;Lett erhead & Bcard Proofs" is a corrupt file.
This file cannot verify.
WARNING: "\\CBS1\Microsoft Exchange Mailboxes\Cassie [cassie]Top of Information StoreSync IssuesServer FailuresŒ 336;ӑ 6;〰 〰&# 14182;
 412;স 9;愳 ㄲ&# 13881;
 667;স 4;戹 㔵&# 13924; 131;ָ 9;㉡ ㈳&# 14178; 128;ӑ 6;㕦 ㄶ&# 12600; 134;ৰ 2;㠲 㜸&# 13620; 393;ਸ 7;㐶 㥦&# 25698; 187;ਞ 5;ぢ 〰&# 12336; 336;ӫ 2;㠵 㐷&# 12336; 336;՗ 0;ㄶ ㄸ&# 14134; 442;֞ 6;㜸 㔴&# 14393; 167;Ը 6;㥦 摢&# 25187; 905;Ӗ 6;〰 〰&# 12336;
 616;Ӓ 4;㘳 〰&# 12336;Busi ness Card Proofs" is a corrupt file.
This file cannot verify.
WARNING: "\\CBS1\Microsoft Exchange Mailboxes\Cassie [cassie]Top of Information StoreSync IssuesServer FailuresŒ 336;ӑ 6;〰 〰&# 14182;
 412;স 9;愳 ㄲ&# 13881;
 667;স 4;戹 㔵&# 13924; 131;ָ 9;㉡ ㈳&# 14178; 128;ӑ 6;㕦 ㄶ&# 12600; 134;ৰ 2;㠲 㜸&# 13620; 393;ਸ 7;㐶 㥦&# 25698; 187;ਞ 5;ぢ 〰&# 12336; 336;ӫ 2;㠵 㐷&# 12336; 336;՗ 0;ㄶ ㄸ&# 14134; 442;֞ 6;㜸 㔴&# 14393; 167;Ը 6;㥦 摢&# 25187; 905;Ӗ 6;〰 〰&# 12336;
 616;Ӓ 4;㜳 〰&# 12336;FW: Business Card Proofs" is a corrupt file.
This file cannot verify.
WARNING: "\\CBS1\Microsoft Exchange Mailboxes\Michael Shanahan [mas]Top of Information StoreInbox Œ 336;ӑ 6;〰 〰&# 14180; 186;Ը 3;扥 㕢&# 25698; 594;ӫ 6;ぢ 晥&# 13369; 644;ਅ 4;晣 ち&# 26168; 128;ӑ 6;㕦 ㄶ&# 12600; 134;ৰ 2;㠲 㜸&# 13620; 393;ਸ 7;㐶 㥦&# 25698; 187;ਞ 5;ぢ 〰&# 12336; 336;ӑ 6;㙡 搳&# 12336; 336;՗ 0;ㄶ ㄸ&# 14134; 442;֞ 6;㜸 㔴&# 14393; 167;Ը 6;㥦 摢&# 25187; 905;Ӗ 6;〰 〰&# 12336;
 360;ֽ 2;㜳 〰&# 12336;Busi ness Card Proofs" is a corrupt file.
This file cannot verify.
WARNING: "\\CBS1\Microsoft Exchange Mailboxes\Michael Shanahan [mas]Top of Information StoreInbox Œ 336;ӑ 6;〰 〰&# 14180; 186;Ը 3;扥 㕢&# 25698; 594;ӫ 6;ぢ 晥&# 13369; 644;ਅ 4;晣 ち&# 26168; 128;ӑ 6;㕦 ㄶ&# 12600; 134;ৰ 2;㠲 㜸&# 13620; 393;ਸ 7;㐶 㥦&# 25698; 187;ਞ 5;ぢ 〰&# 12336; 336;ӑ 6;㙡 搳&# 12336; 336;՗ 0;ㄶ ㄸ&# 14134; 442;֞ 6;㜸 㔴&# 14393; 167;Ը 6;㥦 摢&# 25187; 905;Ӗ 6;〰 〰&# 12336;
 360;ֽ 2;㠳 〰&# 12336;FW: Business Card Proofs" is a corrupt file.
This file cannot verify.
WARNING: "\\CBS1\Microsoft Exchange Mailboxes\Terry Redman [txr]Top of Information StoreSync IssuesServer FailuresŒ 336;ӑ 6;〰 〰&# 13157;
 107;ӑ 8;㤳 ㈹&# 13875; 601;ਸ 4;㈹ 搶&# 13873; 601;ֽ 2;㤷 㤹&# 13113; 128;ӑ 6;㕦 ㄶ&# 12600; 134;ৰ 2;㠲 㜸&# 13620; 393;ਸ 7;㐶 㥦&# 25698; 187;ਞ 5;ぢ 〰&# 12336; 336;ӫ 2;㠵 攰&# 12336; 336;՗ 0;ㄶ ㄸ&# 14134; 442;֞ 6;㜸 㔴&# 14393; 167;Ը 6;㥦 摢&# 25187; 905;Ӗ 6;〰 〰&# 12336;
 616;ਟ 3;昶 〰&# 12336;FW: Business Card Proofs" is a corrupt file.
This file cannot verify.
Verify - \\CBS1\Microsoft Exchange Mailboxes
WARNING: "Letterhead & Bcard Proofs" is a corrupt file.
This file cannot verify.
WARNING: "Business Card Proofs" is a corrupt file.
This file cannot verify.
WARNING: "FW: Business Card Proofs" is a corrupt file.
This file cannot verify.
WARNING: "Business Card Proofs" is a corrupt file.
This file cannot verify.
WARNING: "FW: Business Card Proofs" is a corrupt file.
This file cannot verify.
WARNING: "FW: Business Card Proofs" is a corrupt file.
This file cannot verify.
Please help me fix this nasty scenereo!
Using Windows Small Business Server 2003 with Exchange Server 2003
Backing up using Veritas Backup Exec 9.1
Every day my backup fails, it started with 1 corrupt file in a mailbox, now it appears to have increased to more, which can be seen from the job history below...
The backup Job History has the following information:
Backup - \\CBS1\Microsoft Exchange Mailboxes
WARNING: "\\CBS1\Microsoft Exchange Mailboxes\Cassie [cassie]Top of Information StoreSync IssuesServer FailuresŒ
This file cannot verify.
WARNING: "\\CBS1\Microsoft Exchange Mailboxes\Cassie [cassie]Top of Information StoreSync IssuesServer FailuresŒ
This file cannot verify.
WARNING: "\\CBS1\Microsoft Exchange Mailboxes\Cassie [cassie]Top of Information StoreSync IssuesServer FailuresŒ
This file cannot verify.
WARNING: "\\CBS1\Microsoft Exchange Mailboxes\Michael Shanahan [mas]Top of Information StoreInbox
This file cannot verify.
WARNING: "\\CBS1\Microsoft Exchange Mailboxes\Michael Shanahan [mas]Top of Information StoreInbox
This file cannot verify.
WARNING: "\\CBS1\Microsoft Exchange Mailboxes\Terry Redman [txr]Top of Information StoreSync IssuesServer FailuresŒ
This file cannot verify.
Verify - \\CBS1\Microsoft Exchange Mailboxes
WARNING: "Letterhead & Bcard Proofs" is a corrupt file.
This file cannot verify.
WARNING: "Business Card Proofs" is a corrupt file.
This file cannot verify.
WARNING: "FW: Business Card Proofs" is a corrupt file.
This file cannot verify.
WARNING: "Business Card Proofs" is a corrupt file.
This file cannot verify.
WARNING: "FW: Business Card Proofs" is a corrupt file.
This file cannot verify.
WARNING: "FW: Business Card Proofs" is a corrupt file.
This file cannot verify.
Please help me fix this nasty scenereo!
ASKER
Ok, i can do that! but.. how do i take the database offline, and more importantly, put it back online!
F:\Program Files\Exchsrvr\bin>isinteg -s cbs1 -fix -test alltests
Databases for server cbs1:
Only databases marked as Offline can be checked
Index Status Database-Name
Storage Group Name: First Storage Group
1 Online Mailbox Store (CBS1)
2 Online Public Folder Store (CBS1)
Enter a number to select a database or press Return to exit.
1
Invalid selection, this database cannot be checked (it is online).
Please make another selection or try this database again later.
Enter a number to select a database or press Return to exit.
F:\Program Files\Exchsrvr\bin>isinteg
Databases for server cbs1:
Only databases marked as Offline can be checked
Index Status Database-Name
Storage Group Name: First Storage Group
1 Online Mailbox Store (CBS1)
2 Online Public Folder Store (CBS1)
Enter a number to select a database or press Return to exit.
1
Invalid selection, this database cannot be checked (it is online).
Please make another selection or try this database again later.
Enter a number to select a database or press Return to exit.
Dismount/Mount store in Exchange System Manager
ASKER
for those who don't know how to do that..
servers --> [server name] --> first storage Group --> Right click on 'Mailbox Store' and click dismount/mount volume
servers --> [server name] --> first storage Group --> Right click on 'Mailbox Store' and click dismount/mount volume
ASKER
I did what NiclasH mentioned above, and it did not work, veritas backup is STILL showing in the backup log that mailbox's are corrypt... below is what i did...
F:\Program Files\Exchsrvr\bin>isinteg -s cbs1 -fix -test alltests
Databases for server cbs1:
Only databases marked as Offline can be checked
Index Status Database-Name
Storage Group Name: First Storage Group
1 Offline Mailbox Store (CBS1)
2 Offline Public Folder Store (CBS1)
Enter a number to select a database or press Return to exit.
1
You have selected First Storage Group / Mailbox Store (CBS1).
Continue?(Y/N)y
Test Categorization Tables result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Restriction Tables result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Search Folder Links result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s);time: 0h:0m:0s
Test Global result: 0 error(s); 0 warning(s); 0 fix(es); 1 row(s); time: 0h:0m:0s
Test Delivered To result: 0 error(s); 0 warning(s); 0 fix(es); 8 row(s); time: 0h:0m:0s
Test Repl Schedule result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time:0h:0m:0s
Test Timed Events result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test reference table construction result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:9s
Test Folder result: 0 error(s); 0 warning(s); 0 fix(es); 510 row(s); time: 0h:0m:10s
Test Deleted Messages result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Message result: 0 error(s); 0 warning(s); 0 fix(es); 14460 row(s); time: 0h:0m:5s
Test Attachment result: 0 error(s); 0 warning(s); 0 fix(es); 6430 row(s); time:0h:0m:0s
Test Mailbox result: 0 error(s); 0 warning(s); 0 fix(es); 18 row(s); time: 0h:0m:0s
Test Sites result: 0 error(s); 0 warning(s); 0 fix(es); 70 row(s); time: 0h:0m:0s
Test Categories result: 0 error(s); 0 warning(s); 0 fix(es); 6 row(s); time: 0h:0m:0s
Test Per-User Read result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time:0h:0m:0s
Test special folders result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Message Tombstone result: 0 error(s); 0 warning(s); 0 fix(es); 23 row(s); time: 0h:0m:0s
Test Folder Tombstone result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Now in test 20(reference count verification) of total 20 tests; 100% complete.
F:\Program Files\Exchsrvr\bin>
F:\Program Files\Exchsrvr\bin>isinteg -s cbs1 -fix -test alltests
Databases for server cbs1:
Only databases marked as Offline can be checked
Index Status Database-Name
Storage Group Name: First Storage Group
1 Offline Mailbox Store (CBS1)
2 Offline Public Folder Store (CBS1)
Enter a number to select a database or press Return to exit.
2
You have selected First Storage Group / Public Folder Store (CBS1).
Continue?(Y/N)y
Test Categorization Tables result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Restriction Tables result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Search Folder Links result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s);time: 0h:0m:0s
Test Global result: 0 error(s); 0 warning(s); 0 fix(es); 1 row(s); time: 0h:0m:0s
Test Delivered To result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Repl Schedule result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time:0h:0m:0s
Test Timed Events result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test reference table construction result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Folder result: 0 error(s); 0 warning(s); 0 fix(es); 40 row(s); time: 0h:0m:0s
Test Deleted Messages result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Message result: 0 error(s); 0 warning(s); 0 fix(es); 492 row(s); time: 0h:0m:0s
Test Attachment result: 0 error(s); 0 warning(s); 0 fix(es); 1867 row(s); time:0h:0m:0s
Test Per-User Read result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time:0h:0m:0s
Test Replication result: 0 error(s); 0 warning(s); 0 fix(es); 4 row(s); time: 0h:0m:0s
Test Message Tombstone result: 0 error(s); 0 warning(s); 0 fix(es); 2 row(s); time: 0h:0m:0s
Test Folder Tombstone result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Now in test 17(reference count verification) of total 17 tests; 100% complete.
F:\Program Files\Exchsrvr\bin>
F:\Program Files\Exchsrvr\bin>isinteg
Databases for server cbs1:
Only databases marked as Offline can be checked
Index Status Database-Name
Storage Group Name: First Storage Group
1 Offline Mailbox Store (CBS1)
2 Offline Public Folder Store (CBS1)
Enter a number to select a database or press Return to exit.
1
You have selected First Storage Group / Mailbox Store (CBS1).
Continue?(Y/N)y
Test Categorization Tables result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Restriction Tables result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Search Folder Links result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s);time: 0h:0m:0s
Test Global result: 0 error(s); 0 warning(s); 0 fix(es); 1 row(s); time: 0h:0m:0s
Test Delivered To result: 0 error(s); 0 warning(s); 0 fix(es); 8 row(s); time: 0h:0m:0s
Test Repl Schedule result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time:0h:0m:0s
Test Timed Events result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test reference table construction result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:9s
Test Folder result: 0 error(s); 0 warning(s); 0 fix(es); 510 row(s); time: 0h:0m:10s
Test Deleted Messages result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Message result: 0 error(s); 0 warning(s); 0 fix(es); 14460 row(s); time: 0h:0m:5s
Test Attachment result: 0 error(s); 0 warning(s); 0 fix(es); 6430 row(s); time:0h:0m:0s
Test Mailbox result: 0 error(s); 0 warning(s); 0 fix(es); 18 row(s); time: 0h:0m:0s
Test Sites result: 0 error(s); 0 warning(s); 0 fix(es); 70 row(s); time: 0h:0m:0s
Test Categories result: 0 error(s); 0 warning(s); 0 fix(es); 6 row(s); time: 0h:0m:0s
Test Per-User Read result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time:0h:0m:0s
Test special folders result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Message Tombstone result: 0 error(s); 0 warning(s); 0 fix(es); 23 row(s); time: 0h:0m:0s
Test Folder Tombstone result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Now in test 20(reference count verification) of total 20 tests; 100% complete.
F:\Program Files\Exchsrvr\bin>
F:\Program Files\Exchsrvr\bin>isinteg
Databases for server cbs1:
Only databases marked as Offline can be checked
Index Status Database-Name
Storage Group Name: First Storage Group
1 Offline Mailbox Store (CBS1)
2 Offline Public Folder Store (CBS1)
Enter a number to select a database or press Return to exit.
2
You have selected First Storage Group / Public Folder Store (CBS1).
Continue?(Y/N)y
Test Categorization Tables result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Restriction Tables result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Search Folder Links result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s);time: 0h:0m:0s
Test Global result: 0 error(s); 0 warning(s); 0 fix(es); 1 row(s); time: 0h:0m:0s
Test Delivered To result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Repl Schedule result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time:0h:0m:0s
Test Timed Events result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test reference table construction result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Folder result: 0 error(s); 0 warning(s); 0 fix(es); 40 row(s); time: 0h:0m:0s
Test Deleted Messages result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Test Message result: 0 error(s); 0 warning(s); 0 fix(es); 492 row(s); time: 0h:0m:0s
Test Attachment result: 0 error(s); 0 warning(s); 0 fix(es); 1867 row(s); time:0h:0m:0s
Test Per-User Read result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time:0h:0m:0s
Test Replication result: 0 error(s); 0 warning(s); 0 fix(es); 4 row(s); time: 0h:0m:0s
Test Message Tombstone result: 0 error(s); 0 warning(s); 0 fix(es); 2 row(s); time: 0h:0m:0s
Test Folder Tombstone result: 0 error(s); 0 warning(s); 0 fix(es); 0 row(s); time: 0h:0m:0s
Now in test 17(reference count verification) of total 17 tests; 100% complete.
F:\Program Files\Exchsrvr\bin>
You have an output file called isinteg.raw in the \mbdata folder. What does the summary part in the en say?
ASKER
There's a isinteg.pri and a isinteg.pub but no isinteg.raw file.
I'll do the isinteg command again and see if that file appears.
I'll do the isinteg command again and see if that file appears.
ASKER
No luck still.
Is there any way where I can search for an email stored on the server in a users mailbox by an email subject? If i can find the emails then hopefully delete them off the server this should fix the problem, for some reason the emails are not showing up under outlook.
Is there any way where I can search for an email stored on the server in a users mailbox by an email subject? If i can find the emails then hopefully delete them off the server this should fix the problem, for some reason the emails are not showing up under outlook.
ASKER
Figured it out!
1. Open Outlook Web Access from IE (usually http://www.SERVERNAME/exchange).
2. Log in under each user that is causing the error in the backup log (in my case: Cassie, Michael, and Terry)
3. Goto the folder Sync Issues, now the email will appear in one of the folders within. Either Conflicts, Local Failures, or Server Failures (forgot which one)
4. When you've found the corrupted email, delete PERMANENTLY!!! (if you just delete it into deleted items, the backup will still fail)
Could I please have my points refunded.
Cheers
1. Open Outlook Web Access from IE (usually http://www.SERVERNAME/exchange).
2. Log in under each user that is causing the error in the backup log (in my case: Cassie, Michael, and Terry)
3. Goto the folder Sync Issues, now the email will appear in one of the folders within. Either Conflicts, Local Failures, or Server Failures (forgot which one)
4. When you've found the corrupted email, delete PERMANENTLY!!! (if you just delete it into deleted items, the backup will still fail)
Could I please have my points refunded.
Cheers
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Does your full backup fail? This is brick level backup and normally isinteg solve this issue. Have a look at http://support.microsoft.com/default.aspx?scid=kb;en-us;301460.
Run isinteg -s servername -fix -test alltests several times until "fixes" 0 or the same amout twice.
But the point is to make sure you have a full backup that works, brick level backup is not a replacment for that.