Information Store will not mount...

Ok. Here's the deal... This SBS server was functioning flawlessly for the past 3 years.  Then the Power Supply died.  Put in a new power supply, server comes up, everything looks good - WRONG!!!!  No email.  When you open Outlook, it errors out saying default email folders cannot be found.  

A quick look in the Exchange System Admin show that neither the Private, not Public Infromation stores are mounted.  Attempting to mount them fails with the following error message -

An internal processing error has occurred.  Try restarting the Exchange System Manager or the MS EXCH Information Service, or both.  Examine the app log for events related to this error.  ID no: c1041724

Ok.  I restart the System Manager and the IS Services then try to mount the pri and pub stores again.  Same thing.

Looking at the app event log reveals  Event ID 516 - Source ESE and the following text...

Information Store (3080) First Storage Group: Database D:\mdbdata\pub1.edb: Page 691 (0x000002b3) failed verification due to a timestamp mismatch.  The expected timestamp was 0x7bb079 but the actual timestamp on the page was 0x7bb02e.  Recovery/restore will fail with error -566.  If this condition persists then please restore the database from a previous backup. This problem is likely due to faulty hardware "losing" one or more flushes on this page sometime in the past. Please contact your hardware vendor for further assistance diagnosing the problem.


I also see event ID 454 - Source ESE with the following text...

Information Store (3080) First Storage Group: Database recovery/restore failed with unexpected error -566.

And ....  Event ID 9518 - Source MSExchangeIS  with the following text...

Error 0xfffffdca starting Storage Group /DC=local/DC=scms/CN=Configuration/CN=Services/CN=Microsoft Exchange/CN=SCMS/CN=Administrative Groups/CN=first administrative group/CN=Servers/CN=NPSSBS2003/CN=InformationStore/CN=First Storage Group on the Microsoft Exchange Information Store.
Storage Group - Initialization of Jet failed.


I have ran the MS Exchange Trouble Shooter which advise on running ESEUTIL with the /R E00 /I switches.  I made a copy of my transaction logs and attempted to run the eseutil as specified and receive

Operation terminated with error -1032 (JET_errFileAccessDenied, Cannot access fi
le, the file is locked or in use) after 11.16 seconds.


Please help!  MAXIMUM POINTS AWARDED!!!!!
LVL 1
dkh4bfAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

cmccallCommented:
It seems like your best bet would be to do a full restore of the database.

1)  Make a copy of all log files and databases (edb and stm)
2)  Mark the stores available to be overwritten by restore
3)  Deleted the *.chk file in the log directory
4)  restore all data available last good full and all incrementals
5)  Have the restore do a no loss restore.

This will restore the database to the last backup and then will play in the other transaction logs to bring you back up to the point of the crash.
0
Britt ThompsonSr. Systems EngineerCommented:
"Operation terminated with error -1032 (JET_errFileAccessDenied, Cannot access fi
le, the file is locked or in use) after 11.16 seconds." - is typically related to your store being mounted when trying to run this. You may be running out of disk space, this may prevent you from being able to mount your database as well.

http://www.petri.co.il/check_exchange_2000_2003_server_databases_integrity.htm

Could be corrupt log files as well:
ESEUTIL /p  -   Make sure you have a good backup of all your exchange data before running this and make sure you have enough disk space.
0
cmccallCommented:
If the previous is not acceptable, you can always try to run an eseutil /p.  This will recover the database but you run the risk of losing data.  Microsoft recommends only using this as a last resort to recover the data if all else fails.  I would suggest again that you make a copy of it.

As for the permission denied, make sure you don't have a file level Antivirus on that box.  If you do, make sure you set the exclussions as recommended by the following article.

http://support.microsoft.com/kb/823166
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Big Business Goals? Which KPIs Will Help You

The most successful MSPs rely on metrics – known as key performance indicators (KPIs) – for making informed decisions that help their businesses thrive, rather than just survive. This eBook provides an overview of the most important KPIs used by top MSPs.

dkh4bfAuthor Commented:
I have plenty of space on the drive, well over 100 GB on a 8GB store.  I have made copies of all log and DB files.  I also have good backups for the previous 4+ days before the crash.  I am running eseutli /p.  Nothing else is working....

I assume I need to run this on both the pub and priv edb files, is that correct?

What steps are there to take after the repair?  This is new to me...

Thanks
0
cmccallCommented:
Yes, run this on both pub and priv.  This will automatically pick up the stms.  After the repait, I would run isinteg -fix.  You may need to run it several times as it will fix things with each pass.

Now, once you have done this, make sure you take a full backup immediately.
0
dkh4bfAuthor Commented:
Can you provide a sample command line for  the isinteg command.  I have never used this before.

I am trying isinteg -fix -verbose -L isinteg.pri
0
cmccallCommented:
use the following.  This will give you a menu you can step through.  I normally run it from the directory where the databases are.

isinteg -s <servername> -fix -test ALLTESTS

you can use the -verbose at your own descretion.  
0
dkh4bfAuthor Commented:
Got this....
D:\MDBDATA>isinteg -s npssps2003 -fix -verbose -test ALLTESTS
Error: unable to get databases status from server. The reason could be either wr
ong server name or networking problems. Isinteg quits now.
0
dkh4bfAuthor Commented:
Sorry, I typed the server name wrong.  When corrected I receive this message...

D:\MDBDATA>isinteg -s npssbs2003 -fix -verbose -test ALLTESTS
Databases for server npssbs2003:
Only databases marked as Offline can be checked

Index  Status       Database-Name
Storage Group Name: First Storage Group
  1    Offline      Mailbox Store (NPSSBS2003)
  2    Offline      Public Folder Store (NPSSBS2003)
Enter a number to select a database or press Return to exit.
1
You have selected First Storage Group / Mailbox Store (NPSSBS2003).
Continue?(Y/N)y
Isinteg cannot initiate verification process.
  Please review the log file for more information.
0
cmccallCommented:
I would need to see the contents of the log file.  Verify that eseutil has completed.  If not, let that finish and try again.  If it has finished.  get the contents of the log file and post them here
0
dkh4bfAuthor Commented:
I just spotted an article that stated that ISINTEG will not run if the stores are not mounted.  When I try to mount them I still receive erros and they will not mount.

I am seeing EVENT ID 9518 Source MSExchangeIS with the following text...

Error 0xfffffb40 starting Storage Group /DC=local/DC=scms/CN=Configuration/CN=Services/CN=Microsoft Exchange/CN=SCMS/CN=Administrative Groups/CN=first administrative group/CN=Servers/CN=NPSSBS2003/CN=InformationStore/CN=First Storage Group on the Microsoft Exchange Information Store.
Storage Group - Initialization of Jet failed.

I also see Event ID 454 Source ESE with the following text...

Information Store (3832) First Storage Group: Database recovery/restore failed with unexpected error -1216.

I also see Event ID 494 Source ESE with the following text...

Information Store (3832) First Storage Group: Database recovery failed with error -1216 because it encountered references to a database, 'D:\mdbdata\pub1.edb', which is no longer present. The database was not brought to a Clean Shutdown state before it was removed (or possibly moved or renamed). The database engine will not permit recovery to complete for this instance until the missing database is re-instated. If the database is truly no longer available and no longer required, procedures for recovering from this error are available in the Microsoft Knowledge Base or by following the "more information" link at the bottom of this message.


0
dkh4bfAuthor Commented:
Can you tell me where the log file is located?
0
dkh4bfAuthor Commented:
should I delete any log files left after running eseutil...?
0
dkh4bfAuthor Commented:
Here is the log file on the Priv1.edb
priv1.INTEG.txt
0
dkh4bfAuthor Commented:
Ok. in looking at the log file I just sent, it is from the ESEUTIL not the isinteg...
But it does show complete.

BTW I now have a bunch of log files in my mdbdata folder - transaction log files....
0
cmccallCommented:
new log files?  Is your store mounted?

You can move the log files, but I wouldn't delete them?
0
dkh4bfAuthor Commented:
Ok.  I have moved the log files.  I still get the same error when running isinteg; that it cannot initiate.  I am unable to locate any log file generated by ISINTEG.

The store is still not mounted.  See posts above...
0
cmccallCommented:
I'm sorry.  Give it a -l <d:\logfilefolder\logfile.txt>
0
dkh4bfAuthor Commented:
Will do... Be back to you as soon as I can
0
cmccallCommented:
From what it sounds like, after the /p, the databse is in a different location with a new name.  Look in ESM and see what it expects to be the file path and file name and copy the files into the proper location.  Try that and run again.
0
dkh4bfAuthor Commented:
isinteg is taking forEVER to run....   I have a 1 1/2 hour drive home tonight.  I will let it run and remote in and check when I get hom.
0
cmccallCommented:
isinteg is a long running task.  And you may have to run it a few times to get the database integrity correct.  
0
jawad1481Commented:
HI!

First of all the database will not be recovered by replaying the log files if you have them because you have timestamp mismtach errror.

You have to restore from backup or repair the database using the "eseutil" commands.


Have you tried running "eseutil /p" , "eseutil /d" commands before isinteg ?

if not then first repair the database and before running these commands make a copy of the database files.

HARD REPAIR:

Open Command prompt --> go to bin directory ----> and execute this command/

eseutil /p <drag the priv1.edb file>   and press enter, it will give you warning --> press ok.


once this is complete, run "eseutil /d" <drag the priv1.edb file>

after completion of defrag , let me know.

Thanks.

Jawad.

0
dkh4bfAuthor Commented:
Good morning all...

After a very long night, I have the both stores repaired and re-mounted. New backups have been made and all seems to be working as it should.  Thanks so much for all the help into the late hours last night.
0
dkh4bfAuthor Commented:
CMCCALL,

I meant to give you the points as the accepted solution, but clicked on the wrong link.  How do i fix?  Sorry!
0
cmccallCommented:
dkh4bf,

I'm not sure how to fix that.  Would probably need to have a mediator remedy the situation.  If it can't be done, no worries.  These things happen.
0
dkh4bfAuthor Commented:
Thanks for understanding.  I want to make certain that you get the points you deserve.  Renazonse made a suggestion and I credit him/her with that, howerver you stuck with me and provided more insight and direction into the situation.

I have submitted a request to Customer Service to have the points awarded to you.
0
dkh4bfAuthor Commented:
I actually had to run ESEUTIL /p on both DBs, then run ESEUTIL /d on both before it would come up.  Thanks for all your help.
0
sjakalenCommented:
Hi!

I am encountering the exact same problem on my SBS 2003 server and have followed the advices given in this thread. Though, I cannot get the isinteg running no matter what I try. I am getting the samt error as posted 22/05/09 05:00 PM, ID: 24456018.  The database is offline and I am not able to mount it at all.

From reading I am not sure how this was resolved. It seems that there is not created any logfile even if I use the -l command.

@dkh4bf: I hope you can tell me what made it running??? Or anyone else having any ideas?

Thanks,

Jaspar
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
SBS

From novice to tech pro — start learning today.