Solved

Exchange 5.5 down!! Event service and internet services stopped

Posted on 2004-10-22
327 Views
Last Modified: 2011-09-20
Hi,
I recently began a 5.5 to 2003 migration...
Everything was going pretty well today with testing new mailboxes and stuff like that. Then the 5.5 server dropped unexpectedly. We rebooted the server and all the services were listing as started except the event service and internet service... When I try to stop the information store it gives me a
error 2189 the service could not be controlled in its present state....
We are hosed without this server...
HEEELP!!
0
Question by:Darktide00
    37 Comments
     
    LVL 3

    Expert Comment

    by:ddrewtx
    OK, Darktide, I read your prior post.  If your Information Store won't shut down, go to services and set all the Exchange services to disabled, and reboot the server.  Then when it restarts, logon as the Exchange Service Account, and make sure AV is still off, and there are no other 'non-exchange' errors.  If there are, fix them first.  We need a stable OS before we can get Exchange stabilized.

    Once that is done, then open a command prompt and type the follwoing commands, one line at a time:

    cd\
    cd \exchsrvr\bin
    eseutil /mh /ispriv

    There will be quite a few lines that dump, and look for a line called 'State'.  Does it say 'Consistent' or 'Inconsistent'?

    Then type:
    eseutil /mh /ispub

    Do the same, and does it say consistent or inconsistent.

    Reply with your findings, and I'll stick close to help you with this.

    Best regards,

    Dale Drew
    0
     

    Author Comment

    by:Darktide00
    Right on!!! I totally appreciate it!
    When I try to change the services they state that "the services are locked"......
    There are no other non-exchange errors going on...
    Should I try the eseutils?
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    First off, is this happening on the Exchange 55 or Exchange 2003 server?

    Let's get the facts straight first.
    0
     

    Author Comment

    by:Darktide00
    5.5....
    Sorry about the extra thread thing I freaked out after a couple of hours with bosses coming in and out......
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    Eseutil won't work right if the services are hung, so we have to disable them, either in the Services dialog, or in the registry. If the services says they are locked, then go to start, run, and regedit.

    Open up the following tree:

    HKEY_Local_Machine\SYSTEM\CurrentControlSet\Services

    and scroll down to the services starting with \MSExchange...\ <the full name varies by service>

    Highlight each service, and if you see an entry on the right side 'Start', double click on it, and change it to a decimal value of 4.  Click ok, and go to the next service.  After all the MSExchange Services have been set to 4, then go to Start, Shutdown and click Restart the computer.

    After reboot, let's make sure there are no errors.  Then do the Eseutils as previous discussed.

    Dale
    0
     

    Author Comment

    by:Darktide00
    The server is almost done rebooting
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    NO problem. We'll get it working again, one way or another.  Give me more background information on your migration, if you have it handy.

    Dale
    0
     

    Author Comment

    by:Darktide00
    http://www.experts-exchange.com/Networking/Email_Groupware/Exchange_Server/Q_21175854.html

    Here is the link to what we did.... There is a lot!!
    The one thing that is puzzling me still is the whole service account login.....
    On the very top level of the 5.5 admin is our company name and the person I login wih is the service account admin as well as domain admin... That was change around a little yesterday.. How do I know if each level is giving the admin the right permissions... I have not rebooted since yesterday on this server. And that was before all the changes to the accounts were made. As well as too all the redirector stuff....
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    Wow, you have been busy.  First things first.

    1.  Running Exchange 5.5 on Windows 2000, right?
    2.  Did you run ESEUtils?  If so, what was the state of your ISPriv and ISPub.  We need to know that before we can go any further.  If it is 'Consistent', keep going.  If it is 'Inconsistent', stop and let me know.
    3.  Open Services, and double click on the System Attendant, set it to Manual, and start it.  Did it error?
    4.  Go back to Regedit, and look at HKey_Local_Machine\System\CurrentControlSet\Services\MSExchangeIS and then look at ParametersSystem (I think that is the right tree), and look for 'Working Directory'.  Does that reflect the correct path of the priv1.edb file?  If not change it and let me know.

    Dale
    0
     

    Author Comment

    by:Darktide00
    Hi,
    Sorry about that I was getting lectured by my boss....:( ugh......
    We are running exchange 5.5 sp4 on a nt4.0 sp6a
    Eseutils came back both inconsistent
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    ok. This is where it gets difficult.  There are two ways to deal with 'inconsistent' databases.  We can restore them, or try and repair them.  First question is when was your last backup, and when was that in relationship to your restore?

    Let's cross that bridge first.

    Dale
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    Sorry, meant to say:

    When was your last backup, and when was that in relationship to your migration?

    Dale
    0
     

    Author Comment

    by:Darktide00
    Here is the bad part.... It is like over a month ago.... horrrible I know!!!
    0
     

    Author Comment

    by:Darktide00
    Our last full backup was a month ago... We get only partial backups during the month.....
    We would lose the whole migration thing if we restored:(

    The inconsistency thing happened to me once before and I had to do a repair to both files then I believe we erased the edb logs to rebuild them... Does that sound right?
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    ok. We know that's bad, but not all that uncommon.  We should try to repair, but before we do that, lets make a copy of all of the other files in your MDBData folders, so we can look at other options if repair does not work.  Copy your priv.edb, pub.edb and ALL the other files in any MDBData folder to a different drive, or network drive, so we can recover if we need to.

    If you don't want to do that, let me know.

    Dale.
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    Yes, there is a 'recovery' switch for the eseutils, but we want to make a copy before we try that.  That is not as good in 5.5 as later versions.  

    How many mailboxes do you have left in 5.5?  If there are not that many, there are other options to consider.  Let me know.

    Dale

    0
     

    Author Comment

    by:Darktide00
    It is duplicating to a network drive.....
    0
     

    Author Comment

    by:Darktide00
    I still have almost all the mailboxes in there and all the distribution lists and public files.....
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    How big is your priv and pub, now.  You said you were over 16gb before.  Where are you at now.  

    Dale
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    In the other thread, you were not 100% sure about the version of Exchange you were using.  I take it Exchange 5.5 was on Standard (having a 16gb limit).  Did you buy the Enterprise Edition for Exchange 2003?  Just trying to figure out the options.

    Dale
    0
     

    Author Comment

    by:Darktide00
    Yesh we upgraded to enterprise when we got close to the 16GB limit.....
    It is now close to 19GB
    0
     

    Author Comment

    by:Darktide00
    I mean yes..... not yesh... hehehe
    0
     

    Author Comment

    by:Darktide00
    One other bad thing is we are using circular logging.....
    0
     

    Author Comment

    by:Darktide00
    That means we could have some data loss.... is that right?
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    Ok.  I take that last answer to mean Exchange 5.5 was upgraded to Enterprise Edition.  

    Now, to try the eseutil recovery, wait for the copy to finish, and then open a command prompt.

    go back to \exchsrvr\bin (like the last time we ran eseutil)

    type eseutil /r /is and press enter. When it is done, and it could take a while (not more than 15 or 20 min), then do the eseutil /mh /ispriv and eseutil /myh /ispub to see if they are back to 'consistent'.  If not, let me know.

    If you get any errors, let me know.

    Dale
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    Missed that response about circular logging.  yes you could loose some data, but it's better than loosing the whole store.

    when you run eseutil, use /mh instead of /myh (typo there)

    Dale
    0
     

    Author Comment

    by:Darktide00
    Just while I am waiting for the backup to complete....
    This error in the event log is weird....
    When I look it up on this site(error:8004011d-0526-00000000 ) many people think it has to do with the Service Account or changing the account. Could I have given the wrong permissions to the store?
    Generation of the offline Address Book is complete. Result: The Microsoft Exchange Server computer is not available. Either there are network problems or the Microsoft Exchange Server computer is down for maintenance. Microsoft Exchange Server Information Store ID no: 8004011d-0526-00000000
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    Typically that kind of error happens when one exchange service or another is not running, and causes incomplete communications.  I searched that long string 8004011d... and found a number of different errors.  It's pretty generic, and may be irrelevant.

    Dale
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    You talked about service account changes earlier.  Do you have one main Exchange Service Account?  If so, do you remember what permission you gave it when you changed it earlier...

    If you have more than one 'Service Account', do all your Exchange Server Services run under the same Service account?  

    It sounds like you have the one Exchange 5.5 server and a new Exchange 2003 server that you're migrating to.  How do you have that setup?

    Dale
    0
     

    Author Comment

    by:Darktide00
    Hi,
    Sorry about the wait I had user issues.....
    I am kind of a one man band around here......

    Yes we have one main Service account I am not the best Exchange guy so I have not checked what the services are running under... How could I check that to make sure we have the right passwords and such?

    Yes I have the 5.5 coexisting with the 2003 server at the present time. It is set up using the same service account name and passwords....

    Did I answer that right?

    Bill
    0
     

    Author Comment

    by:Darktide00
    The main user for exchnage has service account rights all the way accross the board... Is that how it should be?
    0
     

    Author Comment

    by:Darktide00
    Oooh, I also was told to change the DNS stuff yesterday... Would that make a difference?
    0
     
    LVL 3

    Accepted Solution

    by:
    Hey Darktide, sorry for the delay in responding, but I'm going to have to call it a night soon.  When the copy is done, here is what we need to do (it's also detailed in http://support.microsoft.com/default.aspx?scid=kb;en-us;272570):

    1.  Open a command prompt and cd to \exchsrvr\bin
    2.  type eseutil /r /ispriv, and again with /ispub and let them finish.  If it errors, try it again with the full path to the priv.edb instead of /ispriv.  Then try it with the full path to the pub.edb instead of /ispub.  
    3.  If it completes, then run eseutil /mh /ispriv and see what the state is.  Also run eseutil /mh /ispub to see what the pub's state is.  If both are consistent, then go ahead with the remaining steps.  If it is still inconsistent or errors, then skip to step 8.  If the services don't start for whatever reason, then the /r probably didn't work, and in that situation skip to Step 8.

    4.  Double check your services to see what account they are running in.  Make sure it is running with the primary Exchange Service Account.  To check that, go to the control panel, Services.  Double click on each Exchange Service to go into properties, and look at the logon tab, and there should be an account listed there.  If it isn't the service account, then change it to the service account.  In Exchange 2003, this should be 'Local System' instead of the Service Account.
    5.  Start the System Attendant and check your app log to see if there are any errors.  If none after a few minutes then move on.
    6.  Start the Directory Service and check your app log to see if there are any errors.  If none, move on.
    7.  Start the Information Store Service, and check your app log to see if there are any errors.  If none, move on.  If you can get the store to run, open the Exchange Administrator, and see if your mailboxes are still there.  If so, then stop all the Exchange Services, and make another copy of the Priv.edb and Pub.edb as that will be a good 'offline backup' and will protect you in case of future problems.  Continue with your migration and keep your fingers crossed.

    8.  If you can't get the stores consistent, then  you need to consider whether to repair your store using eseutil /p or to look at 3rd party utilities to extract the data.  That'll be your call.  I've heard that Ontrack makes a good one, but I've never used it.  Go to http://www.ontrack.com/powercontrols/ for more info on their utility.  You may want to seek others input, but it may be faster than the /p.  Expect the /p to take 2 - 4 gigs/hr on BOTH the priv and pub (in a best case scenario).  When you get to that point, if needed, someone here should be able to give you the right command for it.  Expect it to take as long as the /p.  When that is done, plan on exmerging the data out, as your store is going to be mountable, but not usable for the long term. Also expect data loss.  Exchange 5.5 really depends on having good backups to restore from if there are database issues.  When that is not an option, all bets are off.

    In regards to DNS causing this, I don't think so.  Your server crashed at some point, and when it went down, it left your stores open (in an inconsistent state).  To get them back, we have a process to use, and if we don't we can cause more problems than not.

    Hope this helps, sorry I can't stay online and help with this, but I've got an early trip tomorrow morning, and will be offline until late Sunday night.

    Glad to help, sorry that I can't stick around (also have ISP problems too - had to wait for them to come back online).

    Best regards,

    Dale Drew
    0
     

    Author Comment

    by:Darktide00
    Right on Buddy!
    I truly appreciate all your help!!! Seriously!!!!
    Good luck on your trip!
    I will post on here how everything went if you want to check it out when you come back....
    Thanks again,
    Bill
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    Hi Bill,

    Got back early, so I thought I'd see how things worked out for you.  Sorry to see the next post you did, about the  -1019 error.  They are difficult to resolve unless you have a good backup.  Hope you found a good utility to extract the data from your store, as that can be a difficult situation too.  Thanks for the good review, I'm kinda new here, so all the points I can get help.  Hope things work out with your boss.

    Take care,

    Dale Drew
    0
     

    Author Comment

    by:Darktide00
    Hey!
    I was just wondering if you have ever seen this error.....
    I restored the priv and pub edb's and went through the whole thing again and ended up with this......

    Event 1005
    Unable to start the Microsoft Exchange Information Store. Error 0xfffffc05.
    0
     
    LVL 3

    Expert Comment

    by:ddrewtx
    Sorry, my response got posted to the other thread.  I thought I put it in the same thread...

    Dale
    0

    Write Comment

    Please enter a first name

    Please enter a last name

    We will never share this with anyone. Privacy Policy Terms of Use

    Featured Post

    Prepare to Pass the CompTIA A+ 900 Series Exam

    CompTIA aims to adapt its A+ Certification to reflect the most current knowledge and skills needed by today's IT professionals--and this year's 2016 exam is harder than ever. This certification is one of the most highly-respected and sought after in IT.

    Granting full access permission allows users to access mailboxes present in their database. By giving full access permission one can open and read the content of any mailbox but cannot send emails from that mailbox.
    Use email signature images to promote corporate certifications and industry awards.
    In this video we show how to create a Contact in Exchange 2013. We show this process by using the Exchange Admin Center. Log into Exchange Admin Center.: First we need to log into the Exchange Admin Center. Navigate to the Recipients >> Contact ta…
    In this video we show how to create an Address List in Exchange 2013. We show this process by using the Exchange Admin Center. Log into Exchange Admin Center.: First we need to log into the Exchange Admin Center. Navigate to the Organization >> Ad…

    875 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    12 Experts available now in Live!

    Get 1:1 Help Now