asked on

Problem with Exchange 2007 mailboxes/mailstore

Good Morning,

Just had an issue surface from the weekend. It seems to be persistent to one, maybe two mailstores. The application event log gives this message:

Event Type:      Error
Event Source:      MSExchangeIS Mailbox Store
Event Category:      Logons
Event ID:      1022
Date:            2/23/2009
Time:            9:56:33 AM
User:            N/A
Computer:      exchange-students
Description:
Logon Failure on database "2007-08\200708" - Windows account CAMPUS\username$; mailbox /o=BSC/ou=First Administrative Group/cn=Recipients/cn=username.
Error: -1069
Client Machine: exchangeserver
Client Process: edgetransport.exe
Client ProcessId: 0
Client ApplicationId: Client=Hub Transport

For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
Data:
0000: b3 0d a6 dd 85 8b 2c 41 ³.¦Ý…‹,A
0008: b8 a3 dd 19 b1 f9 00 15 ¸£Ý.±ù..
0010: 5b 44 49 41 47 5f 43 54 [DIAG_CT
0018: 58 5d 00 00 8e 00 00 00 X]..Ž...
0020: ff 04 0d 00 00 00 00 00 ÿ.......
0028: 00 02 80 00 00 00 3a 67 ..€...:g
0030: f0 1f fe 00 00 00 a4 1d ð.þ...¤.
0038: 40 10 0f 01 04 80 a4 19 @....€¤.
0040: 40 10 0f 01 04 80 84 12 @....€„.
0048: 40 10 05 00 07 80 84 18 @....€„.
0050: 40 10 05 00 07 80 71 5d @....€q]
0058: 40 10 ec 03 00 00 d2 55 @.ì...ÒU
0060: 60 20 0f 01 04 80 40 00 ` ...€@.
0068: 0c 68 0f 01 04 80 71 5d .h...€q]
0070: 40 10 ec 03 00 00 d2 55 @.ì...ÒU
0078: 60 20 0f 01 04 80 00 80 ` ...€.€
0080: 6f 67 0f 01 04 80 f1 5e og...€ñ^
0088: 40 10 0f 01 04 80 b4 33 @....€´3
0090: 40 10 d3 fb ff ff 07 08 @.Óûÿÿ..
0098: 40 10 d3 fb ff ff 07 0a @.Óûÿÿ..
00a0: 40 10 d3 fb ff ff 97 08 @.Óûÿÿ—.
00a8: 40 10 d3 fb ff ff @.Óûÿÿ

When an affected user attempts to login, they see the following:

Request
Url: https://exchange.server.org:443/owa/Default.aspx
User host address: 192.168.2.54

Exception
Exception type: Microsoft.Exchange.Data.Storage.StorageTransientException
Exception message: Cannot open mailbox /o=BSC/ou=First Administrative Group/cn=Recipients/cn=username.

Call stack

Microsoft.Exchange.Data.Storage.ConnectionCachePool.OpenMailbox(String serverDn, String userDn, String mailboxDn, Guid mailboxGuid, Guid mdbGuid, Object identity, ConnectFlag connectFlag, OpenStoreFlag openStoreFlag, CultureInfo cultureInfo, String clientInfoString, Boolean secondTry)
Microsoft.Exchange.Data.Storage.ConnectionCachePool.OpenMailbox(String serverDn, String userDn, String mailboxDn, Guid mailboxGuid, Guid mdbGuid, Object identity, ConnectFlag connectFlag, OpenStoreFlag openStoreFlag, CultureInfo cultureInfo, String clientInfoString, Boolean secondTry)
Microsoft.Exchange.Data.Storage.ConnectionCachePool.OpenMailbox(String serverDn, String userDn, String mailboxDn, Guid mailboxGuid, Guid mdbGuid, Object identity, ConnectFlag connectFlag, OpenStoreFlag openStoreFlag, CultureInfo cultureInfo, String clientInfoString)
Microsoft.Exchange.Data.Storage.MailboxSession.Initialize(LogonType logonType, ExchangePrincipal owner, DelegateLogonUser delegateUser, Object identity, OpenMailboxSessionFlags flags)
Microsoft.Exchange.Data.Storage.MailboxSession.CreateMailboxSession(LogonType logonType, ExchangePrincipal owner, DelegateLogonUser delegateUser, Object identity, OpenMailboxSessionFlags flags, CultureInfo cultureInfo, String clientInfoString)
Microsoft.Exchange.Data.Storage.MailboxSession.Open(ExchangePrincipal mailboxOwner, WindowsPrincipal authenticatedUser, CultureInfo cultureInfo, String clientInfoString)
Microsoft.Exchange.Clients.Owa.Core.OwaWindowsIdentity.CreateMailboxSession(ExchangePrincipal exchangePrincipal, CultureInfo cultureInfo)
Microsoft.Exchange.Clients.Owa.Core.UserContext.Load(OwaContext owaContext)
Microsoft.Exchange.Clients.Owa.Core.RequestDispatcher.CreateUserContext(OwaContext owaContext, UserContextKey userContextKey, UserContext& userContext)
Microsoft.Exchange.Clients.Owa.Core.RequestDispatcher.PrepareRequestWithoutSession(OwaContext owaContext, UserContextCookie userContextCookie)
Microsoft.Exchange.Clients.Owa.Core.RequestDispatcher.InternalDispatchRequest(OwaContext owaContext)
Microsoft.Exchange.Clients.Owa.Core.RequestDispatcher.DispatchRequest(OwaContext owaContext)
System.Web.HttpApplication.SyncEventExecutionStep.System.Web.HttpApplication.IExecutionStep.Execute()
System.Web.HttpApplication.ExecuteStep(IExecutionStep step, Boolean& completedSynchronously)

Inner Exception
Exception type: Microsoft.Mapi.MapiExceptionJetErrorVersionStoreOutOfMemory
Exception message: MapiExceptionJetErrorVersionStoreOutOfMemory: Unable to open message store. (hr=0x80004005, ec=-1069) Diagnostic context: Lid: 18969 EcDoRpcExt2 called [length=423] Lid: 27161 EcDoRpcExt2 returned [ec=0x0][length=180][latency=0] Lid: 23226 --- ROP Parse Start --- Lid: 27962 ROP: ropLogon [254] Lid: 17082 ROP Error: 0xFFFFFBD3 Lid: 26937 Lid: 21921 StoreEc: 0xFFFFFBD3 Lid: 27962 ROP: ropExtendedError [250] Lid: 1494 ---- Remote Context Beg ---- Lid: 26426 ROP: ropLogon [254] Lid: 23921 StoreEc: 0x3EC Lid: 21970 StoreEc: 0x8004010F PropTag: 0x680C0040 Lid: 23921 StoreEc: 0x3EC Lid: 21970 StoreEc: 0x8004010F PropTag: 0x676F8000 Lid: 24305 StoreEc: 0x8004010F Lid: 13236 StoreEc: 0xFFFFFBD3 Lid: 2055 StoreEc: 0xFFFFFBD3 Lid: 2567 StoreEc: 0xFFFFFBD3 Lid: 2199 StoreEc: 0xFFFFFBD3 Lid: 17097 StoreEc: 0xFFFFFBD3 Lid: 8620 StoreEc: 0xFFFFFBD3 Lid: 1750 ---- Remote Context End ---- Lid: 26849 Lid: 21817 ROP Failure: 0xFFFFFBD3 Lid: 26297 Lid: 16585 StoreEc: 0xFFFFFBD3 Lid: 32441 Lid: 1706 StoreEc: 0xFFFFFBD3 Lid: 24761 Lid: 20665 StoreEc: 0xFFFFFBD3 Lid: 25785 Lid: 29881 StoreEc: 0xFFFFFBD3

Call stack

Microsoft.Mapi.MapiExceptionHelper.ThrowIfError(String message, Int32 hresult, Int32 ec, DiagnosticContext diagCtx)
Microsoft.Mapi.ExRpcConnection.OpenMsgStore(OpenStoreFlag storeFlags, String mailboxDn, Guid mailboxGuid, Guid mdbGuid, MapiStore msgStorePrivate, String& correctServerDn, ClientIdentityInfo clientIdentityAs, String userDnAs, String applicationId, CultureInfo cultureInfo)
Microsoft.Mapi.ConnectionCache.OpenMapiStore(String mailboxDn, Guid mailboxGuid, Guid mdbGuid, ClientIdentityInfo clientIdentity, String userDnAs, OpenStoreFlag openStoreFlags, CultureInfo cultureInfo, String applicationId)
Microsoft.Mapi.ConnectionCache.OpenMailbox(String mailboxDn, Guid mailboxGuid, Guid mdbGuid, WindowsIdentity windowsIdentityAs, String userDnAs, OpenStoreFlag openStoreFlags, CultureInfo cultureInfo, String applicationId)
Microsoft.Exchange.Data.Storage.ConnectionCachePool.OpenMailbox(String serverDn, String userDn, String mailboxDn, Guid mailboxGuid, Guid mdbGuid, Object identity, ConnectFlag connectFlag, OpenStoreFlag openStoreFlag, CultureInfo cultureInfo, String clientInfoString, Boolean secondTry)

I have no issues with disk/free space. The store is mounted. I haven't performed a reboot yet (that's my next step). Any suggestions or comments to try? Again, there is only one or two mailstores (out of ten) on the server that are affected and not all users in the affected mailstores are having issues.

Thanks in advance,

Ben

Syedm2

Was the mailbox being moved at that time???

bwhorton

ASKER

No. No mailbox moves, no disabled user accounts, no maintenance or anything.

ASKER CERTIFIED SOLUTION

milindn

membership

This solution is only available to members.

To access this solution, you must be a member of Experts Exchange.

Start Free Trial

bwhorton

ASKER

I'm restarting now. Will let you know if that resolved the issue. I'll follow up within the next half hour. Thanks!

Ben

bwhorton

ASKER

Ok, the restart completed and we've been able to access the affected accounts. I'm going to watch it closely for the next two hours and repost if there are any problems. In the meantime, I'll run ExBPA and post the results here. At that time, I'll also award the points if no further issues arise.

Thanks,

Ben

Syedm2

Paste output of Get-MailboxStatistics | fl if poss.

bwhorton

ASKER

Ok, I stumbled onto something which "may" be related. After running the ExBPA, I discovered that one of the storage groups on this server had not received a full backup since it was created months after the other storage groups were created and the backups set for those. I'm running a full backup of that particular SG now and will re-run ExBPA to verify that that error is gone.

Syedm2 - I can't post the output of Get-MailboxStatistics here, but I can tell you that no errors or problems were seen when I ran it.

Ben

Syedm2

okies no probs.

milindn

Cool. Though the backup not run is marked as a high severity issue in ExBPA it never creates such problems. It is just a high priority warning. So you may actually disregard it though it is highly recommended to have the stores backed up regularly. Let us know how it goes.

M

bwhorton

ASKER

Update...backup ran successfully and as expected the BPA came back with no errors. No issues within the last two hours to my knowledge.

Thanks for everyone's assistance.

Ben

bwhorton

ASKER

With no exact cause able to be determined and not much to go on with limited info from the event logs and error messages, Milindn came closest to providing a solution and helped pave the way for me to troubleshoot on my own. Thanks again!