Link to home
Start Free TrialLog in
Avatar of captain
captainFlag for United Kingdom of Great Britain and Northern Ireland

asked on

Domino Traveler quitting with Panic state

Hi

Problem:
We have a Domino mailserver and seen this error happening:
[1578:004B-17E4]  Thread=[1578:004B-17E4]
[1578:004B-17E4] Stack base=0x1CDE0088, Stack size = 7152 bytes
[1578:004B-17E4] PANIC: Process C:\Lotus\Domino\nTRAVELER.EXE (2444/0x98C) has terminated abnormally

The server is 8.5.3 FP5
Traveler is 8.5.3.3
running on Server 2003 SP2

Background:
We have upgraded both server and Traveler recently. Server from 8.5.3 and Traveler from 8.5.3.0. Both upgrades had to be done via Remote desktop. The upgrades were done with local admin account and both completed without error and server was rebooted after upgrade.

Fault searching:
We can reproduce the problem, as it appears to happen if a Remote Desktop session has ended. If admin logs on and stays logged on, server runs for hours without issue. The moment the admin logs off from remote session, the error occurs. Server needs brute force ending but sometimes NSD closes it.

This only happens when logging off NOT when disconnecting and keeping the session alive.

Attempted remedies:
We have unloaded Traveler and HTTP from notes.ini and defragged the Traveler db in line with this Technote as well as following through with deleting the NTSDB. We then reinstalled using local account and restarted the server.

The problem persisted. We then noticed that Domlog.nsf was at 5.6GB and deleted that for a rebuild on next restart. The problem seems to still exist.

I have just had to log in to get the logs and it reproduced the error. Shortly before the crash HTTP JVM reports:
HTTP JVM:  Exception Thrown: java.net.SocketException: Connection reset
[0FBC:003B-0A40] 30/08/2013 16:23:14   HTTP JVM: java.net.SocketException: Connection reset
[0FBC:003B-0A40] 30/08/2013 16:23:14   HTTP JVM:       at java.net.SocketInputStream.read(SocketInputStream.java:179)
[0FBC:003B-0A40] 30/08/2013 16:23:14   HTTP JVM:       at java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2306)
[0FBC:003B-0A40] 30/08/2013 16:23:14   HTTP JVM:       at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2319)
[0FBC:003B-0A40] 30/08/2013 16:23:14   HTTP JVM:       at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2790)
[0FBC:003B-0A40] 30/08/2013 16:23:14   HTTP JVM:       at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:793)
[0FBC:003B-0A40] 30/08/2013 16:23:14   HTTP JVM:       at java.io.ObjectInputStream.<init>(ObjectInputStream.java:293)
[0FBC:003B-0A40] 30/08/2013 16:23:14   HTTP JVM:       at com.lotus.sync.servlet.ConnectionListener$CLWorker.run(ConnectionListener.java:1650)
[0FBC:003A-172C] 30/08/2013 16:23:14   HTTP JVM:  Exception Thrown: java.net.SocketException: Connection reset
[0FBC:003A-172C] 30/08/2013 16:23:14   HTTP JVM: java.net.SocketException: Connection reset
[0FBC:003A-172C] 30/08/2013 16:23:14   HTTP JVM:       at java.net.SocketInputStream.read(SocketInputStream.java:179)
[0FBC:003A-172C] 30/08/2013 16:23:14   HTTP JVM:       at java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2306)
[0FBC:003A-172C] 30/08/2013 16:23:14   HTTP JVM:       at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2319)
[0FBC:003A-172C] 30/08/2013 16:23:14   HTTP JVM:       at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2790)
[0FBC:003A-172C] 30/08/2013 16:23:14   HTTP JVM:       at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:793)
[0FBC:003A-172C] 30/08/2013 16:23:14   HTTP JVM:       at java.io.ObjectInputStream.<init>(ObjectInputStream.java:293)
[0FBC:003A-172C] 30/08/2013 16:23:14   HTTP JVM:       at com.lotus.sync.servlet.ConnectionListener$CLWorker.run(ConnectionListener.java:1650)
[0FBC:0013-1338] 30/08/2013 16:23:20   HTTP JVM: Traveler: Lotus Traveler task did not respond.  Verify that the task is started.  Client request denied for CN=...

Additional info
We also see the following in the console, although it does not appear to have any effect on anything:
java.io.FileNotFoundException: D:\Domino\Data\traveler\cfg\NTSLogging.properties (The system cannot find the file specified.)
        at java.io.FileInputStream.open(Native Method)
        at java.io.FileInputStream.<init>(FileInputStream.java:137)
        at java.io.FileReader.<init>(FileReader.java:66)
        at com.lotus.sync.logging.XLogManager.updateLoggerConfig(XLogManager.java:753)
        at com.lotus.sync.logging.XLogManager.setActivityLevel(XLogManager.java:1593)
        at com.lotus.sync.admin.NTSSettingsINI.handleLoggerUpdates(NTSSettingsINI.java:1336)
        at com.lotus.sync.admin.NTSSettingsINI.refreshSettings(NTSSettingsINI.java:1239)
        at com.lotus.sync.admin.NTSSettingsINI.alarmCallback(NTSSettingsINI.java:1720)
        at com.lotus.sync.TSS.Util.WallClock$AlarmThreadRunnable.run(WallClock.java:103)
        at com.lotus.sync.util.ThreadPoolThread.run(ThreadPoolThread.java:391)

My question:
Has anyone got any ideas how to further diagnose?

Many thanks
capt.
SOLUTION
Avatar of Sjef Bosman
Sjef Bosman
Flag of France image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of captain

ASKER

Thanks, that is what I came up with too.

My hunch is that it is a temp file issue, the fact that it is reproducible when logging off seems to point that way...

thx for the domlog tip, have implemented that.
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of captain

ASKER

Thanks Akhahfaf

The Domino server always runs as a service, I learned that a long time ago when we had it running as a startup application.

It runs happily without hitch as long as it is not accessed via RD. So I am wondering whether the Traveler is relying on some session based temp location that gets closed when RD ends.

But if so why does it start i the first place and how does it run?
Ok the next question is

Using RDP How to do access the server ? Do you type mstsc ? in the Run command line of your PC then provide the server DNS or IPaddress

Or
You type :
mstsc -v: Traveler Server IP Address  /F -admin
mstsc -v: Traveler Server IP Address  /F -Console0

Please clarify
Avatar of captain

ASKER

Remote Desktop Client (Accessories> RE client) from another server within the LAN to the Mailserver which is in DMZ

So: VPN and RD to LAN server then RD to DMZ Server.

Using NetBIOS name /console

no other switches. /f not needed as it runs in fullscreen from RD client config, /v not needed as the RD client wraps that already...
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
ASKER CERTIFIED SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of captain

ASKER

Fixed by proxy of reinstalling the server, good suggestions all around