Sandeep Pandey
asked on
Domino Server crashed
Domino server is crashing and NSD is not generating while checked all configuration / parameters / permission. There is no logs for server crash / penic / terminated in console log. I have followed a different approach to start the server using nohup command and got the below error.
Child Terminated from signal 1
6/3/2017 1:00:40 Running NSD
6/3/2017 1:00:41 Fault cleanup is in progress
6/3/2017 1:00:41 Terminating tasks
6/3/2017 1:00:52 Freeing resources
6/3/2017 1:00:52 Fault cleanup completed
Child Terminated from signal 1
6/3/2017 1:00:40 Running NSD
6/3/2017 1:00:41 Fault cleanup is in progress
6/3/2017 1:00:41 Terminating tasks
6/3/2017 1:00:52 Freeing resources
6/3/2017 1:00:52 Fault cleanup completed
ASKER
Thanks Sjef Bosman. Below is the server hardware and Domino version details.
Processor Type: PowerPC_POWER7
Processor Implementation Mode: POWER 7
Processor Version: PV_7_Compat
Number Of Processors: 2
Processor Clock Speed: 3000 MHz
CPU Type: 64-bit
Kernel Type: 64-bit
Memory Size: 4096 MB
Good Memory Size: 4096 MB
Platform Firmware level: AA730_142
Firmware Version: IBM,AA730_142
Currently server is running on IBM Domino (r) Server (64 Bit), Release 9.0.1FP7HF419 on AIX 1 7
This is the passthru server and partner client connect through this server. Server runs 10-15 hours, 1 day, 2 days and crashed. Earlier ( till 10th May 2017) it was running on domino 901 FP3 and then I upgraded to 9.0.1FP7HF419 but there is no luck to fix this crash issue. There is no error log in console.log then I used nohup command and got the error "Child Terminated from signal 1". Also checked with OS team, they are saying there is no issue from OS.
One more thing I would like to tell you that this issue started when server instance deleted due to some reason, I have backup of server id, names and admin4 only. I built a fresh server on same version of Domino 901 FP3 and getting this crash issue, after that upgraded server to domino 9.0.1FP7HF419.
Server is crashing, no error in console log, nsd is not generating, only a single clue is "Child Terminated from signal 1" in nohup.out file.
Let me know if want to get any more info to address the issue.
Processor Type: PowerPC_POWER7
Processor Implementation Mode: POWER 7
Processor Version: PV_7_Compat
Number Of Processors: 2
Processor Clock Speed: 3000 MHz
CPU Type: 64-bit
Kernel Type: 64-bit
Memory Size: 4096 MB
Good Memory Size: 4096 MB
Platform Firmware level: AA730_142
Firmware Version: IBM,AA730_142
Currently server is running on IBM Domino (r) Server (64 Bit), Release 9.0.1FP7HF419 on AIX 1 7
This is the passthru server and partner client connect through this server. Server runs 10-15 hours, 1 day, 2 days and crashed. Earlier ( till 10th May 2017) it was running on domino 901 FP3 and then I upgraded to 9.0.1FP7HF419 but there is no luck to fix this crash issue. There is no error log in console.log then I used nohup command and got the error "Child Terminated from signal 1". Also checked with OS team, they are saying there is no issue from OS.
One more thing I would like to tell you that this issue started when server instance deleted due to some reason, I have backup of server id, names and admin4 only. I built a fresh server on same version of Domino 901 FP3 and getting this crash issue, after that upgraded server to domino 9.0.1FP7HF419.
Server is crashing, no error in console log, nsd is not generating, only a single clue is "Child Terminated from signal 1" in nohup.out file.
Let me know if want to get any more info to address the issue.
Valuable information there, thank you!
What's important is that the system used to run, then it got "removed", reinstalled and now you have issues. And the O/S team say that it's not their problem? Nice... if you installed Domino twice, and you get similar errors each time, I suspect that there is something seriously wrong with the O/S. Some system library got corrupted, or a disk problem. It could also be that your Domino data environment got damaged, and that one or more databases are unusable. But how to find that out?
Can you ask the O/S team to repair the AIX system? Or to check it, thoroughly? So that you can be reasonably sure that the system is ok? Check also the requirements for R9 on AIX: https://www.ibm.com/software/reports/compatibility/clarity-reports/report/html/softwareReqsForProduct?deliverableId=1351622732112&osPlatform=AIX
Maybe, just for testing purposes, you can do a fresh install of Domino, set it up under a new name, just for a test, and see if that runs. If it crashes too, that would eliminate a data corruption of one of the databases.
You could also get a spare server e.g. Linux, download Domino for Linux, install it, copy some databases from the backup to the spare server and see if it runs. If it does, there's a good chance that the AIX system is damaged.
I've no more ideas right now. Please let us know the results of your investigations.
What's important is that the system used to run, then it got "removed", reinstalled and now you have issues. And the O/S team say that it's not their problem? Nice... if you installed Domino twice, and you get similar errors each time, I suspect that there is something seriously wrong with the O/S. Some system library got corrupted, or a disk problem. It could also be that your Domino data environment got damaged, and that one or more databases are unusable. But how to find that out?
Can you ask the O/S team to repair the AIX system? Or to check it, thoroughly? So that you can be reasonably sure that the system is ok? Check also the requirements for R9 on AIX: https://www.ibm.com/software/reports/compatibility/clarity-reports/report/html/softwareReqsForProduct?deliverableId=1351622732112&osPlatform=AIX
Maybe, just for testing purposes, you can do a fresh install of Domino, set it up under a new name, just for a test, and see if that runs. If it crashes too, that would eliminate a data corruption of one of the databases.
You could also get a spare server e.g. Linux, download Domino for Linux, install it, copy some databases from the backup to the spare server and see if it runs. If it does, there's a good chance that the AIX system is damaged.
I've no more ideas right now. Please let us know the results of your investigations.
ASKER
Hi,
I have created a new FS, will do the fresh installation with backup server id file, notes.ini and names in weekend. Let's see what happen in server.
I have created a new FS, will do the fresh installation with backup server id file, notes.ini and names in weekend. Let's see what happen in server.
This question needs an answer!
Become an EE member today
7 DAY FREE TRIALMembers can start a 7-Day Free trial then enjoy unlimited access to the platform.
View membership options
or
Learn why we charge membership fees
We get it - no one likes a content blocker. Take one extra minute and find out why we block content.
What hardware? How much memory? How many users?
What O/S?? Windows? Linux? AIX? OS400?
What version of Domino? R4? R9?
Did the server ever run, is this a new install, or did it happen all of a sudden?
Can you start the server manually, and what happens then?
Usually, it is a problem with one of the executables or libraries. A fresh install, right over the existing system, should repair a lot. Otherwise, newer Domino versions have a repair mode when you start the installer.
It could also be a disk problem, but I suppose you should have had other errors as well. Check the system log anyway.