Link to home
Start Free TrialLog in
Avatar of rpwarren
rpwarren

asked on

OaracleService<SID> start failure

After a reboot following failed (locked-up) attempt to "Add database to tree" using DBA Studio in stand-alone mode, I now get hung at "starting" for OracleService<SID>.  This is Oracle 8.i which has been running for years and collecting important (but naturally unbacked up) data here on a small Windows 2000 machine.

Most recent log entries below.

-Paul Warren
____________________
from sqlconnect.log:

Fatal NI connect error 12547, connecting to:
 (LOCAL=NO)

  VERSION INFORMATION:
      TNS for 32-bit Windows: Version 8.1.6.0.0 - Production
      Oracle Bequeath NT Protocol Adapter for 32-bit Windows: Version 8.1.6.0.0 - Production
      Windows NT TCP/IP NT Protocol Adapter for 32-bit Windows: Version 8.1.6.0.0 - Production
  Time: 22-SEP-2002 22:38:55
  Tracing not turned on.
  Tns error struct:
    nr err code: 0
    ns main err code: 12547
    TNS-12547: TNS:lost contact
    ns secondary err code: 0
    nt main err code: 0
    nt secondary err code: 0
    nt OS err code: 0
____________________________
From onrsd.log:

System parameter file is C:\Oracle\Ora81\network\admin\sqlnet.ora
Log messages written to C:\Oracle\Ora81\network\log\onrsd.log
Trace information written to C:\Oracle\Ora81\network\trace\onrsd_1672.trc
Trace level is currently 0

NNO-00601: warning: no forwarders, DEFAULT-FORWARDERS-ONLY mode ignored
NNO-00315: server is listening on address (ADDRESS=(PROTOCOL=IPC)(KEY=ONAMES))
NNO-00065: loading cached data from checkpoint file "C:\Oracle\Ora81\network\names\ckpcch.ora"
22-AUG-2004 09:21:47: NNO-00303: server "[root]" started with process ID 280
____________________
from ....logcman.log

Warning : Error while sourcing third party discovery file nmipaging.tcl : couldn't read file "nmipaging.tcl": no such file or directory
__________________________
from listner.log
System parameter file is C:\Oracle\Ora81\network\admin\listener.ora
Log messages written to C:\Oracle\Ora81\network\log\listener.log
Trace information written to C:\Oracle\Ora81\network\trace\listener.trc
Trace level is currently 0

Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=\\.\pipe\EXTPROC0ipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=babylon-server)(PORT=1521)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=babylon-server)(PORT=2481))(PROTOCOL_STACK=(PRESENTATION=GIOP)(SESSION=RAW)))
TIMESTAMP * CONNECT DATA [* PROTOCOL INFO] * EVENT [* SID] * RETURN CODE
Avatar of seazodiac
seazodiac
Flag of United States of America image

post up the ALERT_<SID>.log file .
I mean, not whole but the end portion of the alert log file
Avatar of rpwarren
rpwarren

ASKER

This may be a clue, but there is no alert_*.log on the machine.  Could I have deleted a critical directory?
try to search for file name containing  just ALRT or alert


It's most likely located in <ORACLE_HOME>/admin/<Database SID>/bdump folder.


So you can also search for "bdump" folder.
in bdump I found: babylonALRT.log (SID=BABYLON).  All was operating normally Aug 20 at noon.  I believe failure was that evening.

Sun Aug 15 10:12:40 2004
Thread 1 advanced to log sequence 2036
  Current log# 2 seq# 2036 mem# 0: C:\ORACLE\ORADATA\BABYLON\REDO02.LOG
Tue Aug 17 09:02:33 2004
Thread 1 advanced to log sequence 2037
  Current log# 3 seq# 2037 mem# 0: C:\ORACLE\ORADATA\BABYLON\REDO01.LOG
Wed Aug 18 13:15:37 2004
Thread 1 advanced to log sequence 2038
  Current log# 1 seq# 2038 mem# 0: C:\ORACLE\ORADATA\BABYLON\REDO03.LOG
Dump file C:\Oracle\admin\BABYLON\bdump\babylonALRT.LOG
Mon Aug 23 12:33:05 2004
ORACLE V8.1.6.0.0 - Production vsnsta=0
vsnsql=e vsnxtr=3
Windows 2000 Version 5.0 Service Pack 2, CPU type 586
Starting up ORACLE RDBMS Version: 8.1.6.0.0.
System parameters with non-default values:
  processes                = 59
  shared_pool_size         = 15728640
  large_pool_size          = 614400
  java_pool_size           = 20971520
  nls_date_format          = YYYY-MM-DD HH24:MI:SS
  control_files            = C:\Oracle\oradata\BABYLON\control01.ctl, C:\Oracle\oradata\BABYLON\control02.ctl, C:\Oracle\oradata\BABYLON\control03.ctl
  db_block_buffers         = 2048
  db_block_size            = 8192
  compatible               = 8.1.0.0.0
  log_buffer               = 32768
  log_checkpoint_interval  = 10000
  log_checkpoint_timeout   = 1800
  db_files                 = 1024
  db_file_multiblock_read_count= 8
  max_enabled_roles        = 30
  remote_login_passwordfile= EXCLUSIVE
  global_names             = TRUE
  distributed_transactions = 500
  instance_name            = BABYLON
  service_names            = BABYLON
  mts_dispatchers          = (PROTOCOL=TCP)(PRE=oracle.aurora.server.SGiopServer)
  open_links               = 4
  sort_area_size           = 65536
  sort_area_retained_size  = 65536
  db_name                  = BABYLON
  open_cursors             = 100
  ifile                    = C:\Oracle\admin\BABYLON\pfile\init.ora
  os_authent_prefix        =
  job_queue_processes      = 4
  job_queue_interval       = 10
  parallel_max_servers     = 5
  background_dump_dest     = C:\Oracle\admin\BABYLON\bdump
  user_dump_dest           = C:\Oracle\admin\BABYLON\udump
  max_dump_file_size       = 10240
  oracle_trace_collection_name=
PMON started with pid=2
DBW0 started with pid=3
LGWR started with pid=4
CKPT started with pid=5
SMON started with pid=6
RECO started with pid=7
SNP0 started with pid=8
SNP1 started with pid=9
SNP2 started with pid=10
SNP3 started with pid=11
Mon Aug 23 12:33:10 2004
starting up 1 shared server(s) ...
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
Mon Aug 23 12:33:13 2004
alter database  mount
Mon Aug 23 12:33:19 2004
Successful mount of redo thread 1, with mount id 4204651534.
Mon Aug 23 12:33:19 2004
Database mounted in Exclusive Mode.
Completed: alter database  mount
Mon Aug 23 12:33:19 2004
alter database open
Beginning crash recovery of 1 threads
Mon Aug 23 12:33:20 2004
Thread recovery: start rolling forward thread 1
Recovery of Online Redo Log: Thread 1 Group 1 Seq 2038 Reading mem 0
  Mem# 0 errs 0: C:\ORACLE\ORADATA\BABYLON\REDO03.LOG
Mon Aug 23 12:33:20 2004
Thread recovery: finish rolling forward thread 1
Thread recovery: 0 data blocks read, 0 data blocks written, 0 redo blocks read
Crash recovery completed successfully
Mon Aug 23 12:33:23 2004
Thread 1 advanced to log sequence 2039
Thread 1 opened at log sequence 2039
  Current log# 2 seq# 2039 mem# 0: C:\ORACLE\ORADATA\BABYLON\REDO02.LOG
Successful open of redo thread 1.
Mon Aug 23 12:33:23 2004
SMON: enabling cache recovery
SMON: enabling tx recovery
Mon Aug 23 12:34:00 2004
Completed: alter database open
Mon Aug 23 12:34:00 2004
Errors in file C:\Oracle\admin\BABYLON\udump\ORA00468.TRC:

Nothing serious here, can you upload file C:\Oracle\admin\BABYLON\udump\ORA00468.TRC?
Sorry, but I can't find an "upload" feature.  Here is the data from the file:

Dump file C:\Oracle\admin\BABYLON\udump\ORA00468.TRC
Mon Aug 23 12:34:00 2004
ORACLE V8.1.6.0.0 - Production vsnsta=0
vsnsql=e vsnxtr=3
Windows 2000 Version 5.0 Service Pack 2, CPU type 586
Oracle8i Enterprise Edition Release 8.1.6.0.0 - Production
With the Partitioning option
JServer Release 8.1.6.0.0 - Production
Windows 2000 Version 5.0 Service Pack 2, CPU type 586
Instance name: babylon

Redo thread mounted by this instance: 1

Oracle process number: 14

Windows thread id: 468, image: ORACLE.EXE


*** SESSION ID:(11.1) 2004-08-23 12:34:00.663
FATAL ERROR IN TWO-TASK SERVER: error = 12571
*** 2004-08-23 12:34:00.984
ksedmp: internal or fatal error
Current SQL information unavailable - no session.
----- Call Stack Trace -----
calling                          call     entry                            argument values in hex
location                         type     point                            (? means dubious value)
--------------------             -------- --------------------             ----------------------------
_ksedmp+a8                       CALLrel  _ksedst+0                        
                                                                           D9E4F0
_opitsk+f6b                      CALLrel  _ksedmp+0                        2
_opiino+4eb                      CALLrel  _opitsk+0                        0
_opiodr+504                      CALLreg  00000000                         3C 4
                                                                           2D9FBF8
_opidrv+384                      CALLrel  _opiodr+0                        3C 4
                                                                           2D9FBF8
                                                                           0
_sou2o+19                        CALLrel  _opidrv+0                        
_opimai+10c                      CALLrel  _sou2o+0                        
_OracleThreadStart@4+49f         CALLrel  _opimai+0                        2
                                                                           2D9FE74
7C574388                         CALLreg  00000000                        
----- Argument/Register Address Dump -----
Argument/Register addr=2d9e4f0.  
Dump of memory from 0x2D9E4B0 to 0x2D9E5F0
2D9E4B0 00000000 00000000 65522100 00000033  [.........!Re3...]
2D9E4C0 00000000 02D9E481 FFFFFFFD 00000000  [................]
2D9E4D0 00000000 00000000 00149AC0 00000000  [................]
2D9E4E0 0000001D 02D9E4FC 0041A704 00000001  [..........A.....]
2D9E4F0 00D93EC4 00D93EC4 00D93EC4 00D93ECC  [.>...>...>...>..]
2D9E500 00D93EC4 00D93EC4 00D93EC4 00D93EC4  [.>...>...>...>..]
2D9E510 00D93ECC 00000000 00000000 00000000  [.>..............]
2D9E520 00149AC0 02D9E5D8 0041B649 02D9E53C  [........I.A.<...]
2D9E530 0000001C 00149AC0 00000002 2A2A2A0A  [.............***]
2D9E540 30303220 38302D34 2033322D 333A3231  [ 2004-08-23 12:3]
2D9E550 30303A34 32332D25 2D252073 25207338  [4:00%-32s %-8s %]
2D9E560 7332332D 02D90020 60B16157 00000000  [-32s ...Wa.`....]
2D9E570 0000311B 39443220 34374546 25207300  [.1.. 2D9FE74.s %]
2D9E580 7332332D 342D2520 02000A73 0000311B  [-32s %-4s....1..]
2D9E590 655221B4 00140033 00000000 00000000  [.!Re3...........]
2D9E5A0 00000000 00000000 00000000 00000000  [................]
2D9E5B0 02D9FFEC 00000000 02D9FE74 00000000  [........t.......]
2D9E5C0 00000001 00000001 00000000 02D9DD38  [............8...]
2D9E5D0 00000003 02D9E5FC 0046E4DD 02D9E514  [..........F.....]
2D9E5E0 00000000 0000311B 0014C710 00000000  [.....1..........]
Argument/Register addr=2d9fbf8.  
Dump of memory from 0x2D9FBB8 to 0x2D9FCF8
2D9FBB0                   02D9FBEC 001F0003          [........]
2D9FBC0 02D9FBCC 02DD47B8 6083ED28 00000000  [.....G..(..`....]
2D9FBD0 00000000 02000000 00000000 00000000  [................]
2D9FBE0 00000000 003A0038 00000000 000000E8  [....8.:.........]
2D9FBF0 02D9FC10 7C581505 02D9FD82 FFFFFFFF  [......X|........]
2D9FC00 00000000 00000001 00000000 02D9FE88  [................]
2D9FC10 7C573D85 02D9FFB4 00403154 00000002  [.=W|....T1@.....]
2D9FC20 02D9FE74 00129D74 77D3ACD9 0012A200  [t...t......w....]
2D9FC30 0014F440 004000C8 77532E60 02D9FC88  [@.....@.`.Sw....]
2D9FC40 77F960AA 00400000 00000001 00000009  [.`.w..@.........]
2D9FC50 00000000 44414853 00000000 77530000  [....SHAD......Sw]
2D9FC60 00000002 01119880 00000000 000000E4  [................]
2D9FC70 02D9FC54 000C4004 02D9FD0C 77F81F55  [T....@......U..w]
2D9FC80 77F960E8 FFFFFFFF 02D9FD1C 77F963EF  [.`.w.........c.w]
2D9FC90 00400000 00000002 7FFDF000 7FFDC000  [..@.............]
2D9FCA0 77F880D0 77FD0348 77F8808C 02D9FD30  [...wH..w...w0...]
2D9FCB0 77D3ACD9 0012A200 00000000 00000000  [...w............]
2D9FCC0 00000000 00000000 00000000 00000000  [................]
        Repeat 2 times
2D9FCF0 00000000 7FFDC000                    [........]        
Argument/Register addr=2d9fe74.  
Dump of memory from 0x2D9FE34 to 0x2D9FF74
2D9FE30          00000002 00000349 E3487188      [....I....qH.]
2D9FE40 F7F00B5C FCDA2EF0 F7F00BB4 80451A5E  [\...........^.E.]
2D9FE50 E1008568 FCD9EF40 8046DBA0 FCDA2E88  [h...@.....F.....]
2D9FE60 F7F00CB0 E1008898 00000000 00000000  [................]
2D9FE70 F7F00BB4 02D9FD74 02D9FD82 FCD9EF40  [....t.......@...]
2D9FE80 00000000 00F80010 61726F2A 77617073  [........*oraspaw]
2D9FE90 65725F6E 5F796C70 79626162 5F6E6F6C  [n_reply_babylon_]
2D9FEA0 2A383634 00000000 0000001F FCDA2EF0  [468*............]
2D9FEB0 FCDA2EF0 00000000 00000001 F7F00C10  [................]
2D9FEC0 00000000 E32BAD38 F7F00BD4 00000000  [....8.+.........]
2D9FED0 80415381 FCDA2FF0 FCD9EF40 F7F00CC4  [.SA../..@.......]
2D9FEE0 80451197 00000004 FEFAF308 80496337  [..E.........7cI.]
2D9FEF0 0012F380 00000000 0012F348 002E8472  [........H...r...]
2D9FF00 00000000 00000000 C05016A4 00000141  [..........P.A...]
2D9FF10 C0501000 00020019 C05016A4 00000141  [..P.......P.A...]
2D9FF20 6273E229 C0501B98 77F57001 FF01D940  [).sb..P..p.w@...]
2D9FF30 FF018280 00000000 FF018410 F7F00C60  [............`...]
2D9FF40 00000246 8042DFC6 80062F10 FF0183E0  [F.....B../......]
2D9FF50 FF018280 F7F00C70 77F57005 C0501000  [....p....p.w..P.]
2D9FF60 FFBA7F28 00000000 F7F00CAC 00000000  [(...............]
2D9FF70 FF018410                             [....]            
----- End of Call Stack Trace -----
===================================================
Files currently opened by this process:
===================================================
PROCESS STATE
-------------
Process global information:
     process: 2f08214, call: 0, xact: 0, curses: 0, usrses: 0
  ----------------------------------------
  SO: 2f08214, type: 1, owner: 0, flag: INIT/-/-/0x00
  (process) Oracle pid=14, calls cur/top: 0/2f39538, flag: (0) -
            int error: 0, call error: 0, sess error: 0, txn error 0
  (post info) last post received: 0 0 84
              last post received-location: kgllldl: post after freeing latch
              last process to post me: 2f06f54 1 0
              last post sent: 0 0 13
              last post sent-location: ksasnd
              last process posted by me: 2f078b4 1 0
    (latch info) wait_event=0 bits=0
    Process Group: DEFAULT, pseudo proc: 2f10ec8
    O/S info: user: SYSTEM, term: BABYLON-SERVER, ospid: 468
    OSD pid info: 468
    ----------------------------------------
    SO: 2f9362c, type: 9, owner: 2f08214, flag: INIT/-/-/0x00
    (broadcast handle) flag: (1) PUBLISHER, owner: 2f08214,
                       event: 11, last message event: 0, messages published: 1
                       channel: (2f942fc) scumnt mount lock
                                scope: 101, event: 12, last mesage event: 12,
                                publishers/subscribers: 1/10,
                                messages published: 1
    ----------------------------------------
    SO: 2f940f4, type: 9, owner: 2f08214, flag: INIT/-/-/0x00
    (broadcast handle) flag: (2) ACTIVE SUBSCRIBER, owner: 2f08214,
                       event: 14, last message event: 14, messages read: 0
                       channel: (2f9421c) system events broadcast channel
                                scope: 101, event: 14, last mesage event: 0,
                                publishers/subscribers: 0/13,
                                messages published: 0
    ----------------------------------------
    SO: 2f39538, type: 2, owner: 2f08214, flag: INIT/-/-/0x00
    (call) sess: cur 0, rec 0, usr 0; depth: 0
END OF PROCESS STATE
This error is Not FATAL as it appears in the trace file.

you should be able to access your database.

Can you try to connect database now?
if not, what message does it give you?

USE sqlplus client will be fine.
You are brilliant!  I can get to my data from a client machine, so my children will not have to go to bed hungry.

I do however still have problems on my server.  I get a "ORA 12535 TNS opeartion timed out" error when trying to expand my tree in DBA Studio for example.  Most importantly, do you have any resommendations on how to back this up in this state?
ASKER CERTIFIED SOLUTION
Avatar of seazodiac
seazodiac
Flag of United States of America image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Many thanks!!