kencrest
asked on
Oracle 10g EM Dbconsole will not start up!
Hello...
I'm running Oracle 10g (10.2.0.1) on RHEL4. My listener, database and Oracle HTTP Server are up and running. The sole purpose of this database is to run Oracle Application Express applications. The oracle apex applications are all running fine.
However, I cannot for the life of me get Oracle EM (dbconsole) running. I've tried everything but obviously not the right thing. I can't console to my running database? It keeps failing everytime I start it. I've looked at some logs but I don't know what I'm looking for. Oracle EM was running just fine on Friday, but wouldn't come up Monday morning.
My url for EM is http://172.23.183.169:1158/em
At the terminal session prompt I type >emctl start dbconsole
It comes back after a 5 minute timeout saying it failed. It appears that the agent (3938) does not want to start.
Here is some log info further below...
Please let me know what direction I should go on to resolve this. Thx!
Regards,
Ken
ENV VARIABLES:
[oracle@clthcmmb03 ~]$ env|sort
COLORTERM=gnome-terminal
DBUS_SESSION_BUS_ADDRESS=u nix:abstra ct=/tmp/db us-uEKexk6 EGd
DESKTOP_SESSION=default
DESKTOP_STARTUP_ID=
DISPLAY=:0.0
G_BROKEN_FILENAMES=1
GDMSESSION=default
GNOME_DESKTOP_SESSION_ID=D efault
GNOME_KEYRING_SOCKET=/tmp/ keyring-uF au6k/socke t
GTK_RC_FILES=/etc/gtk/gtkr c:/home/or acle/.gtkr c-1.2-gnom e2
HISTSIZE=1000
HOME=/home/oracle
HOSTNAME=clthcmmb03
INPUTRC=/etc/inputrc
KDEDIR=/usr
LANG=en_US.UTF-8
LD_LIBRARY_PATH=/home/orac le/oracle/ product/10 .2.0/db_1/ lib:/home/ oracle/ora cle/produc t/10.2.0/d b_2/opmn/l ib:
LESSOPEN=|/usr/bin/lesspip e.sh %s
LOGNAME=oracle
LS_COLORS=no=00:fi=00:di=0 0;34:ln=00 ;36:pi=40; 33:so=00;3 5:bd=40;33 ;01:cd=40; 33;01:or=0 1;05;37;41 :mi=01;05; 37;41:ex=0 0;32:*.cmd =00;32:*.e xe=00;32:* .com=00;32 :*.btm=00; 32:*.bat=0 0;32:*.sh= 00;32:*.cs h=00;32:*. tar=00;31: *.tgz=00;3 1:*.arj=00 ;31:*.taz= 00;31:*.lz h=00;31:*. zip=00;31: *.z=00;31: *.Z=00;31: *.gz=00;31 :*.bz2=00; 31:*.bz=00 ;31:*.tz=0 0;31:*.rpm =00;31:*.c pio=00;31: *.jpg=00;3 5:*.gif=00 ;35:*.bmp= 00;35:*.xb m=00;35:*. xpm=00;35: *.png=00;3 5:*.tif=00 ;35:
MAIL=/var/spool/mail/oracl e
ORACLE_HOME=/home/oracle/o racle/prod uct/10.2.0 /db_1
ORACLE_SID=apex
PATH=/home/oracle/oracle/p roduct/10. 2.0/db_1/b in:/home/o racle/orac le/product /10.2.0/db _2/opmn/bi n:/home/or acle/oracl e/product/ 10.2.0/db_ 1/bin:/hom e/oracle/o racle/prod uct/10.2.0 /db_2/opmn /bin:/usr/ kerberos/b in:/usr/lo cal/bin:/u sr/bin:/bi n:/usr/X11 R6/bin
PWD=/home/oracle
SESSION_MANAGER=local/clth cmmb03:/tm p/.ICE-uni x/6580
SHELL=/bin/bash
SHLVL=2
SSH_AGENT_PID=6632
SSH_ASKPASS=/usr/libexec/o penssh/gno me-ssh-ask pass
SSH_AUTH_SOCK=/tmp/ssh-dyb iGw6580/ag ent.6580
TERM=xterm
USER=oracle
_=/usr/bin/env
WINDOWID=39845962
XAUTHORITY=/home/oracle/.X authority
TERMINAL SESSION:
[oracle@clthcmmb03 ~]$ emctl start dbconsole
TZ set to US/Eastern
Oracle Enterprise Manager 10g Database Control Release 10.2.0.1.0
Copyright (c) 1996, 2005 Oracle Corporation. All rights reserved.
http://clthcmmb03:1158/em/console/aboutApplication
Starting Oracle Enterprise Manager 10g Database Control .......................... .......... .......... .......... .......... .......... .......... ....... failed.
-------------------------- ---------- ---------- ---------- ----------
Logs are generated in directory /home/oracle/oracle/produc t/10.2.0/d b_1/clthcm mb03_apex/ sysman/log
EMDCTL.TRC:
2007-08-13 15:08:39 Thread-3086911712 WARN http: snmehl_connect: connect failed to (clthcmmb03:3938): Connection refused (error = 111)
2007-08-13 15:08:45 Thread-3086911712 WARN http: snmehl_connect: connect failed to (clthcmmb03:1158): Connection refused (error = 111)
EMAGENT.TRC:
2007-08-13 14:40:34 Thread-3086911712 ERROR http: snmehl_allocateListenerPor t: failed to bind socket: Address already in use (errno=98)
2007-08-13 14:40:34 Thread-3086911712 ERROR http: nmehl_startHttpListener: failed to listen to HTTP port for http://clthcmmb03:3938/emd/main
2007-08-13 14:40:34 Thread-3086911712 ERROR main: nmehl_startHttpListener failed starting http listener
2007-08-13 15:10:12 Thread-3086911712 ERROR http: snmehl_allocateListenerPor t: failed to bind socket: Address already in use (errno=98)
2007-08-13 15:10:12 Thread-3086911712 ERROR http: nmehl_startHttpListener: failed to listen to HTTP port for http://clthcmmb03:3938/emd/main
2007-08-13 15:10:12 Thread-3086911712 ERROR main: nmehl_startHttpListener failed starting http listener
EMOMS.TRC:
2007-08-12 02:00:36,607 [NotificationMgrThread] ERROR jdbc.ConnectionWrapper _applySessionParams.2980 - SQLException message: ORA-01089: immediate shutdown in progress - no operations are permitted
java.sql.SQLException: ORA-01089: immediate shutdown in progress - no operations are permitted
at oracle.jdbc.driver.Databas eError.thr owSqlExcep tion(Datab aseError.j ava:111)
at oracle.jdbc.driver.T4CTTIo er.process Error(T4CT TIoer.java :330)
at oracle.jdbc.driver.T4CTTIo er.process Error(T4CT TIoer.java :287)
at oracle.jdbc.driver.T4C8Oal l.receive( T4C8Oall.j ava:742)
at oracle.jdbc.driver.T4CCall ableStatem ent.doOall 8(T4CCalla bleStateme nt.java:21 4)
at oracle.jdbc.driver.T4CCall ableStatem ent.execut eForRows(T 4CCallable Statement. java:953)
at oracle.jdbc.driver.OracleS tatement.d oExecuteWi thTimeout( OracleStat ement.java :1260)
at oracle.jdbc.driver.OracleP reparedSta tement.exe cuteIntern al(OracleP reparedSta tement.jav a:3290)
at oracle.jdbc.driver.OracleP reparedSta tement.exe cuteQuery( OraclePrep aredStatem ent.java:3 334)
at oracle.sysman.util.jdbc.Co nnectionWr apper._app lySessionP arams(Conn ectionWrap per.java:2 971)
at oracle.sysman.util.jdbc.Co nnectionWr apper.<ini t>(Connect ionWrapper .java:181)
at oracle.sysman.emSDK.svc.co nn.FGAConn ection.<in it>(FGACon nection.ja va:115)
at oracle.sysman.emSDK.svc.co nn.FGAConn ectionCach e.getFGACo nnection(F GAConnecti onCache.ja va:192)
at oracle.sysman.emSDK.svc.co nn.Connect ionService .getSystem Connection (Connectio nService.j ava:683)
at oracle.sysman.emdrep.notif ication.No tification Mgr.getCon nection(No tification Mgr.java:2 52)
at oracle.sysman.emdrep.notif ication.No tification Mgr.resetC onnection( Notificati onMgr.java :298)
at oracle.sysman.emdrep.notif ication.No tification Mgr.run(No tification Mgr.java:1 190)
I'm running Oracle 10g (10.2.0.1) on RHEL4. My listener, database and Oracle HTTP Server are up and running. The sole purpose of this database is to run Oracle Application Express applications. The oracle apex applications are all running fine.
However, I cannot for the life of me get Oracle EM (dbconsole) running. I've tried everything but obviously not the right thing. I can't console to my running database? It keeps failing everytime I start it. I've looked at some logs but I don't know what I'm looking for. Oracle EM was running just fine on Friday, but wouldn't come up Monday morning.
My url for EM is http://172.23.183.169:1158/em
At the terminal session prompt I type >emctl start dbconsole
It comes back after a 5 minute timeout saying it failed. It appears that the agent (3938) does not want to start.
Here is some log info further below...
Please let me know what direction I should go on to resolve this. Thx!
Regards,
Ken
ENV VARIABLES:
[oracle@clthcmmb03 ~]$ env|sort
COLORTERM=gnome-terminal
DBUS_SESSION_BUS_ADDRESS=u
DESKTOP_SESSION=default
DESKTOP_STARTUP_ID=
DISPLAY=:0.0
G_BROKEN_FILENAMES=1
GDMSESSION=default
GNOME_DESKTOP_SESSION_ID=D
GNOME_KEYRING_SOCKET=/tmp/
GTK_RC_FILES=/etc/gtk/gtkr
HISTSIZE=1000
HOME=/home/oracle
HOSTNAME=clthcmmb03
INPUTRC=/etc/inputrc
KDEDIR=/usr
LANG=en_US.UTF-8
LD_LIBRARY_PATH=/home/orac
LESSOPEN=|/usr/bin/lesspip
LOGNAME=oracle
LS_COLORS=no=00:fi=00:di=0
MAIL=/var/spool/mail/oracl
ORACLE_HOME=/home/oracle/o
ORACLE_SID=apex
PATH=/home/oracle/oracle/p
PWD=/home/oracle
SESSION_MANAGER=local/clth
SHELL=/bin/bash
SHLVL=2
SSH_AGENT_PID=6632
SSH_ASKPASS=/usr/libexec/o
SSH_AUTH_SOCK=/tmp/ssh-dyb
TERM=xterm
USER=oracle
_=/usr/bin/env
WINDOWID=39845962
XAUTHORITY=/home/oracle/.X
TERMINAL SESSION:
[oracle@clthcmmb03 ~]$ emctl start dbconsole
TZ set to US/Eastern
Oracle Enterprise Manager 10g Database Control Release 10.2.0.1.0
Copyright (c) 1996, 2005 Oracle Corporation. All rights reserved.
http://clthcmmb03:1158/em/console/aboutApplication
Starting Oracle Enterprise Manager 10g Database Control ..........................
--------------------------
Logs are generated in directory /home/oracle/oracle/produc
EMDCTL.TRC:
2007-08-13 15:08:39 Thread-3086911712 WARN http: snmehl_connect: connect failed to (clthcmmb03:3938): Connection refused (error = 111)
2007-08-13 15:08:45 Thread-3086911712 WARN http: snmehl_connect: connect failed to (clthcmmb03:1158): Connection refused (error = 111)
EMAGENT.TRC:
2007-08-13 14:40:34 Thread-3086911712 ERROR http: snmehl_allocateListenerPor
2007-08-13 14:40:34 Thread-3086911712 ERROR http: nmehl_startHttpListener: failed to listen to HTTP port for http://clthcmmb03:3938/emd/main
2007-08-13 14:40:34 Thread-3086911712 ERROR main: nmehl_startHttpListener failed starting http listener
2007-08-13 15:10:12 Thread-3086911712 ERROR http: snmehl_allocateListenerPor
2007-08-13 15:10:12 Thread-3086911712 ERROR http: nmehl_startHttpListener: failed to listen to HTTP port for http://clthcmmb03:3938/emd/main
2007-08-13 15:10:12 Thread-3086911712 ERROR main: nmehl_startHttpListener failed starting http listener
EMOMS.TRC:
2007-08-12 02:00:36,607 [NotificationMgrThread] ERROR jdbc.ConnectionWrapper _applySessionParams.2980 - SQLException message: ORA-01089: immediate shutdown in progress - no operations are permitted
java.sql.SQLException: ORA-01089: immediate shutdown in progress - no operations are permitted
at oracle.jdbc.driver.Databas
at oracle.jdbc.driver.T4CTTIo
at oracle.jdbc.driver.T4CTTIo
at oracle.jdbc.driver.T4C8Oal
at oracle.jdbc.driver.T4CCall
at oracle.jdbc.driver.T4CCall
at oracle.jdbc.driver.OracleS
at oracle.jdbc.driver.OracleP
at oracle.jdbc.driver.OracleP
at oracle.sysman.util.jdbc.Co
at oracle.sysman.util.jdbc.Co
at oracle.sysman.emSDK.svc.co
at oracle.sysman.emSDK.svc.co
at oracle.sysman.emSDK.svc.co
at oracle.sysman.emdrep.notif
at oracle.sysman.emdrep.notif
at oracle.sysman.emdrep.notif
ASKER
...yes my database is up and running...here is the results from what you requested above. The instance is called 'apex'. It is currently running Oracle Application Express applications which are working just fine. I just can't get in to the dbconsole for the life of me. The database server has a static ip address of 172.23.183.169.
Thx!
Ken
[oracle@clthcmmb03 ~]$ lsnrctl status
LSNRCTL for Linux: Version 10.2.0.1.0 - Production on 14-AUG-2007 11:31:27
Copyright (c) 1991, 2005, Oracle. All rights reserved.
Connecting to (DESCRIPTION=(ADDRESS=(PRO TOCOL=IPC) (KEY=EXTPR OC1)))
STATUS of the LISTENER
------------------------
Alias LISTENER
Version TNSLSNR for Linux: Version 10.2.0.1.0 - Production
Start Date 13-AUG-2007 12:40:18
Uptime 0 days 22 hr. 51 min. 9 sec
Trace Level off
Security ON: Local OS Authentication
SNMP ON
Listener Parameter File /home/oracle/oracle/produc t/10.2.0/d b_1/networ k/admin/li stener.ora
Listener Log File /home/oracle/oracle/produc t/10.2.0/d b_1/networ k/log/list ener.log
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PRO TOCOL=ipc) (KEY=EXTPR OC1)))
(DESCRIPTION=(ADDRESS=(PRO TOCOL=tcp) (HOST=clth cmmb03)(PO RT=1521)))
Services Summary...
Service "PLSExtProc" has 1 instance(s).
Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
Service "apex" has 2 instance(s).
Instance "apex", status UNKNOWN, has 1 handler(s) for this service...
Instance "apex", status READY, has 1 handler(s) for this service...
Service "apexXDB" has 1 instance(s).
Instance "apex", status READY, has 1 handler(s) for this service...
Service "apex_XPT" has 1 instance(s).
Instance "apex", status READY, has 1 handler(s) for this service...
The command completed successfully
[oracle@clthcmmb03 ~]$
[oracle@clthcmmb03 ~]$ ps -ef|grep pmon
oracle 6920 1 0 Aug13 ? 00:00:00 ora_pmon_apex
oracle 14172 6770 0 11:33 pts/1 00:00:00 grep pmon
[oracle@clthcmmb03 ~]$
Thx!
Ken
[oracle@clthcmmb03 ~]$ lsnrctl status
LSNRCTL for Linux: Version 10.2.0.1.0 - Production on 14-AUG-2007 11:31:27
Copyright (c) 1991, 2005, Oracle. All rights reserved.
Connecting to (DESCRIPTION=(ADDRESS=(PRO
STATUS of the LISTENER
------------------------
Alias LISTENER
Version TNSLSNR for Linux: Version 10.2.0.1.0 - Production
Start Date 13-AUG-2007 12:40:18
Uptime 0 days 22 hr. 51 min. 9 sec
Trace Level off
Security ON: Local OS Authentication
SNMP ON
Listener Parameter File /home/oracle/oracle/produc
Listener Log File /home/oracle/oracle/produc
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PRO
(DESCRIPTION=(ADDRESS=(PRO
Services Summary...
Service "PLSExtProc" has 1 instance(s).
Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
Service "apex" has 2 instance(s).
Instance "apex", status UNKNOWN, has 1 handler(s) for this service...
Instance "apex", status READY, has 1 handler(s) for this service...
Service "apexXDB" has 1 instance(s).
Instance "apex", status READY, has 1 handler(s) for this service...
Service "apex_XPT" has 1 instance(s).
Instance "apex", status READY, has 1 handler(s) for this service...
The command completed successfully
[oracle@clthcmmb03 ~]$
[oracle@clthcmmb03 ~]$ ps -ef|grep pmon
oracle 6920 1 0 Aug13 ? 00:00:00 ora_pmon_apex
oracle 14172 6770 0 11:33 pts/1 00:00:00 grep pmon
[oracle@clthcmmb03 ~]$
This is Linux.
To achive good functionality all
needed environment variables should be set.
% printenv
will show you the variables.
OEM uses ORACLE_SID to know which DB to access.
Check if it is set correctly.
Also PATH has to have entry to Oracle Home directory.
To achive good functionality all
needed environment variables should be set.
% printenv
will show you the variables.
OEM uses ORACLE_SID to know which DB to access.
Check if it is set correctly.
Also PATH has to have entry to Oracle Home directory.
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
Hi Schwertner,
Thx for the reply. I'll rebuilt the OEM repository as you recommended. My environmental variables are below that you wanted to see. Another question for you...why does my TNS Listener say that it has...2 instances for my service/sid 'apex'?? I have only one database instance on this machine named 'apex.' (TNS Listener Status is pasted in its entirety above in my previous message)
Service "apex" has 2 instance(s).
Instance "apex", status UNKNOWN, has 1 handler(s) for this service...
Instance "apex", status READY, has 1 handler(s) for this service...
Is this normal and ok??
Thx
Ken
My environment variables below are that you wanted to see:
ENV VARIABLES:
[oracle@clthcmmb03 ~]$ env|sort
COLORTERM=gnome-terminal
DBUS_SESSION_BUS_ADDRESS=u nix:abstra ct=/tmp/db us-uEKexk6 EGd
DESKTOP_SESSION=default
DESKTOP_STARTUP_ID=
DISPLAY=:0.0
G_BROKEN_FILENAMES=1
GDMSESSION=default
GNOME_DESKTOP_SESSION_ID=D efault
GNOME_KEYRING_SOCKET=/tmp/ keyring-uF au6k/socke t
GTK_RC_FILES=/etc/gtk/gtkr c:/home/or acle/.gtkr c-1.2-gnom e2
HISTSIZE=1000
HOME=/home/oracle
HOSTNAME=clthcmmb03
INPUTRC=/etc/inputrc
KDEDIR=/usr
LANG=en_US.UTF-8
LD_LIBRARY_PATH=/home/orac le/oracle/ product/10 .2.0/db_1/ lib:/home/ oracle/ora cle/produc t/10.2.0/d b_2/opmn/l ib:
LESSOPEN=|/usr/bin/lesspip e.sh %s
LOGNAME=oracle
LS_COLORS=no=00:fi=00:di=0 0;34:ln=00 ;36:pi=40; 33:so=00;3 5:bd=40;33 ;01:cd=40; 33;01:or=0 1;05;37;41 :mi=01;05; 37;41:ex=0 0;32:*.cmd =00;32:*.e xe=00;32:* .com=00;32 :*.btm=00; 32:*.bat=0 0;32:*.sh= 00;32:*.cs h=00;32:*. tar=00;31: *.tgz=00;3 1:*.arj=00 ;31:*.taz= 00;31:*.lz h=00;31:*. zip=00;31: *.z=00;31: *.Z=00;31: *.gz=00;31 :*.bz2=00; 31:*.bz=00 ;31:*.tz=0 0;31:*.rpm =00;31:*.c pio=00;31: *.jpg=00;3 5:*.gif=00 ;35:*.bmp= 00;35:*.xb m=00;35:*. xpm=00;35: *.png=00;3 5:*.tif=00 ;35:
MAIL=/var/spool/mail/oracl e
ORACLE_HOME=/home/oracle/o racle/prod uct/10.2.0 /db_1
ORACLE_SID=apex
PATH=/home/oracle/oracle/p roduct/10. 2.0/db_1/b in:/home/o racle/orac le/product /10.2.0/db _2/opmn/bi n:/home/or acle/oracl e/product/ 10.2.0/db_ 1/bin:/hom e/oracle/o racle/prod uct/10.2.0 /db_2/opmn /bin:/usr/ kerberos/b in:/usr/lo cal/bin:/u sr/bin:/bi n:/usr/X11 R6/bin
PWD=/home/oracle
SESSION_MANAGER=local/clth cmmb03:/tm p/.ICE-uni x/6580
SHELL=/bin/bash
SHLVL=2
SSH_AGENT_PID=6632
SSH_ASKPASS=/usr/libexec/o penssh/gno me-ssh-ask pass
SSH_AUTH_SOCK=/tmp/ssh-dyb iGw6580/ag ent.6580
TERM=xterm
USER=oracle
_=/usr/bin/env
WINDOWID=39845962
XAUTHORITY=/home/oracle/.X authority
Thx for the reply. I'll rebuilt the OEM repository as you recommended. My environmental variables are below that you wanted to see. Another question for you...why does my TNS Listener say that it has...2 instances for my service/sid 'apex'?? I have only one database instance on this machine named 'apex.' (TNS Listener Status is pasted in its entirety above in my previous message)
Service "apex" has 2 instance(s).
Instance "apex", status UNKNOWN, has 1 handler(s) for this service...
Instance "apex", status READY, has 1 handler(s) for this service...
Is this normal and ok??
Thx
Ken
My environment variables below are that you wanted to see:
ENV VARIABLES:
[oracle@clthcmmb03 ~]$ env|sort
COLORTERM=gnome-terminal
DBUS_SESSION_BUS_ADDRESS=u
DESKTOP_SESSION=default
DESKTOP_STARTUP_ID=
DISPLAY=:0.0
G_BROKEN_FILENAMES=1
GDMSESSION=default
GNOME_DESKTOP_SESSION_ID=D
GNOME_KEYRING_SOCKET=/tmp/
GTK_RC_FILES=/etc/gtk/gtkr
HISTSIZE=1000
HOME=/home/oracle
HOSTNAME=clthcmmb03
INPUTRC=/etc/inputrc
KDEDIR=/usr
LANG=en_US.UTF-8
LD_LIBRARY_PATH=/home/orac
LESSOPEN=|/usr/bin/lesspip
LOGNAME=oracle
LS_COLORS=no=00:fi=00:di=0
MAIL=/var/spool/mail/oracl
ORACLE_HOME=/home/oracle/o
ORACLE_SID=apex
PATH=/home/oracle/oracle/p
PWD=/home/oracle
SESSION_MANAGER=local/clth
SHELL=/bin/bash
SHLVL=2
SSH_AGENT_PID=6632
SSH_ASKPASS=/usr/libexec/o
SSH_AUTH_SOCK=/tmp/ssh-dyb
TERM=xterm
USER=oracle
_=/usr/bin/env
WINDOWID=39845962
XAUTHORITY=/home/oracle/.X
You have two entries in "LISTENER STATUS", because the first entry
seems to be the initial and the second is after registration of the
instance by the listener.
The main thing you have to pay attention is if you can
connect normally to the instance from other machine.
If not - you will need some additional simple
changes in the Listener config files.
seems to be the initial and the second is after registration of the
instance by the listener.
The main thing you have to pay attention is if you can
connect normally to the instance from other machine.
If not - you will need some additional simple
changes in the Listener config files.
ASKER
Hi Schwertner,
Welcome back from your trip! I went ahead and rebuilt my OEM Repository as you suggested and some interresting things happened.
>emca -config dbcontrol db -repos recreate
Although the repository created successfully, I got an error saying that dbcontrol could not start up as ports were in use. "SEVERE: Cannot start Database Control. The following ports are already in use: [Database Control HTTP port:1158 EM agent port:3938 RMI port for Database Control:5520 JMS port for Database Control:5540]."
This is the only database instance running on this machine. I'm confused as to why it would be giving me this error. Why does it think that these ports are in use?
Here's the output from the command, the log file, and a netstat -l listing showing which ports are listening.
Any help would be appreciated!
Thx!
Ken
INFO: Repository successfully created
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.EMConfi g perform
SEVERE: Cannot start Database Control. The following ports are already in use: [Database Control HTTP port:1158 EM agent port:3938 RMI port for Database Control:5520 JMS port for Database Control:5540].
Refer to the log file at /home/oracle/oracle/produc t/10.2.0/d b_1/cfgtoo llogs/emca /apex/emca _2007-08-2 0_05-34-00 -PM.log for more details.
Could not complete the configuration. Refer to the log file at /home/oracle/oracle/produc t/10.2.0/d b_1/cfgtoo llogs/emca /apex/emca _2007-08-2 0_05-34-00 -PM.log for more details.
[oracle@clthcmmb03 ~]$
LOG FILE Extract:
CONFIG: Successfully deployed state dirs for clthcmmb03
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.EMAgent Config performConfiguration
CONFIG: Successfully updated agent config files
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.util.Fi leUtil _copyFile
CONFIG: Copying file /home/oracle/oracle/produc t/10.2.0/d b_1/sysman /config/em d.properti es.emca.tm p to /home/oracle/oracle/produc t/10.2.0/d b_1/sysman /config/em d.properti es
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.util.Fi leUtil backupFile
CONFIG: The original file /home/oracle/oracle/produc t/10.2.0/d b_1/sysman /config/em d.properti es.emca.tm p has been copied to /home/oracle/oracle/produc t/10.2.0/d b_1/sysman /config/em d.properti es
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.util.Fi leUtil _copyFile
CONFIG: Copying file /home/oracle/oracle/produc t/10.2.0/d b_1/sysman /emd/targe ts.xml.emc a.tmp to /home/oracle/oracle/produc t/10.2.0/d b_1/sysman /emd/targe ts.xml
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.util.Fi leUtil backupFile
CONFIG: The original file /home/oracle/oracle/produc t/10.2.0/d b_1/sysman /emd/targe ts.xml.emc a.tmp has been copied to /home/oracle/oracle/produc t/10.2.0/d b_1/sysman /emd/targe ts.xml
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.EMConfi g perform
SEVERE: Cannot start Database Control. The following ports are already in use: [Database Control HTTP port:1158 EM agent port:3938 RMI port for Database Control:5520 JMS port for Database Control:5540].
Refer to the log file at /home/oracle/oracle/produc t/10.2.0/d b_1/cfgtoo llogs/emca /apex/emca _2007-08-2 0_05-34-00 -PM.log for more details.
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.EMConfi g perform
CONFIG: Stack Trace:
oracle.sysman.emcp.excepti on.EMConfi gException : Cannot start Database Control. The following ports are already in use: [Database Control HTTP port:1158 EM agent port:3938 RMI port for Database Control:5520 JMS port for Database Control:5540].
at oracle.sysman.emcp.EMDBPos tConfig.ar eDbcPortsF ree(EMDBPo stConfig.j ava:1661)
at oracle.sysman.emcp.EMDBPos tConfig.pe rformConfi guration(E MDBPostCon fig.java:4 51)
at oracle.sysman.emcp.EMDBPos tConfig.in voke(EMDBP ostConfig. java:177)
at oracle.sysman.emcp.EMDBPos tConfig.in voke(EMDBP ostConfig. java:146)
at oracle.sysman.emcp.EMConfi g.perform( EMConfig.j ava:155)
at oracle.sysman.emcp.EMConfi gAssistant .invokeEMC A(EMConfig Assistant. java:479)
at oracle.sysman.emcp.EMConfi gAssistant .performCo nfiguratio n(EMConfig Assistant. java:1123)
at oracle.sysman.emcp.EMConfi gAssistant .statusMai n(EMConfig Assistant. java:463)
at oracle.sysman.emcp.EMConfi gAssistant .main(EMCo nfigAssist ant.java:4 12)
NETSTAT -l
[oracle@clthcmmb03 ~]$ netstat -l
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 clthcmmb03:7200 *:* LISTEN
tcp 0 0 *:7777 *:* LISTEN
tcp 0 0 *:smux *:* LISTEN
tcp 0 0 *:mysql *:* LISTEN
tcp 0 0 *:netbios-ssn *:* LISTEN
tcp 0 0 *:5900 *:* LISTEN
tcp 0 0 clthcmmb03:2381 *:* LISTEN
tcp 0 0 0.0.0.6:2381 *:* LISTEN
tcp 0 0 172.23.183.169:2381 *:* LISTEN
tcp 0 0 *:sunrpc *:* LISTEN
tcp 0 0 *:10000 *:* LISTEN
tcp 0 0 *:1521 *:* LISTEN
tcp 0 0 *:krb5_prop *:* LISTEN
tcp 0 0 *:6003 *:* LISTEN
tcp 0 0 clthcmmb03:6100 *:* LISTEN
tcp 0 0 *:ftp *:* LISTEN
tcp 0 0 clthcmmb03:ipp *:* LISTEN
tcp 0 0 *:6200 *:* LISTEN
tcp 0 0 *:32792 *:* LISTEN
tcp 0 0 clthcmmb03:smtp *:* LISTEN
tcp 0 0 *:microsoft-ds *:* LISTEN
tcp 0 0 clthcmmb03:2301 *:* LISTEN
tcp 0 0 0.0.0.6:2301 *:* LISTEN
tcp 0 0 172.23.183.169:2301 *:* LISTEN
tcp 0 0 *:http *:* LISTEN
tcp 0 0 *:ssh *:* LISTEN
udp 0 0 *:2563 *:*
udp 0 0 clthcmmb03:1028 *:*
udp 0 0 clthcmmb03:1029 *:*
udp 0 0 clthcmmb03:1030 *:*
udp 0 0 172.23.183.169:netbios-ns *:*
udp 0 0 *:netbios-ns *:*
udp 0 0 172.23.183.169:netbios-dgm *:*
udp 0 0 *:netbios-dgm *:*
udp 0 0 *:2458 *:*
udp 0 0 clthcmmb03:25375 *:*
udp 0 0 clthcmmb03:25376 *:*
udp 0 0 *:snmp *:*
udp 0 0 *:snmptrap *:*
udp 0 0 *:2083 *:*
udp 0 0 *:2084 *:*
udp 0 0 clthcmmb03:25393 *:*
udp 0 0 *:748 *:*
udp 0 0 *:kerberos_master *:*
udp 0 0 *:sunrpc *:*
udp 0 0 *:ipp *:*
udp 0 0 172.23.183.169:ntp *:*
udp 0 0 clthcmmb03:ntp *:*
udp 0 0 *:ntp *:*
udp 0 0 *:ntp *:*
Active UNIX domain sockets (only servers)
Proto RefCnt Flags Type State I-Node Path
unix 2 [ ACC ] STREAM LISTENING 7579 /var/lib/mysql/mysql.sock
unix 2 [ ACC ] STREAM LISTENING 15701 /var/tmp/.oracle/sEXTPROC1
unix 2 [ ACC ] STREAM LISTENING 8173 /tmp/.font-unix/fs7100
unix 2 [ ACC ] STREAM LISTENING 13725 /tmp/.gdm_socket
unix 2 [ ACC ] STREAM LISTENING 15703 /var/tmp/.oracle/s#6840.1
unix 2 [ ACC ] STREAM LISTENING 13832 /tmp/.X11-unix/X0
unix 2 [ ACC ] STREAM LISTENING 15706 /var/tmp/.oracle/s#6840.2
unix 2 [ ACC ] STREAM LISTENING 14807 /tmp/mapping-oracle
unix 2 [ ACC ] STREAM LISTENING 14268 /tmp/ssh-dybiGw6580/agent. 6580
unix 2 [ ACC ] STREAM LISTENING 14295 /tmp/orbit-oracle/linc-19f 0-0-398f67 6f54732
unix 2 [ ACC ] STREAM LISTENING 14304 /tmp/orbit-oracle/linc-19b 4-0-3c90bd 7268e43
unix 2 [ ACC ] STREAM LISTENING 14462 /tmp/.ICE-unix/6580
unix 2 [ ACC ] STREAM LISTENING 14471 /tmp/keyring-uFau6k/socket
unix 2 [ ACC ] STREAM LISTENING 14481 /tmp/orbit-oracle/linc-19f 5-0-2a2e23 d663ad1
unix 2 [ ACC ] STREAM LISTENING 14275 @/tmp/dbus-uEKexk6EGd
unix 2 [ ACC ] STREAM LISTENING 14501 /tmp/orbit-oracle/linc-19f 7-0-20e59b 5678786
unix 2 [ ACC ] STREAM LISTENING 14597 /tmp/orbit-oracle/linc-1a1 5-0-3bae21 6a82e63
unix 2 [ ACC ] STREAM LISTENING 14627 /tmp/orbit-oracle/linc-1a2 0-0-45f53a 962d1b1
unix 2 [ ACC ] STREAM LISTENING 14663 /tmp/orbit-oracle/linc-1a2 4-0-4a81af b83fc8
unix 2 [ ACC ] STREAM LISTENING 14668 /tmp/orbit-oracle/linc-1a2 2-0-4a81af b84243
unix 2 [ ACC ] STREAM LISTENING 14692 /tmp/orbit-oracle/linc-1a2 6-0-4a81af ba2502
unix 2 [ ACC ] STREAM LISTENING 14716 /tmp/orbit-oracle/linc-1a2 8-0-4a81af bc1f69
unix 2 [ ACC ] STREAM LISTENING 14768 /tmp/orbit-oracle/linc-1a3 1-0-2d4011 61d8d3
unix 2 [ ACC ] STREAM LISTENING 14821 /tmp/orbit-oracle/linc-1a2 c-0-5b393e a916ecc
unix 2 [ ACC ] STREAM LISTENING 14837 /tmp/orbit-oracle/linc-1a3 b-0-5b393e a92aa98
unix 2 [ ACC ] STREAM LISTENING 14875 /tmp/orbit-oracle/linc-1a3 d-0-4d4825 aea283
unix 2 [ ACC ] STREAM LISTENING 14908 /tmp/orbit-oracle/linc-1a3 f-0-4d4825 ae6dc91
unix 2 [ ACC ] STREAM LISTENING 14976 /tmp/orbit-oracle/linc-1a4 2-0-4d4825 ae8e4db
unix 2 [ ACC ] STREAM LISTENING 15555 /tmp/orbit-oracle/linc-1a7 0-0-7c3ecf 6b622e4
unix 2 [ ACC ] STREAM LISTENING 3250446 /tmp/ksocket-oracle/kdeini t__0
unix 2 [ ACC ] STREAM LISTENING 3250448 /tmp/ksocket-oracle/kdeini t-:0
unix 2 [ ACC ] STREAM LISTENING 3250454 /tmp/.ICE-unix/dcop16694-1 187024927
unix 2 [ ACC ] STREAM LISTENING 3250475 /tmp/ksocket-oracle/klaunc herjAx6La. slave-sock et
unix 2 [ ACC ] STREAM LISTENING 3682455 /tmp/orbit-oracle/linc-1c7 e-0-56225c a3e7baf
unix 2 [ ACC ] STREAM LISTENING 1256092055 /tmp/orbit-oracle/linc-ca7 -0-368a06b ee8b42
unix 2 [ ACC ] STREAM LISTENING 7762 /dev/gpmctl
unix 2 [ ACC ] STREAM LISTENING 12341085 /tmp/mcop-oracle/clthcmmb0 3-7563-46c 0a1a3
unix 2 [ ACC ] STREAM LISTENING 14516 @/tmp/fam-oracle-
unix 2 [ ACC ] STREAM LISTENING 7145 /var/run/acpid.socket
unix 2 [ ACC ] STREAM LISTENING 11484 /var/run/dbus/system_bus_s ocket
[oracle@clthcmmb03 ~]$
Welcome back from your trip! I went ahead and rebuilt my OEM Repository as you suggested and some interresting things happened.
>emca -config dbcontrol db -repos recreate
Although the repository created successfully, I got an error saying that dbcontrol could not start up as ports were in use. "SEVERE: Cannot start Database Control. The following ports are already in use: [Database Control HTTP port:1158 EM agent port:3938 RMI port for Database Control:5520 JMS port for Database Control:5540]."
This is the only database instance running on this machine. I'm confused as to why it would be giving me this error. Why does it think that these ports are in use?
Here's the output from the command, the log file, and a netstat -l listing showing which ports are listening.
Any help would be appreciated!
Thx!
Ken
INFO: Repository successfully created
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.EMConfi
SEVERE: Cannot start Database Control. The following ports are already in use: [Database Control HTTP port:1158 EM agent port:3938 RMI port for Database Control:5520 JMS port for Database Control:5540].
Refer to the log file at /home/oracle/oracle/produc
Could not complete the configuration. Refer to the log file at /home/oracle/oracle/produc
[oracle@clthcmmb03 ~]$
LOG FILE Extract:
CONFIG: Successfully deployed state dirs for clthcmmb03
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.EMAgent
CONFIG: Successfully updated agent config files
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.util.Fi
CONFIG: Copying file /home/oracle/oracle/produc
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.util.Fi
CONFIG: The original file /home/oracle/oracle/produc
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.util.Fi
CONFIG: Copying file /home/oracle/oracle/produc
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.util.Fi
CONFIG: The original file /home/oracle/oracle/produc
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.EMConfi
SEVERE: Cannot start Database Control. The following ports are already in use: [Database Control HTTP port:1158 EM agent port:3938 RMI port for Database Control:5520 JMS port for Database Control:5540].
Refer to the log file at /home/oracle/oracle/produc
Aug 20, 2007 5:46:44 PM oracle.sysman.emcp.EMConfi
CONFIG: Stack Trace:
oracle.sysman.emcp.excepti
at oracle.sysman.emcp.EMDBPos
at oracle.sysman.emcp.EMDBPos
at oracle.sysman.emcp.EMDBPos
at oracle.sysman.emcp.EMDBPos
at oracle.sysman.emcp.EMConfi
at oracle.sysman.emcp.EMConfi
at oracle.sysman.emcp.EMConfi
at oracle.sysman.emcp.EMConfi
at oracle.sysman.emcp.EMConfi
NETSTAT -l
[oracle@clthcmmb03 ~]$ netstat -l
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 clthcmmb03:7200 *:* LISTEN
tcp 0 0 *:7777 *:* LISTEN
tcp 0 0 *:smux *:* LISTEN
tcp 0 0 *:mysql *:* LISTEN
tcp 0 0 *:netbios-ssn *:* LISTEN
tcp 0 0 *:5900 *:* LISTEN
tcp 0 0 clthcmmb03:2381 *:* LISTEN
tcp 0 0 0.0.0.6:2381 *:* LISTEN
tcp 0 0 172.23.183.169:2381 *:* LISTEN
tcp 0 0 *:sunrpc *:* LISTEN
tcp 0 0 *:10000 *:* LISTEN
tcp 0 0 *:1521 *:* LISTEN
tcp 0 0 *:krb5_prop *:* LISTEN
tcp 0 0 *:6003 *:* LISTEN
tcp 0 0 clthcmmb03:6100 *:* LISTEN
tcp 0 0 *:ftp *:* LISTEN
tcp 0 0 clthcmmb03:ipp *:* LISTEN
tcp 0 0 *:6200 *:* LISTEN
tcp 0 0 *:32792 *:* LISTEN
tcp 0 0 clthcmmb03:smtp *:* LISTEN
tcp 0 0 *:microsoft-ds *:* LISTEN
tcp 0 0 clthcmmb03:2301 *:* LISTEN
tcp 0 0 0.0.0.6:2301 *:* LISTEN
tcp 0 0 172.23.183.169:2301 *:* LISTEN
tcp 0 0 *:http *:* LISTEN
tcp 0 0 *:ssh *:* LISTEN
udp 0 0 *:2563 *:*
udp 0 0 clthcmmb03:1028 *:*
udp 0 0 clthcmmb03:1029 *:*
udp 0 0 clthcmmb03:1030 *:*
udp 0 0 172.23.183.169:netbios-ns *:*
udp 0 0 *:netbios-ns *:*
udp 0 0 172.23.183.169:netbios-dgm
udp 0 0 *:netbios-dgm *:*
udp 0 0 *:2458 *:*
udp 0 0 clthcmmb03:25375 *:*
udp 0 0 clthcmmb03:25376 *:*
udp 0 0 *:snmp *:*
udp 0 0 *:snmptrap *:*
udp 0 0 *:2083 *:*
udp 0 0 *:2084 *:*
udp 0 0 clthcmmb03:25393 *:*
udp 0 0 *:748 *:*
udp 0 0 *:kerberos_master *:*
udp 0 0 *:sunrpc *:*
udp 0 0 *:ipp *:*
udp 0 0 172.23.183.169:ntp *:*
udp 0 0 clthcmmb03:ntp *:*
udp 0 0 *:ntp *:*
udp 0 0 *:ntp *:*
Active UNIX domain sockets (only servers)
Proto RefCnt Flags Type State I-Node Path
unix 2 [ ACC ] STREAM LISTENING 7579 /var/lib/mysql/mysql.sock
unix 2 [ ACC ] STREAM LISTENING 15701 /var/tmp/.oracle/sEXTPROC1
unix 2 [ ACC ] STREAM LISTENING 8173 /tmp/.font-unix/fs7100
unix 2 [ ACC ] STREAM LISTENING 13725 /tmp/.gdm_socket
unix 2 [ ACC ] STREAM LISTENING 15703 /var/tmp/.oracle/s#6840.1
unix 2 [ ACC ] STREAM LISTENING 13832 /tmp/.X11-unix/X0
unix 2 [ ACC ] STREAM LISTENING 15706 /var/tmp/.oracle/s#6840.2
unix 2 [ ACC ] STREAM LISTENING 14807 /tmp/mapping-oracle
unix 2 [ ACC ] STREAM LISTENING 14268 /tmp/ssh-dybiGw6580/agent.
unix 2 [ ACC ] STREAM LISTENING 14295 /tmp/orbit-oracle/linc-19f
unix 2 [ ACC ] STREAM LISTENING 14304 /tmp/orbit-oracle/linc-19b
unix 2 [ ACC ] STREAM LISTENING 14462 /tmp/.ICE-unix/6580
unix 2 [ ACC ] STREAM LISTENING 14471 /tmp/keyring-uFau6k/socket
unix 2 [ ACC ] STREAM LISTENING 14481 /tmp/orbit-oracle/linc-19f
unix 2 [ ACC ] STREAM LISTENING 14275 @/tmp/dbus-uEKexk6EGd
unix 2 [ ACC ] STREAM LISTENING 14501 /tmp/orbit-oracle/linc-19f
unix 2 [ ACC ] STREAM LISTENING 14597 /tmp/orbit-oracle/linc-1a1
unix 2 [ ACC ] STREAM LISTENING 14627 /tmp/orbit-oracle/linc-1a2
unix 2 [ ACC ] STREAM LISTENING 14663 /tmp/orbit-oracle/linc-1a2
unix 2 [ ACC ] STREAM LISTENING 14668 /tmp/orbit-oracle/linc-1a2
unix 2 [ ACC ] STREAM LISTENING 14692 /tmp/orbit-oracle/linc-1a2
unix 2 [ ACC ] STREAM LISTENING 14716 /tmp/orbit-oracle/linc-1a2
unix 2 [ ACC ] STREAM LISTENING 14768 /tmp/orbit-oracle/linc-1a3
unix 2 [ ACC ] STREAM LISTENING 14821 /tmp/orbit-oracle/linc-1a2
unix 2 [ ACC ] STREAM LISTENING 14837 /tmp/orbit-oracle/linc-1a3
unix 2 [ ACC ] STREAM LISTENING 14875 /tmp/orbit-oracle/linc-1a3
unix 2 [ ACC ] STREAM LISTENING 14908 /tmp/orbit-oracle/linc-1a3
unix 2 [ ACC ] STREAM LISTENING 14976 /tmp/orbit-oracle/linc-1a4
unix 2 [ ACC ] STREAM LISTENING 15555 /tmp/orbit-oracle/linc-1a7
unix 2 [ ACC ] STREAM LISTENING 3250446 /tmp/ksocket-oracle/kdeini
unix 2 [ ACC ] STREAM LISTENING 3250448 /tmp/ksocket-oracle/kdeini
unix 2 [ ACC ] STREAM LISTENING 3250454 /tmp/.ICE-unix/dcop16694-1
unix 2 [ ACC ] STREAM LISTENING 3250475 /tmp/ksocket-oracle/klaunc
unix 2 [ ACC ] STREAM LISTENING 3682455 /tmp/orbit-oracle/linc-1c7
unix 2 [ ACC ] STREAM LISTENING 1256092055 /tmp/orbit-oracle/linc-ca7
unix 2 [ ACC ] STREAM LISTENING 7762 /dev/gpmctl
unix 2 [ ACC ] STREAM LISTENING 12341085 /tmp/mcop-oracle/clthcmmb0
unix 2 [ ACC ] STREAM LISTENING 14516 @/tmp/fam-oracle-
unix 2 [ ACC ] STREAM LISTENING 7145 /var/run/acpid.socket
unix 2 [ ACC ] STREAM LISTENING 11484 /var/run/dbus/system_bus_s
[oracle@clthcmmb03 ~]$
Check for running firewall(s).
Investigate for ports list in RHEL.
http://download.oracle.com/docs/cd/B25329_01/doc/admin.102/b25107/network.htm
http://download-east.oracle.com/docs/cd/B25006_01/install.1012/install/ports.htm
Investigate for ports list in RHEL.
http://download.oracle.com/docs/cd/B25329_01/doc/admin.102/b25107/network.htm
http://download-east.oracle.com/docs/cd/B25006_01/install.1012/install/ports.htm
ASKER
Hi Schwertner,
Thx for all your help. I thought I'd let you know that I finally got the problem resolved. I had to call Oracle Support and they worked thru the problem with me. Believe it or not, it turned out to be a simple problem that caused a big mess. My 'hosts' file (/etc/hosts) was not set correctly. I did not have the fully qualified domain name set for the host/machine name. Once it was set we went thru dropping the repository, recreating it, and the configuring it. Afterwards everything went back to running beautifully. The Oracle support person mentioned how Oracle 10g EM is very sensitive to the host name as many parts of the Web Admin interface reference the java components by means of the host name.
I thought you'd be interrested in the update. Thx again for everything and all your help. I truly appreciate it. I'm sure we'll be talking again in this forum! ;-)
Kind Regards,
Ken
Thx for all your help. I thought I'd let you know that I finally got the problem resolved. I had to call Oracle Support and they worked thru the problem with me. Believe it or not, it turned out to be a simple problem that caused a big mess. My 'hosts' file (/etc/hosts) was not set correctly. I did not have the fully qualified domain name set for the host/machine name. Once it was set we went thru dropping the repository, recreating it, and the configuring it. Afterwards everything went back to running beautifully. The Oracle support person mentioned how Oracle 10g EM is very sensitive to the host name as many parts of the Web Admin interface reference the java components by means of the host name.
I thought you'd be interrested in the update. Thx again for everything and all your help. I truly appreciate it. I'm sure we'll be talking again in this forum! ;-)
Kind Regards,
Ken
Hello Ken,
really the Linux installations aree very taugh!
But in this case I think you will not be able to connect to
the DB via SQP*Plus from other machine.
I am very glad that you have solved the problem.
Best Regards
Joe
really the Linux installations aree very taugh!
But in this case I think you will not be able to connect to
the DB via SQP*Plus from other machine.
I am very glad that you have solved the problem.
Best Regards
Joe
% lsnrctl status
% ps -ef | grep pmon