Advertisement

05.09.2008 at 11:23AM PDT, ID: 23390393
[x]
Attachment Details
[x]
The Solution Rating System

With so many solutions, how can you tell which solutions are most likely to help you and which ones are not? To provide you with a tool to use, we rate our solutions based on various elements that most accurately determine if a solution is a quality solution. To explain what factors affect the solution rating, here are the elements we take into consideration when formulating our solution rating.

  • The Grade of the Solution
  • The Zone Rank of the Expert Providing the Solution
  • The Number of Author and Expert Comments
  • The Number of Experts Contributing
  • The Feedback of the Community

Your Input Matters
Because of the way the system is set up, the most important variable in this equation is you. As a member of Experts Exchange, you are able to cast your vote on the quality of the solutions in regard to how complete, accurate, helpful and easy to understand each solution is. When you provide your feedback, each rating is adjusted accordingly. So, if you see a solution that has a poor rating that you think is a good solution, let us know by rating it. As you do, the rating will be adjusted and will become more accurate for other members of our site.

If you have any suggestions that you would like to make for our rating system, please ask a question in the Suggestions Zone of Community Support.

Thank you!

Oracle 1089 error but database never shutdown

A cron job running on HPUX received an Oracle 1089 error message (immediate shutdown in progress no operations allowed).  However, there is no sign in the alert log that the instance shutdown.  The statup time - Julian value shows the database was restarted on Thursday morning.  The error was received at 1904 Thursday night.  The database is version 7.3.4 (yes, ancient history).  even if the processes were killed at the OS level, the startup would show in the alert log.
Start your free trial to view this solution
Question Stats
Zone: Database
Question Asked By: gkraft3
Solution Provided By: gkraft3
Participating Experts: 3
Solution Grade: A
Views: 0
Translate:
Loading Advertisement...
05.09.2008 at 11:26AM PDT, ID: 21535327

Rank: Master

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.09.2008 at 11:35AM PDT, ID: 21535397

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.09.2008 at 01:41PM PDT, ID: 21536271

Rank: Master

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.09.2008 at 02:04PM PDT, ID: 21536397

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.09.2008 at 03:01PM PDT, ID: 21536644

Rank: Master

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.12.2008 at 05:34AM PDT, ID: 21546265

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.12.2008 at 06:13AM PDT, ID: 21546614

Rank: Sage

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.12.2008 at 06:17AM PDT, ID: 21546668

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.12.2008 at 06:20AM PDT, ID: 21546703

Rank: Sage

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.12.2008 at 06:23AM PDT, ID: 21546732

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.12.2008 at 08:17AM PDT, ID: 21547708

Rank: Master

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.12.2008 at 08:23AM PDT, ID: 21547766

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
 
Loading Advertisement...
Microsoft
  • Internet Protocols
  • Applications
  • Development
  • OS
  • Hardware
  • Windows Security
Apple
  • Operating Systems
  • Hardware
  • Programming
  • Networking
  • Software
Internet
  • Search Engines
  • File Sharing
  • WebTrends / Stats
  • Spy / Ad Blockers
  • Web Browsers
  • New Net Users
  • Web Development
  • Chat / IM
  • Anti Spam
  • Web Servers
  • Anti-Virus
  • Email Clients
Gamers
  • Tips
  • Online / MMORPG
  • Puzzle
  • Emulators
  • Action / Adventure
  • Role Playing
  • Consoles
  • Game Programming
  • Strategy
  • Sports
  • Misc
  • Computer Games
Digital Living
  • Hardware
  • New Net Users
  • New Users
  • Software
  • Digital Music
  • Gaming World
  • Home Security
  • Apple
  • Networking Hardware
Virus & Spyware
  • Vulnerabilities
  • IDS
  • Encryption
  • Anti-Virus
  • Operating Systems Security
  • Software Firewalls
  • WebApplications
  • Cell Phones
  • Operating Systems
  • Internet
  • Hardware Firewalls
Hardware
  • Handhelds / PDAs
  • Displays / Monitors
  • Components
  • Networking Hardware
  • Peripherals
  • Laptops/Notebooks
  • Storage
  • Servers
  • Desktops
  • New Users
  • Misc
  • Apple
Software
  • System Utilities
  • Industry Specific
  • Network Management
  • Photos / Graphics
  • Page Layout
  • VMWare
  • Misc
  • Web Development
  • OS
  • CYGWIN
  • Voice Recognition
  • Message Queue
  • Quality Assurance
  • Security
  • Firewalls
  • MultiMedia Applications
  • Development
  • Database
  • Office / Productivity
  • Business Management
  • OS/2 Apps
  • Server Software
  • Internet / Email
ITPro
  • OS
  • Storage
  • Encryption
  • Operating Systems Security
  • Apple Hardware
  • Laptops & Notebooks
  • Servers
  • Networking Hardware
  • Peripherals
  • Devices
  • Displays / Monitors
  • WebTrends / Stats
  • Search Engines
  • Firewalls
  • WebApplications
  • IDS
  • Vulnerabilities
  • Email Clients
  • File Sharing
  • Spy / Ad Blockers
  • Web Browsers
  • Web Servers
  • Networking
  • Anti-Virus
  • Chat / IM
  • Anti Spam
Developer
  • Web Servers
  • Web Browsers
  • Game Programming
  • Dev Tools
  • Industry Specific
  • Office / Productivity
  • Database
  • CYGWIN
  • Web Development
  • Search Engines
  • File Sharing
  • WebTrends / Stats
  • Programming
  • Content Management
  • Application Servers
  • Protocols
Storage
  • Removable Backup Media
  • Storage Technology
  • Servers
  • Grid
  • Remote Access
  • Backup / Restore
  • Misc
  • Hard Drives
OS
  • Miscellaneous
  • Security
  • Development
  • Linux
  • VMWare
  • MainFrame OS
  • Unix
  • Apple
  • OS / 2
  • AS / 400
  • BeOS
  • Microsoft
  • VMS / OpenVMS
Database
  • Oracle
  • Miscellaneous
  • MySQL
  • Software
  • Sybase
  • Contact Management
  • PostgreSQL
  • Data Manipulation
  • Clarion
  • InterSystems Cache
  • Siebel
  • MUMPS
  • OLAP
  • SQLBase
  • SAS
  • GIS & GPS
  • 4GL
  • Berkeley DB
  • DB2
  • Informix
  • Interbase / Firebird
  • FoxPro
  • Reporting
  • LDAP
  • Filemaker Pro
  • MS SQL Server
  • dBase
  • MS Access
Security
  • Misc
  • Web Browsers
  • Software Firewalls
  • Operating Systems Security
  • File Sharing
  • Spy / Ad Blockers
  • Vulnerabilities
  • WebApplications
  • IDS
  • Anti-Virus
  • Encryption
  • Anti Spam
  • Email Clients
  • VPN
  • Chat / IM
Programming
  • Editors IDEs
  • Installation
  • Handhelds / PDAs
  • Multimedia Programming
  • System / Kernel
  • Algorithms
  • Game
  • Signal Processing
  • Project Management
  • Open Source
  • Database
  • Misc
  • Languages
  • Processor Platforms
  • Theory
Web Development
  • Scripting
  • Blogs
  • Web Servers
  • Software
  • Search Engines
  • Web Graphics
  • Images
  • Internet Marketing
  • Images and Photos
  • Components
  • Document Imaging
  • Web Languages/Standards
  • Illustration
  • WebApplications
  • Fonts
  • WebTrends / Stats
  • Authoring
  • Digital Camera Software
  • Miscellaneous
Networking
  • Protocols
  • Apple Networking
  • Network Management
  • Message Queue
  • Application Servers
  • Content Management
  • File Servers
  • Email Servers
  • Misc
  • Java Editors & IDEs
  • Wireless
  • Networking Hardware
  • Backup / Restore
  • System Utilities
  • ISPs & Hosting
  • Web Servers
  • Storage Technology
  • Removable Backup Media
  • Servers
  • Broadband
  • Grid
  • OS / 2
  • Novell Netware
  • Unix Networking
  • Windows Networking
  • Security
  • Telecommunications
  • Operating Systems
  • Linux Networking
Other
  • Community Advisor
  • Lounge
  • Community Support
  • New Net Users
  • Philosophy / Religion
  • Math / Science
  • Miscellaneous
  • URLs
  • Expert Lounge
  • Politics
  • Puzzles / Riddles
Community Support
  • Suggestions
  • New to EE
  • New Topics
  • Community Advisor
  • CleanUp
  • Announcements
  • General
  • Feedback
  • Input
  • EE Bugs
 
05.09.2008 at 11:26AM PDT, ID: 21535327

Rank: Master

do you have more than 1 databases on same server?

make sure cron job is trying to connect with right database.
Assisted Solution
 
05.09.2008 at 11:35AM PDT, ID: 21535397
The cron job was connected to the correct database and was in the process of running.  Sorry i wasn't clearer on that.  The process started at 1900 and ran several steps.  Then, at 1904, the database access was rejected with the 1089 error message.  The rest of the job failed because the process was no longer connected to the database.
 
05.09.2008 at 01:41PM PDT, ID: 21536271

Rank: Master

Can you log into the instance?

If you're able to do so, can you attempt to shutdown? If it truly is in the process of shutting down then it would complain.

If it is still stuck in that state, you could issue shutdown abort;

When you restart, you'll need to give it some time as smon would be performing recovery operations.

R.
Assisted Solution
 
05.09.2008 at 02:04PM PDT, ID: 21536397
The database does a nightly cold backup so it has already restarted.  Plus there were other cron jobs run afterward that all logged into the database successfully.  Other than this error from this one job, there is no indication the database ever went down until it's scheduled backup.  That's why this is so confusing.  I think the error message that was sent was wrong.  I do know this job's connection was lost, but I don't think the database was ever down.
 
05.09.2008 at 03:01PM PDT, ID: 21536644

Rank: Master

Is this the first time this has happened or have you just noticed the log?

If you are taking cold backups then the instance must be shut down but from what you've reported, it doesn't appear that the instance did shut down. You may need to review your script to ensure that you're not copying Oracle files while they are still open.

Did you write the cron jobs?

Are you ever going to upgrade? :)

R.
Assisted Solution
 
05.12.2008 at 05:34AM PDT, ID: 21546265
It's the first time that anyone has seen this happen.

The cold backups are done at midnight.  We have a total of three copies of the same database.  The database is brought down, the "extra" set of mirrored files are split off and the database restarted.  This part of the process takes only about 5 minutes.  The backup is done on the offline copy of the database.  When the backup is complete, the thrid mirror is then synchronized with the other two copies.  We don't have EMC, but emulated some of its functions this way.

The problem occurred at 7:04 PM.  There are no other jobs or files or indications that the database was actually down, including a user being logged into the database starting at about 630 and getting out about 7:07.  The user hasn't reported any problem.

I didn't write the cron job, it has been around for a number of years.

The client does want to "upgrade" and has an initiative to re-write the application using SQL Server and .NET rather than staying with Oracle, as the complexion of the shop has changed in the intervening 15 years since the application was created to a Windows-centric organization.  I'm playing caretaker.

Has anyone seen Oracle throw this "database shutdown in progress" error when the database really isn't shutting down, in any version of the software?
 
05.12.2008 at 06:13AM PDT, ID: 21546614

Rank: Sage

Is this an OPS system?  Anything funny happening in the listener log?
Assisted Solution
 
05.12.2008 at 06:17AM PDT, ID: 21546668
The listener log showed no activity, as in no new connections, during the time.

The usual application run against this database is Forms 4.5-based.  There are few users who have any direct access to the database.

 
05.12.2008 at 06:20AM PDT, ID: 21546703

Rank: Sage

Is it OPS or a single instance?  Any trace files generated?
Assisted Solution
 
05.12.2008 at 06:23AM PDT, ID: 21546732
Sorry i didnt' answer clearly before.  This is a single instance and no trace files were generated.
 
05.12.2008 at 08:17AM PDT, ID: 21547708

Rank: Master

Have you since this message again since?

R.
Assisted Solution
 
05.12.2008 at 08:23AM PDT, ID: 21547766
Nothing since.  At least a portion of the process was run manually on Friday morning, successfully.  The next usual run of this process will be tomorrow night.  Also, this is not a new process.  It runs virtually every Tuesday and Thursday night, which makes this even harder to troubleshoot.  My basic question remains: has anyone seen an ORA-01089 issued even though the database wasn't really shutting down?

Thanks for the help.
Accepted Solution
 
 
20080236-EE-VQP-29 / EE_QW_2_20070628