Question

ORA-16038: log 4 sequence# 10840 cannot be archived,ORA-19502: write error on file "", blockno (blocksize=,ORA-00312: online log 4 thread 1: '/ora01/oradata/pbm1/redo/redo04a',ORA-16014: log 4 seque

Asked by: daniesh

On Thursday, Feb 14, at about 8:20 - 8:30 pm, pacific time, the partition holding archive logs filled up completely so the database staooped processing transactions. The space that was available in the partition earlier in the day was sufficient for 3-5 days of "normal" archive log buildup, yet it seems to have filled up in only about a 45 minute time frame immediately before the processing stopped.

I really need to know what was hammering my database so hard it produced that kind of transaction history in only 45 minutes.

the error which i ngot in alert log :
 ORA-16038: log 4 sequence# 10840 cannot be archived
ORA-19502: write error on file "", blockno  (blocksize=)
ORA-00312: online log 4 thread 1: '/ora01/oradata/pbm1/redo/redo04a'
ORA-00312: online log 4 thread 1: '/usr1/oradata/pbm1/redo/redo04b'
Thu Feb 14 20:16:24 2008
Thread 1 advanced to log sequence 10842
  Current log# 6 seq# 10842 mem# 0: /ora01/oradata/pbm1/redo/redo06a
  Current log# 6 seq# 10842 mem# 1: /usr1/oradata/pbm1/redo/redo06b
  Current log# 6 seq# 10842 mem# 0: /ora01/oradata/pbm1/redo/redo06a
  Current log# 6 seq# 10842 mem# 1: /usr1/oradata/pbm1/redo/redo06b
Thu Feb 14 20:16:24 2008
ARC1: Beginning to archive log# 4 seq# 10840
ARC1: Archiving not possible: No primary destinations
ARC1: Failed to archive log# 4 seq# 10840
ARCH: Archival stopped, error occurred. Will continue retrying
Thu Feb 14 20:16:24 2008
ORACLE Instance stndby - Archival Error
ARCH: Connecting to console port...
Thu Feb 14 20:16:24 2008
ORA-16014: log 4 sequence# 10840 not archived, no available destinations
ORA-00312: online log 4 thread 1: '/ora01/oradata/pbm1/redo/redo04a'
ORA-00312: online log 4 thread 1: '/usr1/oradata/pbm1/redo/redo04b'
ARCH: Connecting to console port...
ARCH:
 ORA-16014: log 4 sequence# 10840 not archived, no available destinations
ORA-00312: online log 4 thread 1: '/ora01/oradata/pbm1/redo/redo04a'
ORA-00312: online log 4 thread 1: '/usr1/oradata/pbm1/redo/redo04b'
Thu Feb 14 20:16:34 2008

i know that this error is cause of archive destination gets full.
as i have said my archive destination size is good but on thursday my destination got full in 45 mins
could anybody explain me why archiving is genereted so fast.???

Thanks,
Daniesh

This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.

Subscribe now for full access to Experts Exchange and get

Instant Access to this Solution

  • Plus...
  • 30 Day FREE access, no risk, no obligation
  • Collaborate with the world's top tech experts
  • Unlimited access to our exclusive solution database
  • Never be left without tech help again

Subscribe Now

Trusted by hundreds of thousands everyday for fast, accurate and reliable tech support.

  • "The time we save is the biggest benefit of Experts Exchange to Warner Bros. What could take multiple guys 2 hours or more each to find is accessed in around 15 minutes on Experts Exchange." Mike Kapnisakis, Warner Bros.
  • "Our team likes having a resource that is more secure than just using Google and most experts using this service really know their stuff. It's nice to look here first versus using Google." Dayna Sellner, Lockheed Martin
  • "Anytime that I've been stumped with a problem, 9 out of 10 times Experts Exchange has either the accepted solution or an open discussion of the potential solution to the problem." Kenny Red, eBay Inc.

See what Experts Exchange can do for you.

Got a question?

We've got the answer.

Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.

Screenshot of Experts Exchange Knowledgebase

Need individual assistance?

Our experts are ready to help.

If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.

Screenshot of Experts Exchange Knowledgebase

Want to learn from the best?

Read articles from industry experts.

Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.

Screenshot of an Article

Working on a long term project?

Store your work and research.

Save solutions to your questions, answers you’ve discovered through searching plus helpful articles in your personal knowledgebase for easy future access.

Screenshot of Experts Exchange Knowledgebase

Access the answers to your technology questions today.

Subscribe Now

30-day free trial. Register in 60 seconds.

What Makes Experts Exchange Unique?

Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Trusted by the world's most respected brands.

image of each brand's logo

Faithfully serving IT professionals since 1996.

Experts Exchange Logo

Try it out and discover for yourself.

Subscribe Now

30-day free trial. Register in 60 seconds.

Related Solutions

  1. Oracle sequence
    Hi I have an oracle sequence that sometimes returns numbers bellow the value returned in a previous nextval call. The sequence was created like this: CREATE SEQUENCE seq_cdr INCREMENT BY 1 START WITH 1 MINVALUE 1 MAXVALUE 999999999999999999999999999 NOCYCLE NOORDER C...
  2. reset ORACLE Seq. conditionally ?
    How we can reset an ORACLE sequence to its initial value when year changes automatically. ie Conditionally reset a Sequence Object ???? Eg: CREATE SEQUENCE my_seq INCREMENT 1 START WITH 1 MAXVALUE 1000 CYCLE ; SELECT my_seq.NEXTVAL FROM DUAL 1 2 3...
  3. Deleting Oracle sequences
    One of my oracle tables uses a sequence . Is it possible for me to reduce the sequence value ?
  4. Oracle Sequence  error
    hi I am using PB 7 as front end and oracle 9 as back end .I am getting error ORA08002 :sequence SEQ_BATCH_ID.currval not yet defined in session.this sequence is using in one procedure. this sequence not getting current val.So i regerate that sequence,but still giving this er...
  5. Oracle and sequences
    I have a SAP system interfacing with an Oracle backend. I have an theory that I'd love to get some feedback on from Oracle experts about whether it can be done using sequences. I need to generate a key value with a prescribed input mask. For instance I have three types of m...

Free Tech Articles

  1. WARNING: 5 Reasons why you should NEVER fix a computer for free.
    It is in our nature to love the puzzle. We are obsessed. The lot of us. We love puzzles. We love the challenge. We thrive on finding the answer. We hate disarray. It bothers us deep in our soul. W...
  2. SCCM OSD Basic troubleshooting
    SCCM 2007 OSD is a fantastic way to deploy operating systems, however, like most things SCCM issues can sometimes be difficult to resolve due to the sheer volume of logs to sift through and the dispe...
  3. Migrate Small Business Server 2003 to Exchange 2010 and Windows 2008 R2
    This guide is intended to provide step by step instructions on how to migrate from Small Business Server 2003 to Windows 2008 R2 with Exchange 2010. For this migration to work you will need the fo...
  4. Create a Win7 Gadget
    This article shows you how to create a simple "Gadget" -- a sort of mini-application supported by Windows 7 and Vista. Gadgets can be dropped anywhere on the desktop to provide instant information, ...
  5. Outlook continually prompting for username and password
    There have been a lot of questions recently regarding Outlook prompting for a username and password whilst using Exchange 2007. There are a few reasons why this would happen and I will try to cover t...
  6. Backup Exchange 2010 Information Store using Windows Backup
    There seems to be quite a lot of confusion around the ability to backup Exchange 2010 using the built in Windows Backup feature. This stems from the omission of this feature prior to Exchange 2007 s...

Cloud Class Webinars

  1. Avoiding Bugs in Microsoft Access
    Alison Balter takes and in-depth look at avoiding bugs in Access. In this webinar you will learn about using the immediate window to debug your applications, invoking the debugger, using breakpoints to troubleshoot, stepping through code, setting the next statement to execute, ...
  2. Top 10 Best New Features in Visio 2010
    Scott Helmers gives live demonstrations of the top 10 new features in Visio 2010. This webinar will teach you how to create compelling diagrams by adding shapes to the page with a single click, linking the shapes in a diagram to data in Excel (or SQL Server, or SharePoint), ...
  3. IT Consultant Business Secrets Revealed
    Michael Munger, Experts Exchange tech pro and IT consultant, pulls back the curtain on his very successful businesses and answers question on every IT consultant and business owner should know about. He shares secrets on what he did to solve the 5 most common problems in IT, ...
  4. Disaster Recovery and Business Continuity
    Quest CTO, Mike Billon, gives an overview of the steps involved in building a dunamic disaster recovery plan. Through case studies and an examination of software/hardware tooles for monitoring and testing, you'll gain a better understandin of where you are, where you want ...
  5. Organize Your Visio Diagrams with Containers and Lists
    Scott Helmers uses cross functional flowcharts, wireframe diagrams, data graphic legends and seating charts to teach you: how to ustilize all three new structured diagram components in Visio 2010, the best practices for organizeing shapes in previous version of Visio, how to organize ...
  6. How to Us Objects, Properties, Events and Methods in Microsoft Access
    Alison Dalter gives an in-depbth look at objects, properties, events and methods in Microsoft Access. In this webinar you will learn about using the object browser, referring to objects, working with properties and methods, working with object variables, understanding the ...

Join the Community

Give a Little. Get a Lot.

Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.

Join the Community

Answers

 

by: IanStuartPosted on 2008-02-20 at 04:18:20ID: 20937041

Hi Daniesh,

typical ones are mass deletes...or huge data loads/inserts.

Do you have an idea what could have happened during that time?

Cheers
Ian

 

by: johnsonePosted on 2008-02-20 at 06:26:14ID: 20937988

Use LogMiner and look at a couple of the logs.  That should tell you what types of things were going on.

 

by: schwertnerPosted on 2008-02-20 at 07:16:57ID: 20938534

Did you hot backup? This happens when the DBA forget to switch the tablespaces from backup to normal mode.

 

by: danieshPosted on 2008-02-20 at 09:53:42ID: 20940142

Hi  johnsone,
is the concepts of log miner is available in 8i.could you please tell me how to use log miner in 8i. how i will know that which query is causing problem. As this errored occured at feb 14 so how i will which query had created the problem.???

 

by: johnsonePosted on 2008-02-20 at 10:32:16ID: 20940477

Yes log miner is available for Oracle 8i.

What you need are the archive logs from the time that this occurred.

There are 2 packages that you need to use DBMS_LOGMNR_D and DBMS_LOGMNR.  DBMS_LOGMNR_D is not necessary, but it helps with determinings what was going on as it will translate the object ids to the actual names.

What log miner can do is recreate the statements that occurred.  They will not be the exact statements, but they will be recreated statements that would accomplish the same thing.

After using DBMS_LOGMNR_D to create a dictionary file, you use DBMS_LOGMNR.ADD_LOGFILE to add the archive logs.  After adding the archive logs use DBMS_LOGMNR.START_LOGMNR to start the process.  I will caution you to not add a lot of log files, it takes a while to go through each one.

Now query V$LOGMNR_CONTENTS.  A real simple query to use as a guage to find out what was going on is this one:

select seg_owner, seg_name, operation, count(1)
from v$logmnr_contents
group by seg_owner, seg_name, operation;

You can run log miner in any database as long as it is the same version of Oracle.  I believe it has to be the same character set as well, but I am not sure about that one.  You need to create the dictionary using DBMS_LOGMNR_D in the source database, but you can take that file to any database and use it.  The database you run log miner is does not have to have the same users or schemas either.

 

by: danieshPosted on 2008-02-20 at 10:59:06ID: 20940697

Hi johnsone,
thank you very much.
one more qustion as you can see my post that error occured on feb 14. now is possible to know which query or session was creating a problem. is there chance that we can know with the help of statspack report that which query or session created a problem on 14th feb.

cheers,
Daniesh

 

by: johnsonePosted on 2008-02-20 at 11:25:14ID: 20940914

It does not matter when the problem occurred.  You just need the archive files from when it occurred.

There is a session informatoin in V$LOGMNR_CONTENTS that could help you determine who/what ran the query.

From stats pack, I do not believe you would be able to tell which query or queries generated all the redo.

 

by: danieshPosted on 2008-02-20 at 11:26:58ID: 20940926

hi,

ORA-16038: log 4 sequence# 10840 cannot be archived
ORA-19502: write error on file "", blockno  (blocksize=)
ORA-00312: online log 4 thread 1: '/ora01/oradata/pbm1/redo/redo04a'
ORA-00312: online log 4 thread 1: '/usr1/oradata/pbm1/redo/redo04b'
Thu Feb 14 20:16:24 2008
Thread 1 advanced to log sequence 10842
  Current log# 6 seq# 10842 mem# 0: /ora01/oradata/pbm1/redo/redo06a
  Current log# 6 seq# 10842 mem# 1: /usr1/oradata/pbm1/redo/redo06b
  Current log# 6 seq# 10842 mem# 0: /ora01/oradata/pbm1/redo/redo06a
  Current log# 6 seq# 10842 mem# 1: /usr1/oradata/pbm1/redo/redo06b
Thu Feb 14 20:16:24 2008
ARC1: Beginning to archive log# 4 seq# 10840
ARC1: Archiving not possible: No primary destinations
ARC1: Failed to archive log# 4 seq# 10840
ARCH: Archival stopped, error occurred. Will continue retrying
Thu Feb 14 20:16:24 2008
ORACLE Instance stndby - Archival Error
ARCH: Connecting to console port...
Thu Feb 14 20:16:24 2008
ORA-16014: log 4 sequence# 10840 not archived, no available destinations
ORA-00312: online log 4 thread 1: '/ora01/oradata/pbm1/redo/redo04a'
ORA-00312: online log 4 thread 1: '/usr1/oradata/pbm1/redo/redo04b'
ARCH: Connecting to console port...
ARCH:
 ORA-16014: log 4 sequence# 10840 not archived, no available destinations
ORA-00312: online log 4 thread 1: '/ora01/oradata/pbm1/redo/redo04a'
ORA-00312: online log 4 thread 1: '/usr1/oradata/pbm1/redo/redo04b'
Thu Feb 14 20:16:34 2008

is there any way to solve the above error???

Thanks,
Daniesh

 

by: danieshPosted on 2008-02-20 at 11:35:35ID: 20941013

hi johnsone,
thanks for your reply.
i think i will not get better reply than this.
thanks once again..

cheers,
Daniesh

 

by: danieshPosted on 2008-02-20 at 12:34:44ID: 20941627

what is the way to check tthat my log miner is configured or not???

Thanks,
Daniesh

 

by: danieshPosted on 2008-02-20 at 12:47:17ID: 20941765

is anyone looking into this???

 

by: johnsonePosted on 2008-02-20 at 12:54:45ID: 20941841

The errors occurred because the archive destination file system filled.  Clearing out the archives would solve the issue.

To see if log miner is installed, you can log in as a privileged user and describe the two packages I mentioned.  If they are there, then log miner is installed.  They should be there because the packages are created when you run catproc.

 

by: danieshPosted on 2008-02-20 at 13:05:55ID: 20941961

hi johnsone,
suppose my log miner is already available on my database. now i want to use the log miner to extract the transactions information. we have to use   the new logminer dictionary or the old ones which was created earlier.how i will know which log miner dictionary is available. is there any dynamic views to check it.

 

by: johnsonePosted on 2008-02-20 at 13:22:25ID: 20942097

The dictionary for log miner is not stored in Oracle and is not part of the data dictionary, is that where the confusion is coming in?

The log miner dictionary that is created with DBMS_LOGMNR_D is a mapping between the user ids and object ids that exist in the database to the real names and also to convert the datatypes stored in the archive logs to readable values.  If you build it using DBMS_LOGMNR_D.BUILD, then a text file will be created that is the dictionary mapping and will be used as an input to DBMS_LOGMNR.START_LOGMNR.  As I said before, this is optional, but very handy, as nobody really knows what the ids are and how to read raw data.

If there have been structural changes in your database since the archive logs were created, that is OK.  If log miner cannot determine what the value is, it will still report the ids.

 

by: danieshPosted on 2008-02-20 at 13:31:03ID: 20942169

Hi johsone,
what i am saying is now my clients want me to use log miner to find the problematic query.
i have never used it before. he has asked me that he wants the extract the log file information from 8 to 9 pm on feb 14. coulld you please tell me whole step. so that i can deploy this steps on PROD server.
please help.....

 

by: johnsonePosted on 2008-02-21 at 05:22:49ID: 20947410

As I said before, you are not going to get the exact query from log miner.  Log miner gives you reconstructed queries of what happened.

For example, if a single delete statement was run that deleted 1,000 records, log miner is going to give you 1,000 statements that would accomplish the same thing.

Log miner does not need to be run on the production server.  You just need to copy the archives from the timeframe you want to look at to any server.

You need to run all the log miner commands logged in as SYS.

On production, I believe you need to set utl_file_dir in order to build the dictionary, then run DBMS_LOGMNR_D.BUILD giving it the file name you want the dictionary to be created in.

Take this file and all the archives to any machine with the same version of oracle running (it can be the production machine but it does not have to be).

Run DBMS_LOGMNR.ADD_LOGFILE for each archive log you want to look at.

Run DBMS_LOGMNR.START_LOGMNR and specify the dictionary file that was created with DBMS_LOGMNR_D.BUILD.

Now, query V$LOGMNR_CONTENTS to get the contents of the archive logs.  You can use the query I gave above to get a general idea of what was going on.  There are going to be commands that are unreadable, do not worry about those, they are dictionary activity that you could not recreate anyway.

 

by: danieshPosted on 2008-02-22 at 01:12:48ID: 20955637

Hi johnsone,
i need to know one more thing which thing can we know with the help of log miner.
we can know only the query which  was fired at that particular day or also the cause ??
please explain me???

Thanks,
Daniesh

 

by: johnsonePosted on 2008-02-22 at 05:55:39ID: 20957226

From log miner, you can get the reconstructed queries and the user that ran it.  From there it will probably take some detective work to determine the application that it came from, it all depends on your environment.

An archive/redo log does not contain queries that were run.  All an archive/redo log contains are change vectors.  The values that changed and where they are located in the data file.  Using that information log miner reconstructs a query that would accomplish the same thing, however it is very likely that it is not the original query.

 

by: danieshPosted on 2008-02-22 at 12:18:02ID: 20961007

ok thanks i got it.
thank you very for clearing my concepts of log miner.

Daniesh

20120131-EE-VQP-002

3 Ways to Join

30-Day Free Trial

The Experts

98% positive feedback on 31,087 answers since March 2000. angeliii is a Microsoft Most Valuable Professional for his work with MS SQL Server & Develoment.

He has also proven his knowledge of Visual Basic Programming, PHP Scripting and Oracle Databases.

The Experts

97% positive feedback on 10,752 answers since July 2000. lrmoore has more than 18 years experience in the networking industry.

The six-time Mircosoft MVPs specialties include firewalls, virtual private networking, and network management.

Testimonials

"...and excellent source for support... Kind of like having your very own IT dept." Electriciansnet

Testimonials

"I was apprehensive at signing up at first. However... it has already made my life as an IT administrator much easier." JaCrews

Testimonials

"WOW! You guys have great, active, and knowledgeable people on here." moore50

Business Clients

Business Clients

In the Press

"If you’ve got a question... Experts Exchange can supply an answer.”

In the Press

"...an invaluable aid for both IT professionals and those who require tech support."

In the Press

"where IT professionals provide quick answers on just about any topic"

Business Account Plans

Loading Advertisement...