We did a dataguard switchover this past weekend for several of our databases. We then began running the rman backups from the new primary server. The archive log backups are failing on some of the switched databases. The problem seems to involve the archive logs created on the original primary between the time of the last archivelog backup on that server and the swtichover. Here's what happens:
The first archive log backup reported success, and included the interim-period archive logs described above
The next couple of backups failed with a message saying it can't find the first of the interim-period archive logs:
RMAN-03002: failure of backup command at 11/14/2010 08:36:18
RMAN-06059: expected archived log not found, lost of archived log compromises recoverability
ORA-19625: error identifying file /opt/app/oracle/admin/webp23/arch/webp23_1_561633885_118314.arc
ORA-27037: unable to obtain file status
SVR4 Error: 2: No such file or directory
Additional information: 3
So I copied them over from the original server. The next backup was happy, and included the interiim-period archive logs.
The next one failed with the same message above. So I copied them over again. Went through this cycle a couple of times before I realized the log files it was missing were the same ones over and over. (It was a hectic morning).
So I copied them over one more time and ran the RMAN CATALOG command: catalog archivelog 'blah1','blah2'...
Same results: the first archive log backup was happy, the next failed with the same problem. I'm running a crosscheck now, but I don't see how that's going to fix it.
Here, finally, is my question: How can I make future archive log backups succeed?
If anyone has had the patience to read through this rambling tale, I could sure use some help. Thanks.