Veritas Backup Exec v 10 - Verify Fails Nightly Backup

2-weeks ago my nightly backups started to fail during the "verify" operation.  

I have two questions....

1. Is the verify process important - can I recover w/o verification of the checksum; AND
2. How do I fix this issue, so the backup finishes successfully?

Details:
Windows 2003 Server
Veritas v10 Rev. 5484
Remote Agent(s)

Thanks - c
chrisjdeckerAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

rindiCommented:
Verify can be important, but the only and best way to make sure your backup is OK is to pick out 2 or 3 random files from every backup, then restore those to a folder you have reserved for that. Then open the files with the program they originaly got created with to make sure they aren't corrupt. If the backup starts failing, you should first at least clean the tape drive heads with a cleaning tape, and if that doesn't help, replace the tapes.

What types of tapes are you using? Tapes of DDS types you shouldn't use more than 20 - 30 cycles, as they don't last very long. DLT or similar tapes will last a lot longer...

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
David_FongCommented:
Please post the log file so we can see why it is failing, there are hundreds of possibilities and without the log we can only guess.

BTW, Rev 5484 isn't fully supported, first thing Veritas support will say if you ring them is to upgrade to Rev 5520 even though 5484 was what comes on the CD :(
chrisjdeckerAuthor Commented:
Log below...Please note that the files on the server have not changed so upon verification it should work...right?




Job Log for Daily Oracle Backup


--------------------------------------------------------------------------------


Completed status: Failed  Expand AllCollapse All  
Job Information
Job server: MyServer1_Workstation
Job name: Daily Oracle Backup
Job started: Monday, January 02, 2006 at 4:00:00 AM
Job type: Backup
Job Log: BEX_MyServer1_Workstation_00581.xml

 

Drive and media mount requested: 1/2/2006 4:00:00 AM

Device and Media Information
Drive and media information from media mount: 1/2/2006 4:00:05 AM
Drive Name: QUANTUM 1
Media Label: DLT000046
Media GUID: {dd36e296-0978-4af5-88c5-018ffd493989}
Overwrite Protected Until: 12/31/1899 6:00:00 PM
Appendable Until: 12/30/9999 6:00:00 PM
Targeted Media Set Name: Daily Oracle Backup Media Set

 


Job Operation - Backup  
Backup Options
Media operation - append.
Hardware compression enabled.

 



Server - MyServer1OR1
Network control connection is established between 1.1.1.1:4540 <--> 1.1.50.1:10000
Network data connection is established between  1.1.1.1:4612 <--> 1.1.50.1:2669

Set Information - \\MyServer1OR1\Z: BACKUPS
Backup Set Information
Family Name: "Media created 12/28/2005 3:00:01 AM"
Backup of "\\MyServer1OR1\Z: BACKUPS"
Backup set #12 on storage media #1
Backup set description: "Daily Oracle Backup"
Backup Type: Full - Back Up Files - Reset Archive Bit

 


Backup started on 1/2/2006 at 4:01:39 AM.
Backup completed on 1/2/2006 at 4:17:44 AM.

Backup Set Summary
Backed up 173 files in 8 directories.
Processed 50,514,522,396 bytes in  16 minutes and  5 seconds.
Throughput rate: 2995 MB/min

 

 

 


Server - MyServer1_Workstation

Set Information - D:  
Backup Set Information
Family Name: "Media created 12/28/2005 3:00:01 AM"
Backup of "D: "
Backup set #13 on storage media #1
Backup set description: "Daily Oracle Backup"
Backup Type: Full - Back Up Files - Reset Archive Bit

 


Backup started on 1/2/2006 at 4:17:45 AM.
Backup completed on 1/2/2006 at 4:21:27 AM.

Backup Set Summary
Backed up 668 files in 266 directories.
Processed 8,731,291,813 bytes in  3 minutes and  42 seconds.
Throughput rate: 2250 MB/min

 

 


Set Information - C:  
Backup Set Information
Family Name: "Media created 12/28/2005 3:00:01 AM"
Backup of "C: "
Backup set #14 on storage media #1
Backup set description: "Daily Oracle Backup"
Backup Type: Full - Back Up Files - Reset Archive Bit

 


Backup started on 1/2/2006 at 4:21:32 AM.
Backup completed on 1/2/2006 at 4:21:38 AM.

Backup Set Summary
Backed up 42 files in 6 directories.
Processed 29,694,472 bytes in  6 seconds.
Throughput rate: 283 MB/min

 

 

 


Server - MyServer1_Historian
Network control connection is established between 1.1.1.1:3474 <--> 1.1.1.1:10000
Network data connection is established between  1.1.1.1:3480 <--> 1.1.1.1:4822

Set Information - \\MyServer1_Historian\S: Data_S
Backup Set Information
Family Name: "Media created 12/28/2005 3:00:01 AM"
Backup of "\\MyServer1_Historian\S: Data_S"
Backup set #15 on storage media #1
Backup set description: "Daily Oracle Backup"
Backup Type: Full - Back Up Files - Reset Archive Bit

 


Backup started on 1/2/2006 at 4:21:40 AM.
Backup completed on 1/2/2006 at 4:38:26 AM.

Backup Set Summary
Backed up 118 files in 3 directories.
Processed 31,675,499,400 bytes in  16 minutes and  46 seconds.
Throughput rate: 1802 MB/min

 

 

 

 


Job Operation - Verify  

Set Information - \\MyServer1_Database\Z: BACKUPS
Verify Set Information
Verify of "\\MyServer1_Database\Z: BACKUPS"
Backup set #12 on storage media #1
Backup set description: "Daily Oracle Backup"

 


Verify started on 1/2/2006 at 4:40:21 AM.

Verify Set Detail Information
Difference encountered in file data.
The file \backup\ABB_20060102_578621701_12780 is different.
Difference encountered in file data.
The file \backup\ABB_20060101_578535466_12755 is different.
Difference encountered in file data.
The file \backup\ABB_20051230_578362773_12702 is different.
Difference encountered in file data.
The file \backup\ABB_20051230_578362668_12701 is different.
Difference encountered in file data.
The file \backup\ABB_20051229_578276738_12680 is different.
Difference encountered in file data.
The file \backup\ABB_20051229_578276621_12674 is different.
Difference encountered in file data.
The file \backup\ABB_20051229_578276516_12673 is different.

 

Verify completed on 1/2/2006 at 4:55:36 AM.

Verify Set Summary
Verified 173 files in 8 directories.
7 files were different.
Processed 50,514,522,396 bytes in  15 minutes and  15 seconds.
Throughput rate: 3159 MB/min

 

 


Set Information - D:  
Verify Set Information
Verify of "D: "
Backup set #13 on storage media #1
Backup set description: "Daily Oracle Backup"

 


Verify started on 1/2/2006 at 4:55:36 AM.
Verify completed on 1/2/2006 at 4:59:04 AM.

Verify Set Summary
Verified 668 files in 266 directories.
0 files were different.
Processed 8,731,291,813 bytes in  3 minutes and  28 seconds.
Throughput rate: 2402 MB/min

 

 


Set Information - C:  
Verify Set Information
Verify of "C: "
Backup set #14 on storage media #1
Backup set description: "Daily Oracle Backup"

 


Verify started on 1/2/2006 at 4:59:04 AM.
Verify completed on 1/2/2006 at 4:59:04 AM.

Verify Set Summary
Verified 42 files in 6 directories.
0 files were different.
Processed 29,694,472 bytes in  1 second.
Throughput rate: 1699 MB/min

 

 


Set Information - \\MyServer1_Historian\S: Data_S
Verify Set Information
Verify of "\\MyServer1_Historian\S: Data_S"
Backup set #15 on storage media #1
Backup set description: "Daily Oracle Backup"

 


Verify started on 1/2/2006 at 4:59:05 AM.

Verify Set Detail Information
Difference encountered in file data.
The file \PI\BackupFiles\piarch.091 is different.
Difference encountered in file data.
The file \PI\BackupFiles\piarch.096 is different.
Difference encountered in file data.
The file \PI\BackupFiles\piarch.099 is different.
Difference encountered in file data.
The file \PI\BackupFiles\piarch.278 is different.
Difference encountered in file data.
The file \PI\BackupFiles\piarch.296 is different.
Difference encountered in file data.
The file \PI\BackupFiles\piarch.298 is different.
Difference encountered in file data.
The file \PI\BackupFiles\piarch.305 is different.

 

Verify completed on 1/2/2006 at 5:12:08 AM.

Verify Set Summary
Verified 118 files in 3 directories.
7 files were different.
Processed 31,675,499,400 bytes in  13 minutes and  3 seconds.
Throughput rate: 2315 MB/min



Job Completion Status
Job ended: Monday, January 02, 2006 at 5:12:23 AM
Completed status: Failed

 

Errors
Click an error below to locate it in the job log
Verify- \\MyServer1_Database\Z: BACKUPSDifference encountered in file data.
The file \backup\ABB_20060102_578621701_12780 is different.
Difference encountered in file data.
The file \backup\ABB_20060101_578535466_12755 is different.
Difference encountered in file data.
The file \backup\ABB_20051230_578362773_12702 is different.
Difference encountered in file data.
The file \backup\ABB_20051230_578362668_12701 is different.
Difference encountered in file data.
The file \backup\ABB_20051229_578276738_12680 is different.
Difference encountered in file data.
The file \backup\ABB_20051229_578276621_12674 is different.
Difference encountered in file data.
The file \backup\ABB_20051229_578276516_12673 is different.
Verify- \\MyServer1_Historian\S: Data_SDifference encountered in file data.
The file \PI\BackupFiles\piarch.091 is different.
Difference encountered in file data.
The file \PI\BackupFiles\piarch.096 is different.
Difference encountered in file data.
The file \PI\BackupFiles\piarch.099 is different.
Difference encountered in file data.
The file \PI\BackupFiles\piarch.278 is different.
Difference encountered in file data.
The file \PI\BackupFiles\piarch.296 is different.
Difference encountered in file data.
The file \PI\BackupFiles\piarch.298 is different.
Difference encountered in file data.
The file \PI\BackupFiles\piarch.305 is different.
Python 3 Fundamentals

This course will teach participants about installing and configuring Python, syntax, importing, statements, types, strings, booleans, files, lists, tuples, comprehensions, functions, and classes.

David_FongCommented:
All these files that fail to verify are in directories called backup. Since there is no mention of an Oracle agent it's pretty obvious that Oracle is doing its own backup to disk and then it is intended for BE to back these files to tape. That's a pretty common scenario since the Backup Exec DB agents cost a packet but in your case it seems that BE is starting its job before Oracle's backup has finished. Delaying the Backup Exec job for an hour should solve the problem.

As you've got version 10 you should delay the backup using the time window properties of the selection list rather than under the job itself, then you can delegate the task of deciding when this backup starts to the Oracle DBA without letting them affect other servers covered by the same job policy.

The Oracle backup probably leaves old copies of the backup files behind for a few days so it would normally be possible to restore something but those files that it fails to verify won't be restorable so you would have to go back to Monday's backup rather than Tuesday's if it all blows up on Wednesday.

Talk it over with whoever setup Oracle if the time window is getting critical, they might archive some old data which would not only speed the backup but the database itself (not that yours is running slow).
David_FongCommented:
Sorry, I just read the logfile and missed your comment... "Please note that the files on the server have not changed so upon verification it should work...right?"

Right. It must be verifying against the wrong thing, restart the BE remote agent on the target server.
FLVS_407Commented:
I am having similar issues in Backup Exec 12.5
Only one of my servers is failing during the verify process.
All other backups scheduled run fine so I know its not a hardware failure
Gonna have to call Symantec :(


VerifyMedia mount failed.
Physical Volume Library Drive or Robot paused, offline, or disabled.
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Storage Software

From novice to tech pro — start learning today.