ANR1081E Space reclamation is ended for volume. Storage media is inaccessible

I hope you aren't serious about the second part of your Q! IBM have one-week classes to teach the stuff you requested.
Anyway, for the first part - obviously something must have happened to that volume.
1) Check in TSM (dsmadmc) with Q VOL 006073 F=D for Volume Status, Access, In Error State?, Number of Write Errors, Number of Read Errors and also Volume Location.
Are there any abnormalities? What is the location?
2) Check (again in dsmadmc) with Q LIBVOL libraryname 006073
Does the volume show up? If not, it's either actually no longer in the library or TSM is not aware that it's present.
3) Use your tape library's reporting utilities to find out whether the volume is still in the inventory or not. If the library doesn't know about the volume, check by examining the inventory with your own eyes. Is the volume there? If not, you've found the issue. Where could the volume have been gone?
If it's in the library, but the library doesn't know it - use your library's "re-inventory" mechanism to make it available.
In any case, whether you had to re-inventory or not, use TSM's AUDIT LIBRARY libraryname to make to volume known to TSM again.
wmp
 
 

Here is some basic explanation of TSM's policy terms -
http://lazysystemadmin.blogspot.com/2010/09/tsm-tivoli-storage-manager-policy.html
I always recommend the Infocenters -
5.5 - http://publib.boulder.ibm.com/infocenter/tivihelp/v1r1/index.jsp
6.1 - http://publib.boulder.ibm.com/infocenter/tsminfo/v6/index.jsp
... and the developerworks Wiki - https://www.ibm.com/developerworks/wikis/display/tivolistoragemanager/Home
wmp

When i issue following command : Q VOL 006073 F=D

******************************************************************************
Volume Name: 006073
             Storage Pool Name: TBACK6
             Device Class Name: TDEV3592
            Estimated Capacity: 484,532.3
       Scaled Capacity Applied: 100
                      Pct Util: 0.3
                 Volume Status: Full
                        Access: Read/Write
        Pct. Reclaimable Space: 99.9
               Scratch Volume?: Yes
               In Error State?: No
      Number of Writable Sides: 1
       Number of Times Mounted: 4
             Write Pass Number: 1
     Approx. Date Last Written: 06/21/10 02:24:17
        Approx. Date Last Read: 06/27/10 12:48:06
           Date Became Pending:
        Number of Write Errors: 0
         Number of Read Errors: 0
               Volume Location:
Volume is MVS Lanfree Capable : No
Last Update by (administrator):
         Last Update Date/Time: 06/20/10 10:58:26
          Begin Reclaim Period:
            End Reclaim Period:
  Drive Encryption Key Manager: None
******************************************************************************
Not showing any errors also location is not showing any thing

When i issue command "Q LIBVOL libraryname 006073" it is showing :

Library Name Volume Name Status           Owner      Last Use  Home    Device
                                                               Element Type  
------------ ----------- ---------------- ---------- --------- ------- ------
L3494B       006073      Private                     Data                    

So , how can i know wheres the problem as i am getting the output of the commands. Also today i didnt get that message, so how shud i trace it down whats the issue

Thanks

Try to provoke the error by issuing

MOVE DATA 006073      

This will try to move the data from 006073 to other volumes in the same storage pool.

If/when the error occurs issue

Q ACTLOG SEARCH=006073      

What do you see?

I assume that your library L3494B somehow lost inventory information about that volume.

But first let's see what MOVE DATA brings!

wmp

Can i issue this command when backups & migrations processes are already going on & also how much time would it take for this command to complete.

Yes. no problem. You need two mountpoints ( 1 read, 1 write), but don't worry. MOVE DATA is a background process which will wait until sufficient mountpoints become available, if necessary.

How much time? The volume 006073 has only 0.3% of its compressed ~ 485 GB used, which makes as much as ~ 1.5 GB of payload - with fast tapes like your Jaguars this should not last longer than ~ 40 seconds, once both volumes are mounted and positioned.

Both tapes ( 006073 and a second volume of stgpool TBACK6 having sufficient free space) will be locked during this short time period, but since 006073 seems inaccessible anyway ...

Good luck!

How you came to know that 006073 is inaccessible, also can u let me know how did u find out these details from the logs...that will be of great help

Thanks
PG

>> How you came to know that 006073 is inaccessible <<

But I thought that this is our issue here! At least that's what the message says which you chose as the headline of your question!

And the "details"?

From Q VOL come the percentage: "Pct Util: 0.3" and the compressed capacity: "Estimated Capacity: 484,532.3".
The 1.5 GB are a simple calculation using these two values. That it's "Jaguars" I derived from the name you gave your DEVCLASS: "TDEV3592" (from Q VOL)
Seems that it's first-generation Jaguars, at least you're using first-generation cartridges (300 GB native).
The data which volume 006073 holds is probably AIX OS backup (rootvg), at least the compression rate is typical for that sort of data.

I estimated the 40 seconds based on the average throughput of a first-generation Jaguar of 40 MB/sec.
The name of the storage pool is also from Q VOL: "Storage Pool Name: TBACK6"
 
According to its name your library is a  3494 which has come a bit of of age - the same good old war horse we use here for over 10 years now.

First of all...hahahah for your last sentence....yes, my heading is that as i thought tht you figured out it is inaccessible from the logs i provided. But anyhow, today i didnt got any message for that, so can i find out whether that tape is in use or not. And thanks for explaining all those thinks....your title definitely suites you.

And also i will try that option of moving data & let u know.

PG

One more question: Did you have some sort of hardware issue with the 3494 or other issues like a power outage at or shortly after June 27 this year?

Hi WMP,

Yes, we did had a couple of power outage issue after june 27 where in we need to switch off one of the power source for the systems. But how it is related to this ?
Also today i received this messages again, when i saw in activity log it is showing foll messages :

Date/Time             Message                                                  
--------------------  ----------------------------------------------------------
10/21/10 10:49:29     ANR1040I Space reclamation started for volume 006073,    
                       storage pool TBACK6 (process number 426). (PROCESS: 426)
10/21/10 10:49:29     ANR1044I Removable volume 006073 is required for space    
                       reclamation. (PROCESS: 426)                              
10/21/10 10:51:22     ANR1081E Space reclamation is ended for volume 006073.    
                       Storage media is inaccessible. (PROCESS: 426)

PG

So examine your 3494.

Query the database of the library manager for this volume (check all options like "misplaced", etc.). Do you find it?

If it isn't in the database, check with your own eyes. Is it present anywhere?

If not - someone must have ejected it. If it's there, re-inventory the whole 3494 (need to go offline).

Run AUDIT LIBRARY L4594B in TSM afterwards.

Any changes?

As for the power outages - it might happen that a volume is just placed in the gripper when such an outage occurs. An operator/technician might have taken it and placed it in some arbitrary slot instead of the I/O station or the service slot. Maybe the cartridge has even fallen to the ground of the library and is still lying around.

>> need to go offline <<
What exactly you want to say is i need to take my library offline to do the inventory or it can be done online also. If no, then is there any other way out to just read the specified volume by the library

Thanks
PG

Welcome back!

You could try by entering PAUSE mode, opening and closing all doors and then leaving PAUSE mode.
Make sure that your library is configured to perform an inventory scan in such a scenario.

I must say, however - the above method worked for me only in very rare cases.

Setting the library offline and performing a re-inventory instead of just a scan is by far more reliable.

wmp

What will be the impact if I take a library offline & what commands i have to execute for making it offline & online.

As your first option, how can i make sure that library is configured to scan during pause mode.

Thanks
PG

The impact is that TSM will not be able to reach the library and its drives.
Best take all TSM paths offline (to drives and lib) beforehand.

I'm not close to our machine right now, so I can't give you the exact steps before tomorrow (10 hours from now or so). Sorry, that's not an everyday task, so I can't recall the identifiers of each and every menu item from memory.

I know for sure, however, that you will need the service mode password of your library. Do you have it at hand? If not you will need a support person (from IBM or whatever) anyway.

wmp

No problem , i can wait till tomorrow, but i would appreciate if I can get steps for the same.

PG

OK,
here you go. All the following has to be done at your library's console.
1) Search the database for a volume
Search Database -> Volser, Category ... -> Fill in Volser 006073 -> Set all flags except "Mounted" to Yes -> Search
2) Setup the library to perform an inventory scan when returning from PAUSE (doors were open)
Commands -> Inventory -> Enable Inventory Update
3) Perform an inventory update without the need for PAUSE (and without opening the doors)
Commands -> Inventory -> Perform Inventory Update (Full)
4) Reinventory Complete System
4a) Go offline
Mode -> Offline -> OK
4b) Start Reinventory
Commands -> Inventory -> Reinventory Complete System -> OK
wmp

How much time would it take for the reinventory process to get completed. Also request you to explain Step 2 & 3, I didnt understand >>returning from pause << & without the need for PAUSE, what are thesee steps exactly about.

Thanks

virgo0880,

these are not steps, but four different things, all posted with the aim of answering single questions having emerged during this thread.

>> How much time ... <<
How many volumes are in the library? The last time (rather long ago) I ran such a process involving roundabout 850+ cartridges the duration was less than 90 minutes - but that was with the previous, rather slow version of the library manager (and its accompanying poor PC hardware and old DB2 / OS/2 versions).

wmp

Hi Wmp,

This is PG, i raised this question thread, i changed my login name. Actually what is the command to find out how many volumes are there in the library, i am doing q libvol but it is showing a list volumes. Also the steps given above are the 4 ways of doing the inventory right ..?

Thanks

Is this issue solved?

wmp