Change Retention time in Tivoli Storage Manager

No matter how many new tapes we put in our tape library, it just keeps "holding" more and more tapes offsite.  I'm a relative newb to TSM so can someone tell me how to adjust the time it keeps a tape offsite before it marks it vaultretrieve?  This is in our DRM setup.  I understand the purpose of it but we can't just keep buying more and more tapes to have it store more and more offsite.  Thanks!

Also, this system is setup on Windows if that helps for an answer.
LVL 5
OverSeerAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

woolmilkporcCommented:
Hi,
some questions -
- do you ever get tapes back from vault?
- does space reclamation (triggered by 'EXPIRE INVENTORY')  run regularly (including offsite reclamation)?
- is only the number of offsite tapes growing, or also the number of primary volumes?
- do you use collocation, maybe even 'COLLOCATE = NODE' with your DRM pools?
- did you set a too high value for 'REUSEDELAY'?
- 'Q DRMSTATUS' - do all your DRM pools show up there? Is the value for 'DB Backup Series Expiration' too high?
- how many volumes show up with 'Q VOLH T=DBB"?
wmp
 
0
OverSeerAuthor Commented:
1) Yes, we get tapes back
2) Yes, every night
3) Where would I tell that?
4) No, never heard of it.
5) I wasn't the one who setup the system (I'm a TSM Newb)...
6)tsm: TSMSERVER1>q drmstatus

Recovery Plan Prefix: C:\TSM_STORAGE\DRMPLANS\PREPARE
Plan Instructions Prefix:
Replacement Volume Postfix: @
Primary Storage Pools: ONSITEPOOL
Copy Storage Pools: OFFSITEPOOL
Not Mountable Location Name: NOTMOUNTABLE
Courier Name: COURIER
Vault Site Name: VAULT
DB Backup Series Expiration Days: 2 Day(s)
Recovery Plan File Expiration Days: 60 Day(s)
Check Label?: No
Process FILE Device Type?: No
Command File Name:

7) tsm: TSMSERVER1>Q VOLH T=DBB

Date/Time: 05/27/2009 07:26:44
Volume Type: BACKUPFULL
Backup Series: 551
Backup Operation: 0
Volume Seq: 1
Device Class: LTO3
Volume Name: 000015L3
Volume Location: VAULT
Command:

Date/Time: 05/28/2009 07:28:26
Volume Type: BACKUPFULL
Backup Series: 552
Backup Operation: 0
Volume Seq: 1
Device Class: LTO3
Volume Name: 000038L3
Volume Location: VAULT
Command:
0
woolmilkporcCommented:
1) OK
2) OK
3) Given ONSITEPOOL and OFFSITEPOOL were your only storage pools, check number of volumes by

select count(*) from volumes where stgpool_name='ONSITEPOOL'
select count(*) from volumes where stgpool_name='OFFSITEPOOL'

and compare the displayed values. Huge differences? If both values were roundabout the same, your problem had nothing to do with DRM vault movement.
4/5) Check with
select stgpool_name, collocate, reusedelay from stgpools
Should you find 'Filespace' under 'collocate' - this is a huge media waster (see below). 'Node' will cost media, too, but not that much. Should you find 'Group', check with 'q collocgroup' waht you configured. If there are none, 'Group' is the same as 'No'
6) OK, if ONSITEPOOL and OFFSITEPOOL were your only storage pools involved in DRM processing.
7) OK

ad 4) COLlocate  
     Specifies whether the server attempts to keep data belonging to a
     single client node, group of client nodes, or client file space stored
     on as few volumes as possible. This parameter is optional. The default
     value is GROUP.
     Collocation reduces the number of sequential access media mounts for
     restore, retrieve, and recall operations. However, collocation
     increases both the amount of server time needed to collocate files for
     storing and the number of volumes required.
 ad 5) REUsedelay

     Specifies the number of days that must elapse after all files are
     deleted from a volume before the volume can be rewritten or returned to
     the scratch pool.

COLLOCATE influences thus the overall number of tapes needed.
REUSEDELAY influences the time until tapes reach 'VAULTRETRIEVE' -
Check for 'pending' (empty but delayed) volumes with
select max(volume_name) volume, status, count(*) count from volumes group by status
Which other states besides 'PENDING' are displayed?
Tell me what you found!
wmp


0
Powerful Yet Easy-to-Use Network Monitoring

Identify excessive bandwidth utilization or unexpected application traffic with SolarWinds Bandwidth Analyzer Pack.

OverSeerAuthor Commented:
Here's the command results:

tsm: TSMSERVER1>Select count(*) from volumes where stgpool_name='ONSITEPOOL'
 
 Unnamed[1]
-----------
          7
 
tsm: TSMSERVER1>Select count(*) from volumes where stgpool_name='OFFSITEPOOL'
 
 Unnamed[1]
-----------
         11
 
tsm: TSMSERVER1>select stgpool_name, collocate, reusedelay from stgpools
 
STGPOOL_NAME           COLLOCATE              REUSEDELAY
------------------     ------------------     ----------
ARCHIVEPOOL
BACKUPPOOL
DIRPOOL
OFFSITEPOOL            NO                              0
ONSITEPOOL             NO                              0
SPACEMGPOOL
 
tsm: TSMSERVER1>select max(volume_name) volume, status, count(*) count from volumes group by status
 
VOLUME                 STATUS                       COUNT
------------------     ------------------     -----------
000055L3               FILLING                         10
000051L3               FULL                             8
C:\TSM_STORAGE\DI-     ONLINE                          40
 RPOOL\DIRPOOL10.-
 DSM

Open in new window

0
woolmilkporcCommented:
Strange,
are there really only 18 tape volumes? ( 7 onsite, 11 offsite)? If so, that should not be a real problem.
If there's more, this is most probably because you did a MOVE DRMEDIA (which brings tapes back from VAULTRETRIEVE to ONSITERETRIEVE) but no CHECKIN LIBVOL !
Leaving out the CHECKIN leads to tapes being neither volumes nor libvolumes, only drmedia, and I have seen circumstances where the tapes didn't show up at all, not even as drmedia.
Sorry, but I need the output of 'QUERY DRMEDIA'. If I am right, there are tapes with status ONSITERETRIEVE
 which have to be checked in.
wmp
 
 
0
OverSeerAuthor Commented:
I always do a checkin when I receive tapes back from the Vault...  And we have 60 tapes total (at the offsite facility and here)...  Here's the Q DRM

The Courierretrieve is my tape I'm getting back today...

tsm: TSMSERVER1>q drmedia
 
Volume Name          State                 Last Update             Automated
                                           Date/Time               LibName
----------------     -----------------     -------------------     ----------------
000005L3             Vault                 11/21/2008 08:04:23
000011L3             Vault                 05/28/2009 10:37:58
000014L3             Vault                 05/04/2009 09:22:01
000019L3             Vault                 02/20/2008 09:03:27
000027L3             Vault                 05/29/2009 09:12:08
000030L3             Vault                 05/22/2009 13:55:31
000032L3             Vault                 05/21/2009 09:29:22
000041L3             Vault                 10/30/2008 08:06:55
000044L3             Vault                 03/10/2009 09:23:17
000049L3             Vault                 05/11/2009 09:44:08
000054L3             Vault                 04/10/2009 09:25:46
000038L3             Vault                 05/28/2009 10:38:26
000015L3             Courier retrieve      05/29/2009 09:11:37

Open in new window

0
woolmilkporcCommented:
Strange again ...
the only thing you can do is collect all your tapes stored in the vault which are not listed with 'Q DRMEDIA' and check them in as SCRATCH.
Then we must see what the future brings.
... and, you indeed have only 7 active tapes onsite. If there are more in your library , do a 'Q LIBVOL [libname]' and check the 'Status'. Should you find other values than 'Private' or 'Scratch', please post.
You can also run a query against 'VOLUMES' including 'ACCESS' -
select volume_name, status, access from volumes
and examine the 'ACCESS' column.
wmp
 
0
OverSeerAuthor Commented:
Here's the select statement:

tsm: TSMSERVER1>select volume_name, status, access from volumes
 
VOLUME_NAME            STATUS                 ACCESS
------------------     ------------------     -----------------
000005L3               FULL                   OFFSITE
000011L3               FILLING                OFFSITE
000014L3               FULL                   OFFSITE
000019L3               FILLING                OFFSITE
000027L3               FILLING                OFFSITE
000030L3               FILLING                OFFSITE
000032L3               FILLING                OFFSITE
000037L3               FULL                   READWRITE
000040L3               FULL                   READWRITE
000041L3               FULL                   OFFSITE
000042L3               FULL                   READWRITE
000044L3               FILLING                OFFSITE
000046L3               FULL                   READWRITE
000049L3               FILLING                OFFSITE
000051L3               FULL                   READWRITE
000052L3               FILLING                READWRITE
000054L3               FILLING                OFFSITE
000055L3               FILLING                READWRITE
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL01.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL02.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL03.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL04.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL05.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL06.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL07.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL08.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL09.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL10.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL11.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL12.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL13.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL14.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL15.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL16.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL17.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL18.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL19.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL20.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL21.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL22.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL23.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL24.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL25.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL26.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL27.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL28.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL29.DSM
C:\TSM_STORAGE\BA-     ONLINE                 READWRITE
 CKUPPOOL\BACKUPP-
 OOL30.DSM
C:\TSM_STORAGE\DI-     ONLINE                 READWRITE
 RPOOL\DIRPOOL01.-
 DSM
C:\TSM_STORAGE\DI-     ONLINE                 READWRITE
 RPOOL\DIRPOOL02.-
 DSM
C:\TSM_STORAGE\DI-     ONLINE                 READWRITE
 RPOOL\DIRPOOL03.-
 DSM
C:\TSM_STORAGE\DI-     ONLINE                 READWRITE
 RPOOL\DIRPOOL04.-
 DSM
C:\TSM_STORAGE\DI-     ONLINE                 READWRITE
 RPOOL\DIRPOOL05.-
 DSM
C:\TSM_STORAGE\DI-     ONLINE                 READWRITE
 RPOOL\DIRPOOL06.-
 DSM
C:\TSM_STORAGE\DI-     ONLINE                 READWRITE
 RPOOL\DIRPOOL07.-
 DSM
C:\TSM_STORAGE\DI-     ONLINE                 READWRITE
 RPOOL\DIRPOOL08.-
 DSM
C:\TSM_STORAGE\DI-     ONLINE                 READWRITE
 RPOOL\DIRPOOL09.-
 DSM
C:\TSM_STORAGE\DI-     ONLINE                 READWRITE
 RPOOL\DIRPOOL10.-
 DSM

Open in new window

0
OverSeerAuthor Commented:
What's weird is that I look at the Q DRM every day and request back anything Vault Retrieve and check it in... I also send out anything Mountable to the vault.  Why is it "disappear" out of TSM?
0
woolmilkporcCommented:
Well,
it's a bit overdone to send out MOUNTABLE volumes every day. This leads to many FILLING volumes in the vault, thus wasting media. I assume you do a BACKUP STGPOOL daily? I would wait until this fills the copypool volumes a bit more.
But that's not the culprit.
I guess you're doing the MOVE DRMEDIA with SOURCE=DBB (which is the default, btw.)?
One thing I once saw which led to 'lost' media was running a scheduled 'DEL VOLH TODATE=[date] T=DBB' regularly, despite of the above.
With DRM one should not do that (without DRM it's mandatory), because TSM then looses control over the deleted volumes when they're offsite. Leave deletion of database backup volumes to DRM.

OK, what are you going to do? Can you collect 'lost' volumes and check them in? As I wrote above, at the moment this is the only action that would make sense to me.

Good luck!

wmp




0
OverSeerAuthor Commented:
Well, I just do a 'MOVE DRM * WHERESTATE=MOUNTABLE TOSTATE=VAULT' to get the tapes to the IO door and then send them offsite...

When they come back I do a 'MOVE DRM * WHERESTATE=COURIERRETRIEVE TOSTATE=ONSITERETRIEVE' and then 'CHECKIN LIBVOL TSMLTO1 SEARCH=BULK STATUS=SCRATCH CHECKL=BARCODE WAITTIME=0'

Unless the script that runs every night (morning) is doing the 'DEL VOLH' I'm sure not running it.

Any tips on what I should be running?
0
OverSeerAuthor Commented:
For example.  Tape 000030L3 is listed in my PREPARE file as being in the Vault (offsite) and it shows in TSM as VAULT but it's in my autoloader.  How do I get it out of there?
0
woolmilkporcCommented:
The first MOVE is quite OK.

The CHECKIN is OK, too.

The second MOVE - there must be some procedure at your site which brings 'VAULTRETRIEVE' tapes to COURIERRETRIEVE status, as that transition does not happen automatically. Do you know about such a thing?

The shortest way would be to MOVE 'VAULTRETRIEVE' media (this state  is reached automatically when tapes are fully reclaimed) to ONSITERETRIEVE, then CHECKIN.

I think you should:

1) examine all your scripts to get a clear idea of what's going on.

2) cleanup your inventory, to achieve consistency between TSM's assumptions and reality,

meaning:

For 000030L3 (and other possible candidates) -
does that tape show up in 'Q LIBVOL [library]'?
If Yes (which I don't believe), use CHECKOUT to get it out there,  if No use the control panel functions of your library to eject it, then carry it to your vault.

Equally, as I already said, bring all your orphaned tapes to your library and do CHECKIN LIBVOL ... STATUS=SCRATCH.

You could post your scripts and Q LIBVOL output, so I could have a look at it.

I fear there is not much more to do or say.

wmp










0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
OverSeerAuthor Commented:
Oh, as for the vaultretrieve to courierretrieve, that's me also, I just skipped that step...

2) yes, it does show up in the 'Q LIBVOL' query...

I'll get the tape out of there and into the vault.  Thanks so much for all your help!!  I'll gander over my admin script and see what it's doing exactly...

tsm: TSMSERVER1>q libvol tsmlto1
 
Library Name    Volume Name    Status              Owner         Last Use     Home       Device
                                                                              Element    Type
------------    -----------    ----------------    ----------    ---------    -------    ------
TSMLTO1         000030L3       Private                                        4,102

Open in new window

0
OverSeerAuthor Commented:
Super help and I wish I could give you more points!!  You've been a big help in figuring out what's going on.
0
woolmilkporcCommented:
Thanks for the points and the nice compliment, you're always welcome!

Cheers

wmp

0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Storage Software

From novice to tech pro — start learning today.