Change Retention time in Tivoli Storage Manager
No matter how many new tapes we put in our tape library, it just keeps "holding" more and more tapes offsite. I'm a relative newb to TSM so can someone tell me how to adjust the time it keeps a tape offsite before it marks it vaultretrieve? This is in our DRM setup. I understand the purpose of it but we can't just keep buying more and more tapes to have it store more and more offsite. Thanks!
Also, this system is setup on Windows if that helps for an answer.
Also, this system is setup on Windows if that helps for an answer.
ASKER
1) Yes, we get tapes back
2) Yes, every night
3) Where would I tell that?
4) No, never heard of it.
5) I wasn't the one who setup the system (I'm a TSM Newb)...
6)tsm: TSMSERVER1>q drmstatus
Recovery Plan Prefix: C:\TSM_STORAGE\DRMPLANS\PR
Plan Instructions Prefix:
Replacement Volume Postfix: @
Primary Storage Pools: ONSITEPOOL
Copy Storage Pools: OFFSITEPOOL
Not Mountable Location Name: NOTMOUNTABLE
Courier Name: COURIER
Vault Site Name: VAULT
DB Backup Series Expiration Days: 2 Day(s)
Recovery Plan File Expiration Days: 60 Day(s)
Check Label?: No
Process FILE Device Type?: No
Command File Name:
7) tsm: TSMSERVER1>Q VOLH T=DBB
Date/Time: 05/27/2009 07:26:44
Volume Type: BACKUPFULL
Backup Series: 551
Backup Operation: 0
Volume Seq: 1
Device Class: LTO3
Volume Name: 000015L3
Volume Location: VAULT
Command:
Date/Time: 05/28/2009 07:28:26
Volume Type: BACKUPFULL
Backup Series: 552
Backup Operation: 0
Volume Seq: 1
Device Class: LTO3
Volume Name: 000038L3
Volume Location: VAULT
Command:
2) Yes, every night
3) Where would I tell that?
4) No, never heard of it.
5) I wasn't the one who setup the system (I'm a TSM Newb)...
6)tsm: TSMSERVER1>q drmstatus
Recovery Plan Prefix: C:\TSM_STORAGE\DRMPLANS\PR
Plan Instructions Prefix:
Replacement Volume Postfix: @
Primary Storage Pools: ONSITEPOOL
Copy Storage Pools: OFFSITEPOOL
Not Mountable Location Name: NOTMOUNTABLE
Courier Name: COURIER
Vault Site Name: VAULT
DB Backup Series Expiration Days: 2 Day(s)
Recovery Plan File Expiration Days: 60 Day(s)
Check Label?: No
Process FILE Device Type?: No
Command File Name:
7) tsm: TSMSERVER1>Q VOLH T=DBB
Date/Time: 05/27/2009 07:26:44
Volume Type: BACKUPFULL
Backup Series: 551
Backup Operation: 0
Volume Seq: 1
Device Class: LTO3
Volume Name: 000015L3
Volume Location: VAULT
Command:
Date/Time: 05/28/2009 07:28:26
Volume Type: BACKUPFULL
Backup Series: 552
Backup Operation: 0
Volume Seq: 1
Device Class: LTO3
Volume Name: 000038L3
Volume Location: VAULT
Command:
1) OK
2) OK
3) Given ONSITEPOOL and OFFSITEPOOL were your only storage pools, check number of volumes by
select count(*) from volumes where stgpool_name='ONSITEPOOL'
select count(*) from volumes where stgpool_name='OFFSITEPOOL'
and compare the displayed values. Huge differences? If both values were roundabout the same, your problem had nothing to do with DRM vault movement.
4/5) Check with
select stgpool_name, collocate, reusedelay from stgpools
Should you find 'Filespace' under 'collocate' - this is a huge media waster (see below). 'Node' will cost media, too, but not that much. Should you find 'Group', check with 'q collocgroup' waht you configured. If there are none, 'Group' is the same as 'No'
6) OK, if ONSITEPOOL and OFFSITEPOOL were your only storage pools involved in DRM processing.
7) OK
ad 4) COLlocate
Specifies whether the server attempts to keep data belonging to a
single client node, group of client nodes, or client file space stored
on as few volumes as possible. This parameter is optional. The default
value is GROUP.
Collocation reduces the number of sequential access media mounts for
restore, retrieve, and recall operations. However, collocation
increases both the amount of server time needed to collocate files for
storing and the number of volumes required.
ad 5) REUsedelay
Specifies the number of days that must elapse after all files are
deleted from a volume before the volume can be rewritten or returned to
the scratch pool.
COLLOCATE influences thus the overall number of tapes needed.
REUSEDELAY influences the time until tapes reach 'VAULTRETRIEVE' -
Check for 'pending' (empty but delayed) volumes with
select max(volume_name) volume, status, count(*) count from volumes group by status
Which other states besides 'PENDING' are displayed?
Tell me what you found!
wmp
2) OK
3) Given ONSITEPOOL and OFFSITEPOOL were your only storage pools, check number of volumes by
select count(*) from volumes where stgpool_name='ONSITEPOOL'
select count(*) from volumes where stgpool_name='OFFSITEPOOL'
and compare the displayed values. Huge differences? If both values were roundabout the same, your problem had nothing to do with DRM vault movement.
4/5) Check with
select stgpool_name, collocate, reusedelay from stgpools
Should you find 'Filespace' under 'collocate' - this is a huge media waster (see below). 'Node' will cost media, too, but not that much. Should you find 'Group', check with 'q collocgroup' waht you configured. If there are none, 'Group' is the same as 'No'
6) OK, if ONSITEPOOL and OFFSITEPOOL were your only storage pools involved in DRM processing.
7) OK
ad 4) COLlocate
Specifies whether the server attempts to keep data belonging to a
single client node, group of client nodes, or client file space stored
on as few volumes as possible. This parameter is optional. The default
value is GROUP.
Collocation reduces the number of sequential access media mounts for
restore, retrieve, and recall operations. However, collocation
increases both the amount of server time needed to collocate files for
storing and the number of volumes required.
ad 5) REUsedelay
Specifies the number of days that must elapse after all files are
deleted from a volume before the volume can be rewritten or returned to
the scratch pool.
COLLOCATE influences thus the overall number of tapes needed.
REUSEDELAY influences the time until tapes reach 'VAULTRETRIEVE' -
Check for 'pending' (empty but delayed) volumes with
select max(volume_name) volume, status, count(*) count from volumes group by status
Which other states besides 'PENDING' are displayed?
Tell me what you found!
wmp
ASKER
Here's the command results:
tsm: TSMSERVER1>Select count(*) from volumes where stgpool_name='ONSITEPOOL'
Unnamed[1]
-----------
7
tsm: TSMSERVER1>Select count(*) from volumes where stgpool_name='OFFSITEPOOL'
Unnamed[1]
-----------
11
tsm: TSMSERVER1>select stgpool_name, collocate, reusedelay from stgpools
STGPOOL_NAME COLLOCATE REUSEDELAY
------------------ ------------------ ----------
ARCHIVEPOOL
BACKUPPOOL
DIRPOOL
OFFSITEPOOL NO 0
ONSITEPOOL NO 0
SPACEMGPOOL
tsm: TSMSERVER1>select max(volume_name) volume, status, count(*) count from volumes group by status
VOLUME STATUS COUNT
------------------ ------------------ -----------
000055L3 FILLING 10
000051L3 FULL 8
C:\TSM_STORAGE\DI- ONLINE 40
RPOOL\DIRPOOL10.-
DSM
Strange,
are there really only 18 tape volumes? ( 7 onsite, 11 offsite)? If so, that should not be a real problem.
If there's more, this is most probably because you did a MOVE DRMEDIA (which brings tapes back from VAULTRETRIEVE to ONSITERETRIEVE) but no CHECKIN LIBVOL !
Leaving out the CHECKIN leads to tapes being neither volumes nor libvolumes, only drmedia, and I have seen circumstances where the tapes didn't show up at all, not even as drmedia.
Sorry, but I need the output of 'QUERY DRMEDIA'. If I am right, there are tapes with status ONSITERETRIEVE
which have to be checked in.
wmp
are there really only 18 tape volumes? ( 7 onsite, 11 offsite)? If so, that should not be a real problem.
If there's more, this is most probably because you did a MOVE DRMEDIA (which brings tapes back from VAULTRETRIEVE to ONSITERETRIEVE) but no CHECKIN LIBVOL !
Leaving out the CHECKIN leads to tapes being neither volumes nor libvolumes, only drmedia, and I have seen circumstances where the tapes didn't show up at all, not even as drmedia.
Sorry, but I need the output of 'QUERY DRMEDIA'. If I am right, there are tapes with status ONSITERETRIEVE
which have to be checked in.
wmp
ASKER
I always do a checkin when I receive tapes back from the Vault... And we have 60 tapes total (at the offsite facility and here)... Here's the Q DRM
The Courierretrieve is my tape I'm getting back today...
The Courierretrieve is my tape I'm getting back today...
tsm: TSMSERVER1>q drmedia
Volume Name State Last Update Automated
Date/Time LibName
---------------- ----------------- ------------------- ----------------
000005L3 Vault 11/21/2008 08:04:23
000011L3 Vault 05/28/2009 10:37:58
000014L3 Vault 05/04/2009 09:22:01
000019L3 Vault 02/20/2008 09:03:27
000027L3 Vault 05/29/2009 09:12:08
000030L3 Vault 05/22/2009 13:55:31
000032L3 Vault 05/21/2009 09:29:22
000041L3 Vault 10/30/2008 08:06:55
000044L3 Vault 03/10/2009 09:23:17
000049L3 Vault 05/11/2009 09:44:08
000054L3 Vault 04/10/2009 09:25:46
000038L3 Vault 05/28/2009 10:38:26
000015L3 Courier retrieve 05/29/2009 09:11:37
Strange again ...
the only thing you can do is collect all your tapes stored in the vault which are not listed with 'Q DRMEDIA' and check them in as SCRATCH.
Then we must see what the future brings.
... and, you indeed have only 7 active tapes onsite. If there are more in your library , do a 'Q LIBVOL [libname]' and check the 'Status'. Should you find other values than 'Private' or 'Scratch', please post.
You can also run a query against 'VOLUMES' including 'ACCESS' -
select volume_name, status, access from volumes
and examine the 'ACCESS' column.
wmp
the only thing you can do is collect all your tapes stored in the vault which are not listed with 'Q DRMEDIA' and check them in as SCRATCH.
Then we must see what the future brings.
... and, you indeed have only 7 active tapes onsite. If there are more in your library , do a 'Q LIBVOL [libname]' and check the 'Status'. Should you find other values than 'Private' or 'Scratch', please post.
You can also run a query against 'VOLUMES' including 'ACCESS' -
select volume_name, status, access from volumes
and examine the 'ACCESS' column.
wmp
ASKER
Here's the select statement:
tsm: TSMSERVER1>select volume_name, status, access from volumes
VOLUME_NAME STATUS ACCESS
------------------ ------------------ -----------------
000005L3 FULL OFFSITE
000011L3 FILLING OFFSITE
000014L3 FULL OFFSITE
000019L3 FILLING OFFSITE
000027L3 FILLING OFFSITE
000030L3 FILLING OFFSITE
000032L3 FILLING OFFSITE
000037L3 FULL READWRITE
000040L3 FULL READWRITE
000041L3 FULL OFFSITE
000042L3 FULL READWRITE
000044L3 FILLING OFFSITE
000046L3 FULL READWRITE
000049L3 FILLING OFFSITE
000051L3 FULL READWRITE
000052L3 FILLING READWRITE
000054L3 FILLING OFFSITE
000055L3 FILLING READWRITE
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL01.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL02.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL03.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL04.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL05.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL06.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL07.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL08.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL09.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL10.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL11.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL12.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL13.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL14.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL15.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL16.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL17.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL18.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL19.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL20.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL21.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL22.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL23.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL24.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL25.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL26.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL27.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL28.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL29.DSM
C:\TSM_STORAGE\BA- ONLINE READWRITE
CKUPPOOL\BACKUPP-
OOL30.DSM
C:\TSM_STORAGE\DI- ONLINE READWRITE
RPOOL\DIRPOOL01.-
DSM
C:\TSM_STORAGE\DI- ONLINE READWRITE
RPOOL\DIRPOOL02.-
DSM
C:\TSM_STORAGE\DI- ONLINE READWRITE
RPOOL\DIRPOOL03.-
DSM
C:\TSM_STORAGE\DI- ONLINE READWRITE
RPOOL\DIRPOOL04.-
DSM
C:\TSM_STORAGE\DI- ONLINE READWRITE
RPOOL\DIRPOOL05.-
DSM
C:\TSM_STORAGE\DI- ONLINE READWRITE
RPOOL\DIRPOOL06.-
DSM
C:\TSM_STORAGE\DI- ONLINE READWRITE
RPOOL\DIRPOOL07.-
DSM
C:\TSM_STORAGE\DI- ONLINE READWRITE
RPOOL\DIRPOOL08.-
DSM
C:\TSM_STORAGE\DI- ONLINE READWRITE
RPOOL\DIRPOOL09.-
DSM
C:\TSM_STORAGE\DI- ONLINE READWRITE
RPOOL\DIRPOOL10.-
DSM
ASKER
What's weird is that I look at the Q DRM every day and request back anything Vault Retrieve and check it in... I also send out anything Mountable to the vault. Why is it "disappear" out of TSM?
Well,
it's a bit overdone to send out MOUNTABLE volumes every day. This leads to many FILLING volumes in the vault, thus wasting media. I assume you do a BACKUP STGPOOL daily? I would wait until this fills the copypool volumes a bit more.
But that's not the culprit.
I guess you're doing the MOVE DRMEDIA with SOURCE=DBB (which is the default, btw.)?
One thing I once saw which led to 'lost' media was running a scheduled 'DEL VOLH TODATE=[date] T=DBB' regularly, despite of the above.
With DRM one should not do that (without DRM it's mandatory), because TSM then looses control over the deleted volumes when they're offsite. Leave deletion of database backup volumes to DRM.
OK, what are you going to do? Can you collect 'lost' volumes and check them in? As I wrote above, at the moment this is the only action that would make sense to me.
Good luck!
wmp
it's a bit overdone to send out MOUNTABLE volumes every day. This leads to many FILLING volumes in the vault, thus wasting media. I assume you do a BACKUP STGPOOL daily? I would wait until this fills the copypool volumes a bit more.
But that's not the culprit.
I guess you're doing the MOVE DRMEDIA with SOURCE=DBB (which is the default, btw.)?
One thing I once saw which led to 'lost' media was running a scheduled 'DEL VOLH TODATE=[date] T=DBB' regularly, despite of the above.
With DRM one should not do that (without DRM it's mandatory), because TSM then looses control over the deleted volumes when they're offsite. Leave deletion of database backup volumes to DRM.
OK, what are you going to do? Can you collect 'lost' volumes and check them in? As I wrote above, at the moment this is the only action that would make sense to me.
Good luck!
wmp
ASKER
Well, I just do a 'MOVE DRM * WHERESTATE=MOUNTABLE TOSTATE=VAULT' to get the tapes to the IO door and then send them offsite...
When they come back I do a 'MOVE DRM * WHERESTATE=COURIERRETRIEVE
Unless the script that runs every night (morning) is doing the 'DEL VOLH' I'm sure not running it.
Any tips on what I should be running?
When they come back I do a 'MOVE DRM * WHERESTATE=COURIERRETRIEVE
Unless the script that runs every night (morning) is doing the 'DEL VOLH' I'm sure not running it.
Any tips on what I should be running?
ASKER
For example. Tape 000030L3 is listed in my PREPARE file as being in the Vault (offsite) and it shows in TSM as VAULT but it's in my autoloader. How do I get it out of there?
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
Oh, as for the vaultretrieve to courierretrieve, that's me also, I just skipped that step...
2) yes, it does show up in the 'Q LIBVOL' query...
I'll get the tape out of there and into the vault. Thanks so much for all your help!! I'll gander over my admin script and see what it's doing exactly...
2) yes, it does show up in the 'Q LIBVOL' query...
I'll get the tape out of there and into the vault. Thanks so much for all your help!! I'll gander over my admin script and see what it's doing exactly...
tsm: TSMSERVER1>q libvol tsmlto1
Library Name Volume Name Status Owner Last Use Home Device
Element Type
------------ ----------- ---------------- ---------- --------- ------- ------
TSMLTO1 000030L3 Private 4,102
ASKER
Super help and I wish I could give you more points!! You've been a big help in figuring out what's going on.
Thanks for the points and the nice compliment, you're always welcome!
Cheers
wmp
Cheers
wmp
some questions -
- do you ever get tapes back from vault?
- does space reclamation (triggered by 'EXPIRE INVENTORY') run regularly (including offsite reclamation)?
- is only the number of offsite tapes growing, or also the number of primary volumes?
- do you use collocation, maybe even 'COLLOCATE = NODE' with your DRM pools?
- did you set a too high value for 'REUSEDELAY'?
- 'Q DRMSTATUS' - do all your DRM pools show up there? Is the value for 'DB Backup Series Expiration' too high?
- how many volumes show up with 'Q VOLH T=DBB"?
wmp