asked on

Archiving by month shell script

Hi Guys,

I have the following shell script that tars up files older than 30 days and moves the files in to an archive directory, I want to modify the script so instead of taring and archiving the last 30 days of data archives tar up only the previos second month for example: on feb 5th 2010 the script has to archive the month of December 2009 on to directory name december09, here's what I got:

#!/bin/ksh
#
# SCRIPT NAME: ap_arc.ksh
#
# PURPOSE: The purpose of this script is to move files older than 30 days in to an archive directory.
#
# REQUIREMENTS: The file(s) have to be 30 days or older to be tar up and archived
# VARIABLES Defined on /home/fsrconnect/autosys/common/profile_bourne
# Find files older than 30 days and move them to the archive directory
#
# EXIT CODES: 0 ==> NORMAL EXECUTION
# 39 ==> NO FILES TO ARCHIVE
# 40 ==> TAR AND COMPRESSION OF THE AP FILES NOT EXECUTED
# 41 ==> NOT ABLE TO REMOVED FILES FROM TAR_AP DIRECTORY
# 42 ==> FILE `date "+%y%m%d".AP.tgz` IS MISSING ON THE CURRENT MONTH DIRECTORY

# SORT PROFILE FILE

. /home/fsrconnect/autosys/common/profile_bourne

# Month Array

month[0]="none"
month[01]="January"
month[02]="February"
month[03]="March"
month[04]="April"
month[05]="May"
month[06]="June"
month[07]="July"
month[08]="August"
month[09]="September"
month[10]="October"
month[11]="November"
month[12]="December"

# AP

cd $AP_ARC
find $AP_ARC -mtime +30 -exec mv -f {} $TAR_AP \;
cd $TAR_AP
ls -l $TAR_AP > /dev/null 2>&1
if [[ $? != 0 ]] ; then
echo " THERE ARE NO FILES OLDER THAN 30 DAYS TO ARCHIVE AT THE MOMENT. "

cd $AP_ARC
find $AP_ARC -mtime +30 -exec mv -f {} $TAR_AP \;
cd $TAR_AP
ls -l $TAR_AP > /dev/null 2>&1
if [[ $? != 0 ]] ; then
echo " THERE ARE NO FILES OLDER THAN 30 DAYS TO ARCHIVE AT THE MOMENT. "
exit 39
fi

tar cvf - *.* | gzip -c > `date "+%y%m%d".AP.tgz`
ls -l `date "+%y%m%d".AP.tgz` > /dev/null 2>&1
if [[ $? != 0 ]] ; then

echo " ERROR: TAR AND COMPRESSION OF THE AP FILES NOT EXECUTED. "
exit 40
fi

rm -f $(ls * | grep -v *.tgz)
if [[ $? != 0 ]] ; then
echo " ERROR: NOT ABLE TO REMOVED FILES FROM TAR_AP DIRECTORY. "
exit 41
fi

a=`date "+%m"`
mv *.tgz $TAR_AP/${month[$a]}
if [[ $? != 0 ]] ; then

echo " ERROR: FILE `date "+%y%m%d".AP.tgz` IS MISSING ON THE CURRENT MONTH DIRECTORY "
exit 42

fi

Thanks for your help.!!!

MikeOM_DBA

Try this:

# ...Blah, Blah, Blah...

# SORT PROFILE FILE
. /home/fsrconnect/autosys/common/profile_bourne

# Month Array
month=("none" "January" "February" "March" "April" "May" "June" 
       "July" "August" "September" "October" "November" "December")

dt=(`date +%Y\ %m\ %d`)
Y=${dt[0]}; M=${dt[1]}; D=${dt[2]}
echo "%+ Today's date: $M/$D/$Y"
(( M = M - 2 ))
if [ $M -lt 1 ]; then
  (( Y = Y - 1 )); (( M = M + 12 ))
fi  
filedt=$(printf "%s%0.2d%0.2d" $Y $M $D;)
rm arc*.tmp
touch -t ${filedt}0000 arc$$.tmp
echo "%+ Archive date: $M/$D/$Y; ${month[$M]}; $filedt"

## AP

cd $AP_ARC
find . ! -newer arc$$.tmp 
if [[ $? != 0 ]] ; then
  echo "!ERROR $?: THERE ARE NO FILES OLDER THAN $M/$D/$Y TO ARCHIVE AT THE MOMENT. "
  exit 39
fi
tgzFile="${month[$M]}-${dt[0]}${dt[1]}${dt[2]}.AP.tgz"
find . ! -newer arc$$.tmp |xargs -I! tar cvf - ! | gzip -c > ${TAR_AP}/$tgzFile
if [[ $? != 0 ]] ; then
  echo "!ERROR $?: TAR AND COMPRESSION OF THE AP FILES NOT EXECUTED. "
  exit 40
fi

find . ! -newer arc$$.tmp -exec rm {} \;
if [[ $? != 0 ]] ; then
  echo "!ERROR $?: NOT ABLE TO REMOVE FILES FROM AR DIRECTORY. "
  exit 41
fi

exit 0

Open in new window

MikeOM_DBA

Fixed some typo's:

# ...Blah, Blah, Blah...

# SORT PROFILE FILE
. /home/fsrconnect/autosys/common/profile_bourne

# Month Array + Misc variables:
month=("none" "January" "February" "March" "April" "May" "June" 
       "July" "August" "September" "October" "November" "December")
dt=(`date +%Y\ %m\ %d`)
Y=${dt[0]}; M=${dt[1]}; D=${dt[2]}
echo "%+ Today's date: $M/$D/$Y"
(( M = M - 2 ))
if [ $M -lt 1 ]; then
  (( Y = Y - 1 )); (( M = M + 12 ))
fi  
filedt=$(printf "%s%0.2d%0.2d" $Y $M $D;)
echo "%+ Archive date: $M/$D/$Y"
rm arc*.tmp 2>/dev/null
touch -t ${filedt}0000 arc$$.tmp
TAR_DIR="${TAR_AP}/${month[$M]}${Y#??}"
[ ! -d $TAR_DIR ] && mkdir -p $TAR_DIR
tgzFile="${dt[0]}${dt[1]}${dt[2]}.AP.tgz"
echo "%+ TAR Dir/File: $TAR_DIR/$tgzFile" 

## AP

cd $AP_ARC
find . ! -newer arc$$.tmp >/dev/null 2>&1
if [[ $? != 0 ]] ; then
  echo "!ERROR $?: THERE ARE NO FILES OLDER THAN $M/$D/$Y TO ARCHIVE AT THE MOMENT. "
  exit 39
fi
find . ! -newer arc$$.tmp |xargs -I! tar cvf - ! | gzip -c > ${TAR_DIR}/$tgzFile
if [[ $? != 0 ]] ; then
  echo "!ERROR $?: TAR AND COMPRESSION OF THE AP FILES NOT EXECUTED. "
  exit 40
fi
find . ! -newer arc$$.tmp -exec rm {} \;
if [[ $? != 0 ]] ; then
  echo "!ERROR $?: NOT ABLE TO REMOVE FILES FROM AR DIRECTORY. "
  exit 41
fi

exit 0