bash script

This should get you somewhere near what you want.

#!/bin/bash


PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin

#
# Create the backup file name
#
PDATE=$(date +"%Y-%m-%d-%H-%M")
echo "--> Date suffix $PDATE"
BFILE=
# Compressed file name
BUFILE=backup/important-$PDATE.tar
echo "--> Proposed backup file $BUFILE"


#
# Make a tar backup
#
echo "--> nice -n 15 tar -cpf $BUFILE --one-file-system /important"
nice -n 15 tar -cpf $BUFILE --one-file-system /important


#
# See if a backup file was actually generated
#
if [ ! -e $BUFILE ]; then
  echo "--> No backup file generated"
  echo "--> Send email to root and stop here"
  /usr/sbin/sendmail root << EOM
From: System_Backup
To: root
Subject: System backup failed

System full backup failed.
No compressed backup file was generated
Should have been:  $BUFILE
EOM
  exit

#
# Backup was successful, purge the directory
#
echo "--> rm -r /important/*
rm -r /important/*

#
# Done
#
echo "--> Done.  Backup and purge complete."

Select allOpen in new window

thank you

i test it i got this output and this result


[root@linux-lab /]# ./test.sh
--> Date suffix 2020-02-10-16-01
--> Proposed backup file backup/important-2020-02-10-16-01.tar
--> nice -n 15 tar -cpf backup/important-2020-02-10-16-01.tar --one-file-system /important
tar: Removing leading `/' from member names
./test.sh: line 50: unexpected EOF while looking for matching `"'
./test.sh: line 51: syntax error: unexpected end of file
[root@linux-lab /]# cd /important/
[root@linux-lab important]# ll
total 4
drwxr-xr-x. 8 root root 4096 Feb  5 15:05 photos
[root@linux-lab important]# cd /
[root@linux-lab /]# cd /backup/
[root@linux-lab backup]# ll
total 1385752
-rw-r--r--. 1 root root 709498880 Feb 10 15:57 important-2020-02-10-15-57.tar
-rw-r--r--. 1 root root 709498880 Feb 10 16:02 important-2020-02-10-16-01.tar
[root@linux-lab backup]#


where you think the issue




[root@linux-lab /]# less test.sh
#!/bin/bash


PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin

#
# Create the backup file name
#
PDATE=$(date +"%Y-%m-%d-%H-%M")
echo "--> Date suffix $PDATE"
BFILE=
# Compressed file name
BUFILE=backup/important-$PDATE.tar
echo "--> Proposed backup file $BUFILE"


#
# Make a tar backup
#
echo "--> nice -n 15 tar -cpf $BUFILE --one-file-system /important"
nice -n 15 tar -cpf $BUFILE --one-file-system /important


#
# See if a backup file was actually generated
#
if [ ! -e $BUFILE ]; then
  echo "--> No backup file generated"
  echo "--> Send email to root and stop here"
  /usr/sbin/sendmail root << EOM
From: System_Backup
To: root
Subject: System backup failed

System full backup failed.
No compressed backup file was generated
Should have been:  $BUFILE
EOM
  exit

#
# Backup was successful, purge the directory
#
echo "--> rm -r /important/*
rm -r /important/*

#
# Done
#
echo "--> Done.  Backup and purge complete."
~
~
~
~
~
~

echo "--> nice -n 15 tar --one-file-system -cpf $BUFILE  /important"
nice -n 15 tar --one-file-system -cpf $BUFILE  /important

Select allOpen in new window

That may improve things.

I'd likely do something like...

tar -cf ~/backup/$timestamp-important-tarball.tar /important

zstd --threads=0 --rm --no-check -19 --long=31 ~/backup/$timestamp-important-tarball.tar

rm -rf /important/*

Select allOpen in new window

The specific zstd incantation produces a very fast compression (almost as fast as zip) with far greater compression than xz.

Tip: Using zstd for your backups reduces system load, backup time, disk space usage for backup files.

The exit status for all backup creation commands (tar, compress, ...) SHOULD BE tested for success.

Tar will create a file, but if /backup is full the backup is not succesful, the tar does exist...

So adjusting the script from Dr. Klahn: and using zstd compression...

#!/bin/bash

PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin  
# 
# Create the backup file name 
#
PDATE=$(date +"%Y-%m-%d-%H-%M") 
echo "--> Date suffix $PDATE" 

# Compressed file name
BUFILE="backup/important-$PDAT.tar.zst"
echo "--> Proposed backup file $BUFILE"

#
# Make a tar backup
#
echo "--> nice -n 15 tar --one-file-system -cpf $BUFILE  /important"
nice -n 15 tar cpf --one-file-system --zstd $BUFILE  /important
TARRESULT=$?

#
# See if a backup file was actually generated
#
if [ "$TARRESULT" != "0" ] || [ ! -e "$BUFILE" ]
then
   echo "--> No backup file generated"
   echo "--> Send email to root and stop here"
   /usr/sbin/sendmail root << EOM
From: System_Backup
To: root
Subject: System backup failed

System full backup failed. No compressed backup file was generated Should have been:  $BUFILE
Tar exit status: $TARRESULT
EOM

   exit  1
fi
# 
# Backup was successful, purge the directory 
# 

echo "--> rm -r /important/* 
rm -rf /important/*  
# 
# Done 
# 
echo "--> Done.  Backup and purge complete."

Select allOpen in new window

sorry but till now dose not work


[root@linux-lab /]# ./test.sh
--> Date suffix 2020-02-11-08-27
--> Proposed backup file backup/important-.tar.zst
--> nice -n 15 tar --one-file-system -cpf backup/important-.tar.zst  /important
tar: unrecognized option '--zstd'
Try 'tar --help' or 'tar --usage' for more information.
--> No backup file generated
--> Send email to root and stop here
./test.sh: line 28: From:: No such file or directory
./test.sh: line 29: To:: command not found
./test.sh: line 30: Subject:: command not found
./test.sh: line 32: System: command not found
./test.sh: line 33: Tar: command not found
./test.sh: line 34: EOM: command not found
[root@linux-lab /]# cd backup/
[root@linux-lab backup]# ll
total 0
[root@linux-lab backup]# cd /important/
[root@linux-lab important]# ll
total 4
-rw-r--r--. 1 root root 34 Feb 11 08:25 hi
[root@linux-lab important]#

Ok 

i repaired the script  above if: "<<EOM" is written it is removed from view....  "<< EOM" does show corerctly. EE Bug i already reported. see below:

blah <<EOM
asdf
ad
EOM
 

Select allOpen in new window

blah << EOM
adsf
ad
EOM
 

Select allOpen in new window

Appearantly your tar doesn't known zstd compression, what version are you using?

You mention bash/linux versions of linux can help. There is a ifference between versions as each of the componenets gets upgraded continuously.

zstd has been available to tar for about 2 years... and update might be in place.

RHEL 7 doesn't have it as it uses a tar is from 2013.

Check with man tar which compression can be used if it doesn't know --zstd then try --xz if that isn't available try --bzip2 if that files try --gz.

the file extentions for tar need  then need to be resp. .tar.xz, .tar.bz2 or .tar.gz.

Hi noci

thank you because you are helping me

i cheked man tar and i found --xz   supported so i change it in the script

and i removed the space << EOM   no look like this  <<EOM

then i test it but dose not make any backup file and removed nothing

please check the attached file

and please try to test it on any centos box you have

try to make /importnat   and /backup  and test this script on your box then send me the corrected one

thanks a lot
3.jpg

Try issuing the tar command manually from the working directory and see what happens.

Try the tar command without the compression switch.  If that works, the compression (whatever kind you prefer) can be added later on in the script per below.

#
# Compress the backup
# At present 7-Zip produces the best compression
# test notes:  Bzip2 compresses 40% bigger than 7z
#              gzip compresses 50% bigger than 7z
#
echo "--> nice -n 15 7z a -t7z (target-file-name) (tar-file-name)"
nice -n 15 7z a -t7z (target-file-name) (tar-file-name)
# Remove the tar file
echo "--> rm -f (tar-file-name)"
rm -f (tar-file-name)

Select allOpen in new window

dear Dr Klahn

the first version you wrote worked very well

it create the tar file  but the first version dose not delete the data from the source

so the first part about creating the backup (( tar file )) worked

but the problem with check if the backup done successfully then remove the data from the source

so please try to help me and fix you script and test it in any linux box you have then give it to me


thanks

This should definitely work....

#!/bin/bash 
 
IMPORTANT=/important 
BACKUP=/backup 
COMPRESSION=--xz 
EXT=xz 
 
if [ -z "$BACKUP" ] || [ ! -d $BACKUP ] 
then 
  echo "Verify backup destination settings" 
fi 
if [ -z "$IMPORTANT" ] || [ ! -d $IMPORTANT ] 
then 
  echo "Verify backup source settings" 
fi 
 
PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin 
# 
# Create the backup file name 
# 
PDATE=$(date +"%Y-%m-%d-%H-%M") 
echo "--> Date suffix $PDATE" 
 
# Compressed file name 
BUFILE="$BACKUP/important-$PDATE.tar.$EXT" 
echo "--> Proposed backup file $BUFILE" 
 
# 
# Make a tar backup 
# 
echo "--> nice -n 15 tar cf $BUFILE --one-file-system $COMPRESSION  $IMPORTANT" 
nice -n 15 tar cf $BUFILE --one-file-system $COMPRESSION $IMPORTANT 
TARRESULT=$? 
 
# 
# See if a backup file was actually generated 
# 
if [ "$TARRESULT" != "0" ] || [ ! -e "$BUFILE" ] 
then 
   echo "--> No backup file generated" 
   echo "--> Send email to root and stop here" 
   /usr/sbin/sendmail root << EOM 
From: System_Backup 
To: root 
Subject: System backup failed 
 
System full backup failed. No compressed backup file was generated Should have been:  $BUFILE 
Tar exit status: $TARRESULT 
EOM 
 
   exit  1 
fi 
# 
# Backup was successful, purge the directory 
# 
 
echo "--> rm -rf $IMPORTANT/*" 
rm -rf $IMPORTANT/* 
# 
# Done 
# 
echo "--> Done.  Backup and purge complete." 

Select allOpen in new window

yes it work partly

please check the attached file

the source data has to be removed
4.jpg

Somehow the EOM on line 49 is not seen....

Consequently the rm is missing and you got the errors about line 62.... EOF.

The EOM needs to be on the LEFT, no spaces in front!

The EOM on line 42 doesn't matter if there is a blank in front.

hi noci

i would like to thank you because you are investing time to help me

the issue still even if played with EOM . (( please check the attached file ))

i think in order to fix this issue you can just connect to any Linux box you have and

1- create direct called /important
2- create one txt file under /important
3- create another directory /backup

then test your script this will save your time and this will help me to get a tested script

thanks a lot
5.jpg

great job

but the files still available under /important  so some how  

rm -rf /important/*

dose not take effects  so where i have to make changes to let it work


[root@linux-lab /]# ./sword.sh
--> Date suffix
--> Proposed backup file /backup/important_2020_02_12_10_47_59.tar.xz
--> /usr/bin/tar -czf /backup/important_2020_02_12_10_47_59.tar.xz ./*
--> /usr/bin/rm -rf /important/*
/usr/bin/rm -rf /important/gggg /important/hh /important/hi /important/jj
--> Done.  Backup and purge complete.
[root@linux-lab /]# cd important/
[root@linux-lab important]# ll
total 8
drwxr-xr-x. 2 root root 4096 Feb 12 08:19 gggg
-rw-r--r--. 1 root root    0 Feb 12 08:19 hh
-rw-r--r--. 1 root root   34 Feb 11 08:25 hi
-rw-r--r--. 1 root root    0 Feb 12 08:19 jj
[root@linux-lab important]# cd /
[root@linux-lab /]# cd backup/
[root@linux-lab backup]# ll
total 4
-rw-r--r--. 1 root root 204 Feb 12 10:47 important_2020_02_12_10_47_59.tar.xz
[root@linux-lab backup]# pwd

@sword12
I have written following comment:

# You can remove echo here after completing unit testing.
        echo $RM -rf $IMPORTANT/* # Done
        #$RM -rf $IMPORTANT/* # Done

Select allOpen in new window

Hence
replace above code to:

# You can remove echo here after completing unit testing.
#echo $RM -rf $IMPORTANT/* # Done
$RM -rf $IMPORTANT/* # Done

Select allOpen in new window

it worked like a charm

thanks a lot for all of you

spaces at the end of the lines seem to be inserted by the EE website. They were not in the scripts i pasted here.

Script was running on my system..  

Anyway it works now. 

@sword12

>> thanks a lot for all of you


>> comments not only from noci from others too.
I was thinking the same when you accepted the solution.

In my code
Replace:
PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin
        echo "--> Date suffix $PDATE"
        while [ 1 ]
        do
                PDATE=$($DATE +"%Y_%m_%d_%H_%M_%S") # Create the backup file name using _ as seperator.
                BUFILE=
With:
PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin
        while [ 1 ]
        do
                PDATE=$($DATE +"%Y_%m_%d_%H_%M_%S") # Create the backup file name using _ as seperator.
                echo "--> Date suffix $PDATE"
                BUFILE=

If you feel to change the points, you can change(share :) ) the given points to others if required.