Need Unix script to copy files from one directory to another and keep a log of it

Thanks, for the quick response my user would like to a certain list of files and there isn't a basic pattern or extention.

7Souls

so, how (s)he decides on files to backup? (s)he can then use . (dot) to refer to current dir

tar cf -  .  | ( cd /path/to/dir2 ; tar xvf - >> /path/to/logfile  )

Hi omarfarid, see the snipet of code that I sent with this questions he has all 5000 plus statements ready with a 'cp' file to destination directory. I know I can tar by extentions but that won't work because he only wants the files in his list.

example
cp /psfscm/data/BJOHNSON2009-02-02-11.50.35Memory-Mark.pdf  /psfscm/data/adhoc/

and this happen 5000 + times coping different files.

Thanks,
7Souls        
                                           

if the cp commands are already in a script then try this

sh -x scriptname > logfile

Or you could create a script a like:

echo start of log
echo target directory is $1
while read cp file
do
cp $file $1
echo $file copied to $1
done <your file snipet

Then run the script as:
#./script target_directory >logfile

Hi arlready_used;

Can you give me the xact UNIX commands to do the read of the copy file and echo's.

Thanks,
7Souls

I did.
Create a file,  (using vi or cat, or notepad on a Windows machine and then ftp the file to the unix box), containing the lines from my previous post, starting with "echo start of log" and ending with "done<your file".
Change the permissions on the script file using "chmod" to make it executable.
The script does the following:

echo start of log                       --- prints "start of log" on the output device
echo target directory is $1       --- prints "target directory is 'the command line parameter you enter when you execute the script"
while read cp file                      --- reads the file that has been created for you, and discards the "cp" at the beginning of each line
do                                             --- starts a loop
cp $file $1                                 --- copies the file in the list to the target directory
echo $file copied to $1             --- prints "listed_file copied to target_directory"
done < file_list                          --- closes loop and assigns the file named file_list as input to script.

run the script with the target_directory as the first command line option.

Thanks already_used, your idea sounds good but before I start and writing it your way. I first tried this
ex:
#!/usr/bin/ksh -xv
set -a allexport

export LOG_FILE=/psfscm/data/copyfile_attachments_adhoc.log

cp /psfscm/data/BJOHNSON2009-02-02-11.50.35Memory-Mark.pdf
              /psfscm/data/adhoc >> ${LOG_FILE}
cp /psfscm/data/PORTED002009-02-02-12.45.45Daily_Report.pdf
              /psfscm/data/adhoc >> ${LOG_FILE}
cp /psfscm/data/PORTED002009-02-02-12.46.49Whighams.pdf
              /psfscm/data/adhoc >> ${LOG_FILE}
cp /psfscm/data/PORTED002009-02-02-12.52.28Raffield_Tire.pdf
              /psfscm/data/adhoc >> ${LOG_FILE}
cp /psfscm/data/PORTED002009-02-02-12.53.02Daily_Report.pdf
              /psfscm/data/adhoc >> ${LOG_FILE}
cp /psfscm/data/PORTED002009-02-02-12.53.46Whighams.pdf
              /psfscm/data/adhoc >> ${LOG_FILE}
cp /psfscm/data/PORTED002009-02-02-12.54.13Equifax.pdf
              /psfscm/data/adhoc >> ${LOG_FILE}
cp /psfscm/data/GRUBBW002009-02-02-14.40.24Holland_221.00_1-14-09.pdf
              /psfscm/data/adhoc >> ${LOG_FILE}
cp /psfscm/data/WILLIL002009-02-02-17.43.27Hill_-__56.92.pdf
              /psfscm/data/adhoc >> ${LOG_FILE}
cp /psfscm/data/WILLIL002009-02-02-17.45.39McDade_-_9.28.pdf
              /psfscm/data/adhoc >> ${LOG_FILE}
cp /psfscm/data/WILLIL002009-02-02-17.46.56Hill_-__-10.03.pdf
              /psfscm/data/adhoc >> ${LOG_FILE}
cp /psfscm/data/WILLIL002009-02-02-17.47.45Hill_-_9.90.pdf
              /psfscm/data/adhoc >> ${LOG_FILE}
Wait

This is doing the copies but its not writing to the log file:
$ ls -lrt *.log
-rw-rw-r--   1 ps8admfn psadm          0 Aug 14 16:11 copyfile_attachments_adhoc.log

What am I doing wrong?

Thanks,
7Souls

There is no output from the cp command, therefore there is nothing in the log file.
Just add  "ls -l /psfscm/data/adhoc >>$(LOG_FILE)"  as the last line of your script.
If you don't actually need to do the copy again, just:

Do " ls -l  /psfscm/data/adhoc > log_file"  to save the listing into a file.

Jack

Hi already_used
 
no luck on the log:
$ ls -lrt copyfile_attachments_adhoc.log
-rwxrw-rw-   1 ps8admfn psadm          0 Aug 14 16:11 copyfile_attachments_adhoc.log

what happens after the copy statement it spits out a listing of all the files in the directory including the directories.

Thanks,
7Souls

How about cpio?

You could create a file called /pathname/files.txt file look like:

BJOHNSON2009-02-02-11.50.35Memory-Mark.pdf
PORTED002009-02-02-12.45.45Daily_Report.pdf
PORTED002009-02-02-12.46.49Whighams.pdf
PORTED002009-02-02-12.52.28Raffield_Tire.pdf
PORTED002009-02-02-12.53.02Daily_Report.pdf

Then do the 2 step:
cd /psfscm/data
cat /pathname/files.txt | cpio -pv ./adhoc > /tmp/filecopy.log 2>&1


The copy output and any errors would be in /tmp/filecopy.log

This may make it easier to maintain the list of files as well.

I'm not sure how the list of files is determined, but if it's based on changes to the files and/or new files, you could do:

cd /psfscm/data
find . -mtime -1 | cpio -pv ./adhoc > /tmp/filecopy.log 2>&1

That would get anything modified or created in the last day.  You could limit the filenames with a -name switch to find as well.  More info would be needed to go down that road though.

You could also create a file with the commands in it called something like /usr/bin/filecopy.sh and put those commands in it, make it executable with chmod and then add it to the crontab file to automate the process.

Thank You 7souls.