?
Solved

Shell script to move files matching a pattern, and keeping the same tree structure

Posted on 2008-06-21
7
Medium Priority
?
697 Views
Last Modified: 2013-12-26
Hi

I would like to write a shell script that would move files matching the pattern *_t.* to another location, while keeping the directory structure from the original location.

Can someone help ?
0
Comment
Question by:terencepires
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
  • 2
  • 2
7 Comments
 
LVL 11

Expert Comment

by:rowansmith
ID: 21837465
You don't need a script for this, you can just use the tar command.

0
 
LVL 14

Expert Comment

by:agriesser
ID: 21837479
Untested (currently no access to a linux machine):

#!/bin/sh
 
basedir=/source
destdir=/destination
 
for file in $(find $basedir -type f -name "*_t.*"); do
  mkdir -p ${destdir}/$(dirname $file)
  mv $basedir/$file $destdir/$file
done

Open in new window

0
 
LVL 11

Expert Comment

by:rowansmith
ID: 21837517
The following takes everything in the parents subdirectory tartest, and coppies it to the current directory.

It will only create the sub directories where their is a file to be extracted...

Go to the directory where you want the files to be and replace ../tartest with the full path to the directory where your source files are.

Put the tar command in a script if you want :-)
rowan@daedalus:~/output$ tar -cvvf - ../tartest/ | tar -xvvf - *_t.*
 
[Storing everything starts here]
 
tar: Removing leading `../' from member names
drwxr-xr-x rowan/users       0 2008-06-21 23:25:55 ../tartest/
-rw-r--r-- rowan/users       0 2008-06-21 23:20:41 ../tartest/abc.t.33
drwxr-xr-x rowan/users       0 2008-06-21 23:23:20 ../tartest/dir2/
-rw-r--r-- rowan/users       0 2008-06-21 23:23:20 ../tartest/dir2/abc123_t.gft
-rw-r--r-- rowan/users       0 2008-06-21 23:22:56 ../tartest/abc123_t.gft
drwxr-xr-x rowan/users       0 2008-06-21 23:23:25 ../tartest/dir3/
-rw-r--r-- rowan/users       0 2008-06-21 23:23:25 ../tartest/dir3/abc123_t.gft
drwxr-xr-x rowan/users       0 2008-06-21 23:23:13 ../tartest/dir1/
-rw-r--r-- rowan/users       0 2008-06-21 23:23:13 ../tartest/dir1/abc123_t.gft
 
 
[Writing out starts here]
 
-rw-r--r-- rowan/users       0 2008-06-21 23:23:20 tartest/dir2/abc123_t.gft
drwxr-xr-x                  Creating directory: tartest
drwxr-xr-x                  Creating directory: tartest/dir2
-rw-r--r-- rowan/users       0 2008-06-21 23:22:56 tartest/abc123_t.gft
-rw-r--r-- rowan/users       0 2008-06-21 23:23:25 tartest/dir3/abc123_t.gft
drwxr-xr-x                  Creating directory: tartest/dir3
-rw-r--r-- rowan/users       0 2008-06-21 23:23:13 tartest/dir1/abc123_t.gft
drwxr-xr-x                  Creating directory: tartest/dir1

Open in new window

0
NFR key for Veeam Agent for Linux

Veeam is happy to provide a free NFR license for one year.  It allows for the non‑production use and valid for five workstations and two servers. Veeam Agent for Linux is a simple backup tool for your Linux installations, both on‑premises and in the public cloud.

 
LVL 1

Author Comment

by:terencepires
ID: 21838351
thanks to both of you !

I prefer the scripting solution as it will be something i will have to do more than once, so it's a lot more convenient to me !

Anyway I get an error when running the script :

mv: rename /Users/terencepires/Documents/Skydog/Images/Images_Skydog///Users/terencepires/Documents/Skydog/Images/Images_Skydog//54_nude_honeys_FR_TOUR/1_t.jpg to
/Users/terencepires/Documents/Skydog/Images/Thumbnails//Users/terencepires/Documents/Skydog/Images/Images_Skydog//54_nude_honeys_FR_TOUR/1_t.jpg: No such file or directory

0
 
LVL 14

Accepted Solution

by:
agriesser earned 2000 total points
ID: 21838366
OK, I'm now having access to a linux machine.
Here's the fixed version:
#!/bin/sh
 
basedir=/source
destdir=/destination
 
for file in $(cd $basedir && find . -type f -name "*_t.*"); do
  mkdir -p $destdir/$(dirname $file)
  mv $basedir/$file $destdir/$file
done

Open in new window

0
 
LVL 14

Expert Comment

by:agriesser
ID: 21838373
And here's a version that works with command line parameters (if desired).

Usage: move-files.sh /source /destination
#!/bin/sh
 
if [ "$#" != "2" ]; then
  echo "Usage: $(basename $0) <source-dir> <destination-dir>"
  exit 1
fi
 
basedir="$1"
destdir="$2"
 
for file in $(cd $basedir && find . -type f -name "*_t.*"); do
  mkdir -p $destdir/$(dirname $file)
  mv $basedir/$file $destdir/$file
done

Open in new window

0
 
LVL 1

Author Closing Comment

by:terencepires
ID: 31469409
THANK
YOU !

Cheers
Terence
0

Featured Post

Will your db performance match your db growth?

In Percona’s white paper “Performance at Scale: Keeping Your Database on Its Toes,” we take a high-level approach to what you need to think about when planning for database scalability.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Introduction: Displaying information on the statusbar.   Continuing from the third article about sudoku.   Open the project in visual studio. Status bar – let’s display the timestamp there.  We need to get the timestamp from the document s…
The purpose of this article is to fix the unknown display problem in Linux Mint operating system. After installing the OS if you see Display monitor is not recognized then we can install "MESA" utilities to fix this problem or we can install additio…
This video will show you how to get GIT to work in Eclipse.   It will walk you through how to install the EGit plugin in eclipse and how to checkout an existing repository.
In this video, Percona Solutions Engineer Barrett Chambers discusses some of the basic syntax differences between MySQL and MongoDB. To learn more check out our webinar on MongoDB administration for MySQL DBA: https://www.percona.com/resources/we…
Suggested Courses
Course of the Month9 days, 3 hours left to enroll

765 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question