Solved

SED Mass find and replace

Posted on 2004-08-03
4
1,799 Views
Last Modified: 2012-05-05
I'm trying to do a mass find and replace using sed. I'm not very good with sed so I don't know how to make it find "cpdigest.com" and replace it with "connectpress.com" in a few thousand files.

Here's what I have so far: sed -e "s/\cpdigest.com/connectpress.com/g

But I dont know where to go from here.

Thanks
0
Comment
Question by:wgordy
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
4 Comments
 
LVL 20

Accepted Solution

by:
Gns earned 500 total points
ID: 11707261
You could wrap it up in a for-loop, or just use the -i option.... This is from the manpage:
       -i[suffix], --in-place[=suffix]
              edit files in place (makes backup if extension supplied)
-------
So you could for example do
sed -i -e 's/cpdigest.com/connectpress.com/g' filenames
or
sed --in-place=".bup" -e 's/cpdigest.com/connectpress.com/g' filenames
...
Perhaps safest to test with one or two files to see that it really does what you expect, and then using the backup suffix method when you do 'em all... provided you have the space (of course:-).

-- Glenn
0
 
LVL 23

Expert Comment

by:Mysidia
ID: 11708467
Just a note... many versions of sed do not have -i.   I believe it appears as a GNU extension in more recent versions only... If you find yourself on a system with a different sed implementation that doesn't have the -i option, and still want a one-line command, you can try perl, also  

I.E.  The perl way to do this would be to issue the command:  perl -i'.bak' -pe 's/cpdigest\.com/connectpress.com/g' *
(In that case you have a perl regular expression instead of a POSIX regular expression, also)

If you want to do the replacement recursively, you need a shell script.
Here's one way:

#!/bin/sh

for i in `find /path/to/start/from -type f` ; do
       mv $i $i.tmp$$
       sed -e 's/cpdigest\.com/connectpress.com/g' < $i.tmp$$ > $i
       mv $i.tmp$$ $i.bak
done


You can also use find options like   -name \*.txt

for example, if you only want to alter files that contain that pattern in the filename
0
 
LVL 8

Expert Comment

by:da99rmd
ID: 11712918
Hi wgordy,
go for Gns solution but i would use find instead of a for loop(for loops always has problem with strange file names etc.), like this:
find /path/to/files -type f -exec sed -i -e 's/cpdigest.com/connectpress.com/g' {} \;
but this is kind of dangerous so test with this first:
find /path/to/files -type f -exec sed -e 's/cpdigest.com/connectpress.com/g' {} > {}.kalleballe \;
this way you ca take a look at some files named *.kalleballe and see if it worked, and then use the command line above.

/Rob
0
 
LVL 20

Expert Comment

by:Gns
ID: 11713979
Well Mysidia, this is the Linux TA... It's one of the very few places where we can safely rely on the GNU-ish features being there;-).
And sure, you need a version 4 sed... But this isn't _that_ brand new exactly. Most modern distros will have moved to this version by now.
Further, if the feature showed to be lacking, I was planning to show some further examples along the same vein you and Rob did... (You just beat me to it (I'm much for dialog with the questioner;)...:-) Anyway... Thanks for doing them!

Oh, Rob, minor point... When we're talking thousands of files I tend to prefer using the xargs strategy WRT find -exec, simply to reduce the number of fork/execs that need be done ... so that transforms your first example to
find /path/to/files -type f -print | xargs sed -i -e 's/cpdigest.com/connectpress.com/g'
... Your second example doesn't lend it self to that though (for obvious reasons:-) but is fairly close to the
find /path/to/files -type f -print | xargs sed --in-place=.bup -e 's/cpdigest.com/connectpress.com/g'
which is inverse and fairly easy to "undo" (execise left to the reader:-):-)

-- Glenn
0

Featured Post

Do you have a plan for Continuity?

It's inevitable. People leave organizations creating a gap in your service. That's where Percona comes in.

See how Pepper.com relies on Percona to:
-Manage their database
-Guarantee data safety and protection
-Provide database expertise that is available for any situation

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Network Interface Card (NIC) bonding, also known as link aggregation, NIC teaming and trunking, is an important concept to understand and implement in any environment where high availability is of concern. Using this feature, a server administrator …
It’s 2016. Password authentication should be dead — or at least close to dying. But, unfortunately, it has not traversed Quagga stage yet. Using password authentication is like laundering hotel guest linens with a washboard — it’s Passé.
Learn how to get help with Linux/Unix bash shell commands. Use help to read help documents for built in bash shell commands.: Use man to interface with the online reference manuals for shell commands.: Use man to search man pages for unknown command…
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.
Suggested Courses

623 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question