Solved

sed / awk / grep on files in directory

Posted on 2009-03-28
3
646 Views
Last Modified: 2013-12-26

Hello:
I need some help please. I need a ksh script that will perform some rather basic sed/awk grep commands.

I have a directory full of .txt files. Each file in this directory needs to undergo a treatment.
(learned from earlier EE posting)

1. sed -e 's/~/~\n/g' $file1 > $file1.$$

I'm interested in lines starting with "W12" within these files.  When I grep for that pattern in each .txt file, it produces STANDARDIZED output like this. (Delimiter will always be a '*' and position is fixed.)

W12*CL**18****VN*4921427~
W12*CL**3****VN*4921537~
W12*CL**4****VN*4931037~
W12*CS**2****VN*5057600~
W12*CS**5****VN*5057604~

2. I'd like to see the filename _AND_ line number where the grep match took place
3. Also need to count the # of times 'CL' and 'CS' appear in that output shown above.
4. Need to put a tab between the 5th and 6th char in the 7 digit integer shown in lines above.
5. Need to e-mail the ultimate output to a list of users

Thank you very much.

0
Comment
Question by:cjb123
  • 2
3 Comments
 
LVL 45

Expert Comment

by:sunnycoder
ID: 24011666
#matched lines
grep -n ^W12 $file1.$$


CL_count=`grep -n ^W12 $file1.$$ | grep CL | wc -l`
CS_count=`grep -n ^W12 $file1.$$ | grep CS | wc -l`

#4. Need to put a tab between the 5th and 6th char in the 7 digit integer shown in lines above.
grep -n ^W12 $file1.$$ | sed 's/\(.*\*\)\(.....\)\(..\)/\1\2\t\3/'   > final_out.txt

#5. Need to e-mail the ultimate output to a list of users
mutt -a final_out.txt  -s "the output" receiver@domain.com
0
 

Author Comment

by:cjb123
ID: 24013020
Sunnycoder:
thanks for quick reply.  Would you please help me get the FILENAME and LINE NUMBER from the grep commands where pattern "W12" isfound?  Thank you.
0
 
LVL 45

Accepted Solution

by:
sunnycoder earned 500 total points
ID: 24013147
Filename
grep -n ^W12 $file1.$$ | awk -F: ' { print $1 } '

Line Number
grep -n ^W12 $file1.$$ | awk -F: ' { print $2 } '

File name and line number
grep -n ^W12 $file1.$$ |  awk -F: ' { print $1 " " $2 } '

0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Question regarding Copy/Paste 16 91
Expand data scrubbing tool 13 32
sumNumber challenge 16 111
Smart Camera scanning and reading information 3 100
Introduction: The undo support, implementing a stack. Continuing from the eigth article about sudoku.   We need a mechanism to keep track of the digits entered so as to implement an undo mechanism.  This should be a ‘Last In First Out’ collec…
Have you tried to learn about Unicode, UTF-8, and multibyte text encoding and all the articles are just too "academic" or too technical? This article aims to make the whole topic easy for just about anyone to understand.
This video will show you how to get GIT to work in Eclipse.   It will walk you through how to install the EGit plugin in eclipse and how to checkout an existing repository.
Video by: Mark
This lesson goes over how to construct ordered and unordered lists and how to create hyperlinks.

896 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

13 Experts available now in Live!

Get 1:1 Help Now