Solved

Script to change CR LF to LF -- 0D 0A  to 0A

Posted on 2006-06-21
12
3,999 Views
Last Modified: 2013-12-26
I'm trying to get a script written to change the carrige return linefeed characters to linefeed characters

I have a file where all lines end with Hex 0D 0A  I want them to end with 0A

I tried using sed to do a search and replace - something like this:

sed -e 's/\x0D/whatever/' test.txt > test.new

Search for 0d and replace with "whatever"

I just wanted to get this working first - Anyway - sed runs without error but apparetnly can't find any 0D in my file
even though I know the hex character exists.

Thanks
0
Comment
Question by:aflat362
  • 6
  • 5
12 Comments
 
LVL 86

Expert Comment

by:jkr
Comment Utility
Don't reinvent the wheel, 'recode' or 'dos2unix' can do that, e.g.

dos2unix test.txt test.new

recode ibmpc..lat1 text.txt > test.new
0
 
LVL 3

Author Comment

by:aflat362
Comment Utility
I don't have either of those executables . . .

[x67167] dbimg1:/home/x67167) dos2unix
ksh: dos2unix:  not found.
[x67167] dbimg1:/home/x67167) recode
ksh: recode:  not found.

0
 
LVL 3

Author Comment

by:aflat362
Comment Utility
I'm running AIX 5.2 ml 4
0
 
LVL 43

Accepted Solution

by:
ravenpl earned 125 total points
Comment Utility
try:
cat file.txt | perl -ne 'y/\r//d; print'
0
 
LVL 3

Author Comment

by:aflat362
Comment Utility
hmm.

I don't have perl installed.  

I'd like to get this working with the tools I have:

shell (korn, bourne or C)
awk
sed

Thanks for the posts.
0
 
LVL 3

Author Comment

by:aflat362
Comment Utility
nevermind.  I do have perl.

This may work for me.

cat test.txt | perl -ne 'y/\r//d; print' > test.new

Can you explain what the y/\r//d;  part of this command is doing?

or point me to a reference?

Thanks
0
Do You Know the 4 Main Threat Actor Types?

Do you know the main threat actor types? Most attackers fall into one of four categories, each with their own favored tactics, techniques, and procedures.

 
LVL 43

Expert Comment

by:ravenpl
Comment Utility
cat file.txt | sed -e 's/\r//'
#but please verify that it in fact removes the char...
0
 
LVL 43

Expert Comment

by:ravenpl
Comment Utility
Bots, sed and perl s/// or y///d searches for given character, then rplaces with replaement char(or removes if no replacement found
y/ab/c/d # changes each occurance of 'a' to 'c' and remoes any 'c'.
0
 
LVL 43

Expert Comment

by:ravenpl
Comment Utility
removes any 'b' character - dorry for mistake above.
0
 
LVL 3

Author Comment

by:aflat362
Comment Utility
Ok, so for this example it searches for \r which must equate to 0D 0A and replaces it with what? null?

what's up with the "d"?

cat test.txt | perl -ne 'y/\r//d; print' > test.new

Thanks
0
 
LVL 43

Expert Comment

by:ravenpl
Comment Utility
in fact - not really. It searched for any \r and removes. 'd' stands for delete found but not replaced characters.
For more please see: man perlop, operation 'tr' or 'y'
0
 
LVL 3

Author Comment

by:aflat362
Comment Utility
Thanks!
0

Featured Post

Why You Should Analyze Threat Actor TTPs

After years of analyzing threat actor behavior, it’s become clear that at any given time there are specific tactics, techniques, and procedures (TTPs) that are particularly prevalent. By analyzing and understanding these TTPs, you can dramatically enhance your security program.

Join & Write a Comment

This is to be the first in a series of articles demonstrating the development of a complete windows based application using the MFC classes.  I’ll try to keep each article focused on one (or a couple) of the tasks that one may meet.   Introductio…
Introduction: Displaying information on the statusbar.   Continuing from the third article about sudoku.   Open the project in visual studio. Status bar – let’s display the timestamp there.  We need to get the timestamp from the document s…
This video will show you how to get GIT to work in Eclipse.   It will walk you through how to install the EGit plugin in eclipse and how to checkout an existing repository.
This video gives you a great overview about bandwidth monitoring with SNMP and WMI with our network monitoring solution PRTG Network Monitor (https://www.paessler.com/prtg). If you're looking for how to monitor bandwidth using netflow or packet s…

728 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

11 Experts available now in Live!

Get 1:1 Help Now