Link to home
Start Free TrialLog in
Avatar of sunshine737
sunshine737

asked on

Wierd characters in a file.

am looking for help in removing the weird characters
which are coming along with special characters in the source file .

The user enters text for a description field manually
the description may consist special characters like registered mark( R) , trademark ( TM)
and even some times for regular pipe symbol( | )

the characters are coming good, but a non printable weird character is coming along with
these special characters.
Please verify the image in attachment
you can see a wierd character looks like 'A' between Staples and Registerd mark
and also the character like 'A' between Post-it and Registerd marks

I want to remove such kind of wierd characters only, before processing my source file

I appreciate your help to remove these wierd characters preferably in unix

unix environment: IBM AIX

Thanks User generated image
Avatar of skymo
skymo
Flag of Israel image

tr -cd '\11\12\40-\176' < $INPUT_FILE > $OUTPUT_FILE
you can also use the [:printable:] filter in the tr instead of the \xx\yyy\....
Avatar of sunshine737
sunshine737

ASKER

Sorry,that didn't worked.
I am attaching the sample file.i can see special characters,when i open the file in unix.

Thanks
wierd-characters-file.txt
ASKER CERTIFIED SOLUTION
Avatar of msk_1227
msk_1227

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial