<div>
The following:<br />

<div class="indent">
perl -e'open(F,$ARGV[0])||die; $_=join(&quot;\n&quot;,&lt;F&gt;); s/(\s)\s+/$1/gm; 1 while( s/(^\s|^\d\n|^\d\s)//gm); s/\s*www\s*//g; print' my_big_file
</div>
<br />
Returns<br />
<br />

<div class="indent">
aword aword aword aword aword<br />
bword bword bword<br />
40,000 sss ss ss $1000Aug 21, 2007<br />
Oct 29, 2008
</div>
<br />
is that what you wanted?<br />
<br />
<br />

</div>


The following:

perl -e'open(F,$ARGV[0])||die; $_=join("\n",<F>); s/(\s)\s+/$1/gm; 1 while( s/(^\s|^\d\n|^\d\s)//gm); s/\s*www\s*//g; print' my_big_file

Returns


aword aword aword aword aword
bword bword bword
40,000 sss ss ss $1000Aug 21, 2007
Oct 29, 2008

is that what you wanted?




<div>
Superb thanks! I also wanted to remove any instance of a date that follows that format (Aug 21, 2007 etc). Thanks again
</div>


Superb thanks! I also wanted to remove any instance of a date that follows that format (Aug 21, 2007 etc). Thanks again

<div>
Glad I was able to help.<br />
Happy Perling!
</div>


<div>
<div class="content wysiwyg-content">
Hi,<br />
<br />
How can I remove multiple spaces and empty lines? Also, I need to remove all single digits from a large file.<br />
<br />
Here's what the file looks like:<br />
<br />
&nbsp; &nbsp; &nbsp;aword aword aword &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; aword &nbsp; aword<br />
<br />
bword bword &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; bword<br />
<br />
1<br />
3<br />
2<br />
4<br />
5<br />
<br />
3 &nbsp; &nbsp;#40,000 sss ss &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ss $1000 # In this case I would want to remove 1,3,2,4,5,3 but not #40,000 or $1000<br />
<br />
<br />
1 2 3 4 5 6 8 9 #Need to remove any standalone character 1-9<br />
<br />
<br />
www Aug 21, 2007 #need to remove any instance of www<br />
<br />
<br />
Oct 29, 2008 # Need to remove any occurrence of a date<br />
<br />
<br />
Thanks a lot in advance.<br />
<br />
<br />
<br />
<br />
<br />
<br />
<br />
<br />
&nbsp;
</div>
</div>


Hi,

How can I remove multiple spaces and empty lines? Also, I need to remove all single digits from a large file.

Here's what the file looks like:

     aword aword aword           aword   aword

bword bword             bword

1
3
2
4
5

3    #40,000 sss ss           ss $1000 # In this case I would want to remove 1,3,2,4,5,3 but not #40,000 or $1000


1 2 3 4 5 6 8 9 #Need to remove any standalone character 1-9


www Aug 21, 2007 #need to remove any instance of www


Oct 29, 2008 # Need to remove any occurrence of a date


Thanks a lot in advance.








 

Remove extra spaces, empty lines, dates,

The term 'shell' refers to a general class of text-based command interpreters most often associated with the UNIX and Linux operating systems. Popular shells include Bourne, Debian Almquist (dash), Korn (ksh), Bourne Again (bash) and the C shell family (csh). Some view the DOS 'cmd' prompt as a minimal shell of sorts. It is also possible to install Cygwin on Windows and emulate a full Unix environment with complete shell capabilities. Terminal emulators, such as xterm, GNOME Terminal and OS X Terminal, can be used to access shell.

Shell Scripting

Perl is a high-level, general-purpose, interpreted, dynamic programming languages with over 25 years of development. Perl 5 runs on over 100 platforms from portables to mainframes and is suitable for both rapid prototyping and large-scale development projects.  Perl gained widespread popularity as a Common Gateway Interface (CGI) scripting language, in part due to its regular expression and string parsing abilities. In addition to CGI, Perl is used for graphics programming, system administration, network programming, finance, bioinformatics, and other applications.

Perl

A regular expression ("regex") is a sequence of characters that define a search pattern, mainly for use in pattern matching with strings, or string matching, i.e. "find and replace"-like operations. Regular expression processors are found in several search engines, search and replace dialogs of several word processors and text editors, and in the command lines of text processing utilities, such as sed and AWK. Many programming languages provide regular expression capabilities, some built-in, for example Perl, JavaScript, Ruby, AWK, and Tcl, and others via a standard library, for example .NET languages, Java, Python and C++ (since C++11). Most other languages offer regular expressions via a library.