Solved

extract data from a large file in Linux

Posted on 2014-07-24
4
379 Views
Last Modified: 2014-07-24
I have a file with thousands of email, names and addresses and so on I need to extract just the email address and pipe that to a new file.
What would be the easiest grep command to do so?

Regards,
Atorex
0
Comment
Question by:atorex
  • 2
  • 2
4 Comments
 
LVL 68

Accepted Solution

by:
woolmilkporc earned 500 total points
ID: 40217421
grep -o -E "[^[:space:]]*@[^[:space:] ]*" inputfile | sort -u > outputfile

"sort -u" above is meant to remove duplicates.

wmp
0
 

Author Comment

by:atorex
ID: 40217440
the below is what I get, its not getting just email addresses.


Brodner      0.0875      +37.76907      122.444      1      1      1      haight@gin.com      STORE      CALI      San
Byun      0.0925      +41.81192      87.6873      1      1      1      wickerpark@gin.com      STORE      CENTRAL      Chicago      en_US      USD            
Cruz      0.095      +47.43225      121.803      1      1      1      pikeplace@gin.com      STORE      NOWEST      Seattle      en_US      USD            
Cutler      0      +40.68494      73.9806      1      1      1      parkslope@gin.com      STORE      EAST      New
Dworkin      0.09      +33.78659      118.299      1      1      1      larchmont@gin.com      STORE      CALI      Los

Sample input file,

UPDATE      RETAIL_LOCATION      1031      1031      West Pearl      BLD-PERL      943 Pearl St                  Boulder      CO      80302      US                                          0.0836      40.017415      105.283      1      1      1      westpearl@gin.com      STORE      NOWEST      Boulder      en_US      USD
0
 
LVL 68

Expert Comment

by:woolmilkporc
ID: 40217469
It works perfectly for me using your data.

What is your OS, what do you get with "grep --version"?

Did you exactly use my code, including the "[:space:]" stuff I added later?
0
 

Author Comment

by:atorex
ID: 40217480
Sorry My bad, didn't see the updated command, and that works perfectly.

thanks for the help.
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Why Shell Scripting? Shell scripting is a powerful method of accessing UNIX systems and it is very flexible. Shell scripts are required when we want to execute a sequence of commands in Unix flavored operating systems. “Shell” is the command line i…
It’s 2016. Password authentication should be dead — or at least close to dying. But, unfortunately, it has not traversed Quagga stage yet. Using password authentication is like laundering hotel guest linens with a washboard — it’s Passé.
This video shows how to set up a shell script to accept a positional parameter when called, pass that to a SQL script, accept the output from the statement back and then manipulate it in the Shell.
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.

863 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

20 Experts available now in Live!

Get 1:1 Help Now