We help IT Professionals succeed at work.
Get Started
Linux Sort/Dedupe but with a header on line 1
I have the following command:
sort FILENAME -u >> FILENAME-2
What it is meant to do is DEDUP AND SORT. However, my files have a one line header at the top; EX.
Email,Fname,Lname
rvalleriani@test.com,Chris
test@test.com,Mike,Liuk
m@m.com,Maurico,Hammer
The above command will randomize everything including the first line, which it shouldn't do!!
I was told to try this:
tail +2 FILENAME| sort FILENAME -u >> FILENAME-2
However, this doesn't seem to work either.
Any suggestions?
sort FILENAME -u >> FILENAME-2
What it is meant to do is DEDUP AND SORT. However, my files have a one line header at the top; EX.
Email,Fname,Lname
rvalleriani@test.com,Chris
test@test.com,Mike,Liuk
m@m.com,Maurico,Hammer
The above command will randomize everything including the first line, which it shouldn't do!!
I was told to try this:
tail +2 FILENAME| sort FILENAME -u >> FILENAME-2
However, this doesn't seem to work either.
Any suggestions?
Why Experts Exchange?
Experts Exchange always has the answer, or at the least points me in the correct direction! It is like having another employee that is extremely experienced.
Jim Murphy
Programmer at Smart IT Solutions
When asked, what has been your best career decision?
Deciding to stick with EE.
Mohamed Asif
Technical Department Head
Being involved with EE helped me to grow personally and professionally.
Carl Webster
CTP, Sr Infrastructure Consultant
Ask ANY Question
Connect with Certified Experts to gain insight and support on specific technology challenges including:
- Troubleshooting
- Research
- Professional Opinions
Did You Know?
We've partnered with two important charities to provide clean water and computer science education to those who need it most. READ MORE