We help IT Professionals succeed at work.

How to remove duplicates eficiently without sorting

1 Endorsement
Last Modified: 2017-04-21
I have windows 7 and i also I have a 18 Mb text file, i want to remove duplicates without sorting I want every line and word to keep its order

thank you
Watch Question

Brian McDonaldIT Manager

The easiest way I can think to do this is drop this into an excel file and use the builtin remove duplicates function. Is this a list? If so then excel would probably be the quickest way.


is a list:

Brian McDonaldIT Manager

Then I'd dump it into excel and use the built in remove duplicates. You should be able to pull it in so each item is in a different cell, then highlight all cells and go to the data menu, and click remove duplicates. Should work great and will leave the sort order the same.
Experienced IT Infrastructure Services/operations Manager
Unlock this solution and get a sample of our free trial.
(No credit card required)


thank you

Gain unlimited access to on-demand training courses with an Experts Exchange subscription.

Get Access
Why Experts Exchange?

Experts Exchange always has the answer, or at the least points me in the correct direction! It is like having another employee that is extremely experienced.

Jim Murphy
Programmer at Smart IT Solutions

When asked, what has been your best career decision?

Deciding to stick with EE.

Mohamed Asif
Technical Department Head

Being involved with EE helped me to grow personally and professionally.

Carl Webster
CTP, Sr Infrastructure Consultant
Empower Your Career
Did You Know?

We've partnered with two important charities to provide clean water and computer science education to those who need it most. READ MORE

Ask ANY Question

Connect with Certified Experts to gain insight and support on specific technology challenges including:

  • Troubleshooting
  • Research
  • Professional Opinions
Unlock the solution to this question.
Thanks for using Experts Exchange.

Please provide your email to receive a sample view!

*This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.


Please enter a first name

Please enter a last name

8+ characters (letters, numbers, and a symbol)

By clicking, you agree to the Terms of Use and Privacy Policy.