Link to home
Start Free TrialLog in
Avatar of Sabrin
Sabrin

asked on

remove duplicates from text file

hello,
I have a text file with name in it each line by line and I would like to check
for duplicates and delete them! how can I do this?
SOLUTION
Avatar of GrahamSkan
GrahamSkan
Flag of United Kingdom of Great Britain and Northern Ireland image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of Sabrin
Sabrin

ASKER

this makes the computer freeze if the list has 50,000 lines!!
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
ASKER CERTIFIED SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
mmm Idle_Mind nice!
I should have thought it my self.
That's secret option #3...   =)

I believe you could also build an in memory table out of the data and query it using an SQL statement to get the unique values.  ADO or something...not my forte though....  =\