Link to home
Start Free TrialLog in
Avatar of FillSee
FillSee

asked on

Sql Server 2005 Visual Studio Data Transformation - Locate duplicate data and make unique

In Visual Studio with SQL Server 2005, I am extracting one field of data from one table with a small number of duplicates and inserting it into another table where the destination field is the primary key (i.e. unique - no duplicates allowed).
I am using a source and a destination OLEDB connection object in each case.

I need help with creating a query (or Data flow transformation) that detects duplicate data and adds a character to make the 2nd, 3rd or 4th instance of the duplicate data unique allowing the subsequent destination field act as a unique identifier.
ASKER CERTIFIED SOLUTION
Avatar of Dabas
Dabas
Flag of Australia image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of FillSee
FillSee

ASKER

Thanks Dabas, a handy addition to my script library! I also tried concatenating two fileds in the source data stream ('cust name' and 'cust code') to create a unique identifier which also worked in this case.