Identify duplicate record using random key - possible?
We are loading data from files into SQL Server database using SSIS. Before insert into the destination table, we need to remove duplicate.
1) What is the best way to do this in SSIS?
2) I am thinking of store a randome key in teh destination table, where the random key is generated using the entire record as input. Does SQL Server have a random generator that accepts parameter of type varchar?