Everyday I have a set of files like Excel data, text file data that I need to insert into a database.
I want to know if there is an auto method to check if the data has been inserted into the database first before running an insert. I want to avoid duplicate in the database. Or is there a an auto method to check if the file data has been inserted into. If yes, do not run the the file. Otherwise, run the insert.
I want to use SSIS/ETL to do that. can someone help me if there is an auto method to check for this purpose?