<div>
If you want to prevent a duplicate file load, you need a unique way to identify the file. &nbsp;How would you know it's a duplicate? &nbsp;Does the file have a unique name? &nbsp;Or time stamp? &nbsp;Or column with a unique id ?
</div>


<div>
Actually there is no unique field in a data that is being provided, execept filename
</div>


<div>
<div class="content wysiwyg-content">
I am looking for advise what would be the best approach for storing history of ETL load. The way ETL works is I am receiving flat file and it is loaded to staging area and from staging area to a production table and to a view<br />
What would be the best approach in case I got duplicate file and load it I do not want that to happen<br />
Thanks<br />
Robert
</div>
</div>


I am looking for advise what would be the best approach for storing history of ETL load. The way ETL works is I am receiving flat file and it is loaded to staging area and from staging area to a production table and to a view
What would be the best approach in case I got duplicate file and load it I do not want that to happen
Thanks
Robert

Best approach for history retention in SSIS ETL

SQL Server Integration Services (SSIS) is a component of the Microsoft SQL Server database software that can be used to perform a broad range of data migration tasks. SSIS is a platform for data integration and workflow applications. It features a fast and flexible data warehousing tool used for data extraction, transformation, and loading (ETL). The tool may also be used to automate maintenance of SQL Server databases and updates to multidimensional cube data. SSIS replaced Data Transformation Services, which had been a feature of SQL Server since Version 7.0.

SSIS

Microsoft SQL Server is a suite of relational database management system (RDBMS) products providing multi-user database access functionality.SQL Server is available in multiple versions, typically identified by release year, and versions are subdivided into editions to distinguish between product functionality. Component services include integration (SSIS), reporting (SSRS), analysis (SSAS), data quality, master data, T-SQL and performance tuning.