Handling large portions of data in SQL Server
Posted on 2011-02-13
we are trying to implement an archiving system that keeps up to 15 years of data. The data will be imported daily through files, each of them is 2 GB.
- I am here concerned with the performance issues that may result during retrieving this data
- This data is going to be transformed from files to relational DB in order to facilitate the reporting and the retrieval functionalities. each file will include 1 million - 3 million of records
- 15 users will connect to this data, in a parallel manner, in order to perform various search queries
- No summary reports (statistical) is requested
Is it proper to use SQL Server to handle this? What about the Hardware specifications that should be considered? What is the best techniques that should be considered when structuring this data?