<div>
Truncate which table? Why would any data from a prior query need to be removed? Instead, why not run the job an midnight and pull only yesterday's new additions to the Log table?
</div>


Truncate which table? Why would any data from a prior query need to be removed? Instead, why not run the job an midnight and pull only yesterday's new additions to the Log table?

<div>
<div class="content wysiwyg-content">
14 million records is not that big, but is too large for me to do &quot;what if&quot; queries without such a long response time, I lose my train of thought.<br />
<br />
&nbsp;I need to create some form of order on the data to support my data mining without changing the db schema. So I imagine I could plan out a night job that would run:<br />
<br />
- Index on the Log table for better performance<br />
- Create one or more tables which my scripts will populate <br />
- Make one or more scripts that will populate the tables<br />
<br />
Does this concept make sense?<br />
<br />
Suggestions?<br />
<br />
Thanks.
</div>
</div>


14 million records is not that big, but is too large for me to do "what if" queries without such a long response time, I lose my train of thought.

 I need to create some form of order on the data to support my data mining without changing the db schema. So I imagine I could plan out a night job that would run:

- Index on the Log table for better performance
- Create one or more tables which my scripts will populate 
- Make one or more scripts that will populate the tables

Does this concept make sense?

Suggestions?

Thanks.

T-SQL: Need a database plan to mine a pretty big Log table

Databases are organized collections of data, most commonly accessed through management systems including schemas, tables, queries and processes that allow users to enter and manipulate the information or utilize it in other fashions, such as with web applications or for reporting purposes.

Databases

Microsoft SQL Server is a suite of relational database management system (RDBMS) products providing multi-user database access functionality.SQL Server is available in multiple versions, typically identified by release year, and versions are subdivided into editions to distinguish between product functionality. Component services include integration (SSIS), reporting (SSRS), analysis (SSAS), data quality, master data, T-SQL and performance tuning.

Microsoft SQL Server

Microsoft SQL Server 2008 is a suite of relational database management system (RDBMS) products providing multi-user database access functionality.Component services include integration (SSIS), reporting (SSRS), analysis (SSAS), data quality, master data, T-SQL and performance tuning. Major improvements include the  Always On technologies and support for unstructured data types.

Microsoft SQL Server 2008

T-SQL

SQL (Structured Query Language) is designed to be used in conjunction with relational database products as of a means of working with sets of data. SQL consists of data definition, data manipulation, and procedural elements. Its scope includes data insert, query, update and delete, schema creation and modification, and data access control.