MS SQL Scheduled ODBC import
Posted on 2011-09-21
I've been trying to use Crystal Reports to provide some Business Intelligence.
I have been running reports on our main company database which is an odd bespoke DBMS with little support and only an ODBC interface for me to talk to it with.
Although it has been working in principal, the process of running some of the more complex reports I've been designing has proved to be unbelieveably slow. Even a relatively simple report on two linked tables can take all afternoon.
On experimenting it seems that a report that just pulls out the entire table is actually quite quick, so I've decided to set up a SQL server (MSSQL2008 because it is what I'm used to) and I now want to pull about a dozen tables into a blank database every night (overwriting the existing ones) and then run the reports on the SQL database, which will be nice and quick and won't affect the users of the main system.
How can I set up the SQL server to automatically drag the tables I nominate out of the OBDC connection every night and dump them in this temporary database ready for reporting on? Also, can I set up stored procedures that run at scheduled times to do a bit of processing on the data once it has arrived?
I'm pretty good with T-SQL and Crystal Reports, but the actual guts of SQL server are not my strongest point.
Thanks in advance.