Solved

How can I track the Processing times for my ETL/SSIS packages?

Posted on 2014-01-29
3
310 Views
Last Modified: 2016-02-10
I'm using SQL Server 2012, what is the best way to analyze the different processing times for my different ETL/SSIS packages?

I'm interested in seeing perhaps a comparison of PROCESSING times campared against each other for a nightly ETL Jobs Run..

Thanks
0
Comment
Question by:MIKE
  • 2
3 Comments
 
LVL 65

Accepted Solution

by:
Jim Horn earned 500 total points
ID: 39819003
Most developers I know, pre-2012, created their own 'logging' table for SSIS package runs, with an id identity columns, and columns for the name, any variables passed, whatever.

When a package starts, an SQL Task in the beginning writes a row to this table, returns the id value, and then stores that value in an SSIS variable.

When a package ends, a SQL Task at the end updates that row based on the id = @id, and adding whatever other values you wish to track such as number of files processed, number of rows inserted-updated-deleted, etc.

Then, just query the table to view all history.
0
 
LVL 17

Author Comment

by:MIKE
ID: 39819036
I was wondering if there was some kind of module or app in SQL Server 2012 that would help in this regard. I wonder if some SYS table automatically tracks the actual processing time spent in seconds or whatever,...?
0
 
LVL 65

Assisted Solution

by:Jim Horn
Jim Horn earned 500 total points
ID: 39819047
Built-in Reporting shows some promise, but I haven't worked with it so can't give you a definitive answer.

I'll step back to encourage other experts to respond.
0

Featured Post

Courses: Start Training Online With Pros, Today

Brush up on the basics or master the advanced techniques required to earn essential industry certifications, with Courses. Enroll in a course and start learning today. Training topics range from Android App Dev to the Xen Virtualization Platform.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

My client sends data in an Excel file to me to load them into Staging database. The file contains many sheets that they have same structure. In this article, I would like to share the simple way to load data of multiple sheets by using SSIS.
I have a large data set and a SSIS package. How can I load this file in multi threading?
Via a live example, show how to extract insert data into a SQL Server database table using the Import/Export option and Bulk Insert.
Viewers will learn how to use the SELECT statement in SQL to return specific rows and columns, with various degrees of sorting and limits in place.

813 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now