Solved

How can I track the Processing times for my ETL/SSIS packages?

Posted on 2014-01-29
3
320 Views
Last Modified: 2016-02-10
I'm using SQL Server 2012, what is the best way to analyze the different processing times for my different ETL/SSIS packages?

I'm interested in seeing perhaps a comparison of PROCESSING times campared against each other for a nightly ETL Jobs Run..

Thanks
0
Comment
Question by:MIKE
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
3 Comments
 
LVL 66

Accepted Solution

by:
Jim Horn earned 500 total points
ID: 39819003
Most developers I know, pre-2012, created their own 'logging' table for SSIS package runs, with an id identity columns, and columns for the name, any variables passed, whatever.

When a package starts, an SQL Task in the beginning writes a row to this table, returns the id value, and then stores that value in an SSIS variable.

When a package ends, a SQL Task at the end updates that row based on the id = @id, and adding whatever other values you wish to track such as number of files processed, number of rows inserted-updated-deleted, etc.

Then, just query the table to view all history.
0
 
LVL 17

Author Comment

by:MIKE
ID: 39819036
I was wondering if there was some kind of module or app in SQL Server 2012 that would help in this regard. I wonder if some SYS table automatically tracks the actual processing time spent in seconds or whatever,...?
0
 
LVL 66

Assisted Solution

by:Jim Horn
Jim Horn earned 500 total points
ID: 39819047
Built-in Reporting shows some promise, but I haven't worked with it so can't give you a definitive answer.

I'll step back to encourage other experts to respond.
0

Featured Post

Salesforce Has Never Been Easier

Improve and reinforce salesforce training & adoption using WalkMe's digital adoption platform. Start saving on costly employee training by creating fast intuitive Walk-Thrus for Salesforce. Claim your Free Account Now

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

JSON is being used more and more, besides XML, and you surely wanted to parse the data out into SQL instead of doing it in some Javascript. The below function in SQL Server can do the job for you, returning a quick table with the parsed data.
Ever needed a SQL 2008 Database replicated/mirrored/log shipped on another server but you can't take the downtime inflicted by initial snapshot or disconnect while T-logs are restored or mirror applied? You can use SQL Server Initialize from Backup…
Using examples as well as descriptions, and references to Books Online, show the documentation available for date manipulation functions and by using a select few of these functions, show how date based data can be manipulated with these functions.
Via a live example, show how to shrink a transaction log file down to a reasonable size.

623 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question