Link to home
Start Free TrialLog in
Avatar of tracimcp
tracimcp

asked on

SSIS data validation

Hello,

I'm working on a project that will load data from a text file into the database.  I've created an SSIS package that loads the data into staging tables and then I have a sql statement that inserts the data into the correct production tables.  

My question is what is the best way to validate the data using SSIS?  
i) Invalid or missing values (e.g. bad dates. non-numeric data in numeric fields) and then produce an exception report.  

Please Help as I need to have this done soon!
Avatar of davecorun
davecorun

You have two options.  You can manually add tasks that massage the data, and look for "invalid data", and have it put these items in an audit report.

Or you could use the Error pages within your tasks to decide what to do w/ errors when they are encountered.  To connect another task to an "error", it's always the red line.  Then have that sub-task put the results in an audit report of sorts.
Avatar of tracimcp

ASKER

One of the columns is a date field and is being sent to us in the format: yyyymmdd.  How  can i determine if an invalid date is in that field? An example would be if some of the date field was missing:  200707?

Thanks!
ASKER CERTIFIED SOLUTION
Avatar of davecorun
davecorun

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Dave,

I would prefer to use the conditional split.  But what would I put in the field to check the date if I use the split?