Data Ware House - Daily CSV Extracts into Microsoft SQL 2008 R2 Server

Hi,
I've recently been give a task to import daily change files into an Microsoft SQL Server. There are 156 files/tables that are Extracted & downloaded on a daily base that need to be bulk insert into an SQL database. What is the best way to approach this?

There are a few tools that I've been looking at, which are SSIS and BCP.
johnojohnoAsked:
Who is Participating?
 
aikimarkConnect With a Mentor Commented:
Files have both a creation date and a modified date properties.  Why couldn't you use that date?
0
 
aikimarkCommented:
You should include Powershell as another viable tool.  Like BCP, it is a 'push' model.  SSIS would be the pull model.
0
 
johnojohnoAuthor Commented:
Thanks aikmark I'll check it out. I've started to use SSIS to import the data. I've created a foreach loop container for each of my table extracts, which are daily CSV files.
Unfortunately non of the data extracts have a record creation date so I need to come up with a way to understand which records are the most up to date.  

Does anyone have any ideals how I can do this and remove the duplicate records of about 117 tables on a daily bases?
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.