Solved

loop for import excel file with date prefix using ssis package

Posted on 2015-02-18
7
97 Views
Last Modified: 2016-02-15
Hi,

I have a requirement to load data into SQL table. The excel files come with the date on it as below format:

xxxxxxx_2015_02_19_050021

Please let me know how do I loop through the files and load the data into a sql table. and also store this files in SQL table


thanks in advance
0
Comment
Question by:ken hanse
  • 3
  • 3
7 Comments
 
LVL 65

Accepted Solution

by:
Jim Horn earned 100 total points
ID: 40617878
In general, this would be an SSIS package with a For Each File loop to sweep through a given folder for files of a certain type, then those files can be used as the data source in a data flow task.

So .. are these files exactly the same schema?

Also, be advised that SSIS and Excel have known compatibility issues, and Excel docs are not good for data sources as users can do thousands of different things to throw off both normalization and the source to target mapping.
0
 

Author Comment

by:ken hanse
ID: 40627889
Yes, it is same schema. And using 32bit excel driver.
0
 
LVL 45

Expert Comment

by:Vitor Montalvão
ID: 40630731
How many files will you process by day?
All files? Only the day file?
0
Enabling OSINT in Activity Based Intelligence

Activity based intelligence (ABI) requires access to all available sources of data. Recorded Future allows analysts to observe structured data on the open, deep, and dark web.

 

Author Comment

by:ken hanse
ID: 40638760
Only the day file
0
 
LVL 45

Expert Comment

by:Vitor Montalvão
ID: 40639173
Then use the Import Data wizard to create a daily job and assure that the file has always the same name.
0
 

Author Comment

by:ken hanse
ID: 40640645
sorry Vitor, I just need to explained bit more.

the file format is:

xxxxxx_yyyy_mm_dd_mmss

one file per day

This is on excel xls format. I need dynamically read the file,


Thanks
0
 
LVL 45

Assisted Solution

by:Vitor Montalvão
Vitor Montalvão earned 400 total points
ID: 40647302
Then use Jim Horn's suggestion. Create a package in SSIS than can go through all files and process only the files that you want.
0

Featured Post

Find Ransomware Secrets With All-Source Analysis

Ransomware has become a major concern for organizations; its prevalence has grown due to past successes achieved by threat actors. While each ransomware variant is different, we’ve seen some common tactics and trends used among the authors of the malware.

Join & Write a Comment

Entering time in Microsoft Access can be difficult. An input mask often bothers users more than helping them and won't catch all typing errors. This article shows how to create a textbox for 24-hour time input with full validation politely catching …
Here's a requirements document template for an integration project (also known as Extract-Transform-Load or ETL) based on my development experience as an SQL Server Information Services (SSIS) developer over the years.
This is Part 3 in a 3-part series on Experts Exchange to discuss error handling in VBA code written for Excel. Part 1 of this series discussed basic error handling code using VBA. http://www.experts-exchange.com/videos/1478/Excel-Error-Handlin…
You have products, that come in variants and want to set different prices for them? Watch this micro tutorial that describes how to configure prices for Magento super attributes. Assigning simple products to configurable: We assigned simple products…

705 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

20 Experts available now in Live!

Get 1:1 Help Now