Posted on 2011-09-06
Last Modified: 2013-11-10

i am currently developing my first package in ssis, one element of the package is a data flow task that uses an ole db source - which points towards an excel file - thinking being that it will pick up this file when its saved in the correct location process it accordingly and move the file when fisnished

this is all working perfectly in debug, until when the excel document isnt there - it then gives back an error!

how would i best achieve this process? eg i will want to check the folder daily and if its not there simply do nothing and return no errors..


Question by:malraff
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 3
LVL 18

Expert Comment

ID: 36489087
Here is what  I use as the first step in my SSIS jobs that import files.  It checks to see if the file is there and hasn't already been processed.  As the final step, I update the table ImportLog with the finished time.

DECLARE @ImportName varchar(50)
SET @ImportName = 'DailyTotals'
DECLARE @FileInfo varchar(500)
DECLARE @CreateDate datetime
CREATE TABLE [dbo].[#tbl_temp_Timestamp](vchFileData varchar(2000))
INSERT INTO #tbl_temp_Timestamp
  EXEC [master].[dbo].xp_cmdshell 'dir \\server\share\filename.txt /T:W | FIND "filename"'

SELECT @FileInfo = vchFileData FROM #tbl_temp_Timestamp WHERE #tbl_temp_Timestamp.vchFileData IS NOT NULL
DROP TABLE [dbo].[#tbl_temp_Timestamp]
IF @FileInfo = 'File Not Found'
      raiserror ('File not present',16,1)

IF (SELECT COUNT(*) FROM ImportLog WHERE ImportName = @ImportName AND FileDate = @CreateDate AND ImportComplete IS NOT NULL) > 0
      raiserror ('File already processed',16,1)

INSERT INTO ImportLog (ImportName, FileDate, ImportStart) VALUES (@ImportName, @CreateDate, getdate())

LVL 14

Accepted Solution

Christopher Gordon earned 500 total points
ID: 36489143
In the past, I've used a Foreach Loop Container to prevent the "File Not Found" type of errors.

If you haven't used a Foreach Loop Container before, simply drag the Task from the toolbar onto your SSIS Canvas.  You can then copy and paste the contents of your package into the Foreach Loop Container (make sure you have the task highlighted when you paste).

Last, you'll need to set some properties of the Foreach loop task.

1. Right Click on Foreach Loop task.
2. Select "Collection" on Left Hand Menu
3. Change Enumerator to "Foreach File Enumerator".
4. Set the "Folder:" property the target folder.
5. Set the "Files:" property to the name of the file the package will be looking for (you can use wildcards).

LVL 14

Expert Comment

by:Christopher Gordon
ID: 36489181
Some more additional explanation might be in order,

With the above logic, the ssis package will first execute the Foreach loop task.  If it finds a file that matches the criteria specified, it will execute the code inside the container.  If it doesn't, it will close without throwing an error.
Independent Software Vendors: We Want Your Opinion

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!


Author Comment

ID: 36489225
hi gohord

i tried the foreach loop container - but it still returns the exact same error when it does not exist? it works when the file is there

Author Comment

ID: 36489244
LVL 14

Expert Comment

by:Christopher Gordon
ID: 36489263
hi malraff

Sorry never had that issue before.

Do you have all of your code inside the foreach loop container?

Are there any other files in the target folder?  If so, is the configuration information within the task specific enough to the files you're looking to process?

LVL 14

Assisted Solution

by:Christopher Gordon
Christopher Gordon earned 500 total points
ID: 36489270
This probably isn't the issue, but might be a good idea to set "DelayValidation" property of your Data Flow task to "True".  (Since the file isn't always going to be there)

Author Comment

ID: 36489646
brilliant gohord! i changed delay validation to true and viola - no errors!

this isnt sitting in a loop if the files are not there?

LVL 14

Expert Comment

by:Christopher Gordon
ID: 36489733
You won't have loop issues if there are no files in the specified folder in the foreach file task.  In fact, the foreach file loop won't allow the code to "kick off" if there are no files that match the criteria specified.

Glad I could help!

Featured Post

Free Tool: Path Explorer

An intuitive utility to help find the CSS path to UI elements on a webpage. These paths are used frequently in a variety of front-end development and QA automation tasks.

One of a set of tools we're offering as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

For both online and offline retail, the cross-channel business is the most recent pattern in the B2C trade space.
This article shows gives you an overview on SQL Server 2016 row level security. You will also get to know the usages of row-level-security and how it works
Via a live example, show how to extract information from SQL Server on Database, Connection and Server properties
Via a live example, show how to setup several different housekeeping processes for a SQL Server.

734 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question