Solved

suspect execution in ssis packeg flow running before data collected completely

Posted on 2011-03-17
8
228 Views
Last Modified: 2012-05-11
In My ssis package:

1: Execute sql task has : select * into tableA from tableSource, usuallay it will copy around 5 millions of rows
2:delete_Invalid_Test_Data: delete from tableA for certain unwated records
3:Insert data to actual table:

My problem is that when sometimes this package run, it not completely copy all the rows, for eg: it should copy all data until 23:59:59.000 but for soem reasons it just copy until 23:04 or sometime 23:30 and so on..

why this can happen ? i
ssis-packages.jpg
0
Comment
Question by:motioneye
  • 4
  • 4
8 Comments
 
LVL 14

Accepted Solution

by:
Daniel_PL earned 500 total points
ID: 35154916
Check your delete task logic, it may delete also wanted records.
0
 

Author Comment

by:motioneye
ID: 35156020
That is what I'm thinking too, then again I ran the T-sql  manually and perform delete,  I can see the data available...
0
 
LVL 14

Assisted Solution

by:Daniel_PL
Daniel_PL earned 500 total points
ID: 35156444
You wrote that problem is happening only sometimes, maybe problems with SELECT INTO? You can use INSERT INTO SELECT copying to declared temp table.
Have you tried to use data flow task instead? You can easily get an example of it by creating sample package in data export wizard in SSMS, then by saving package to disk you are able to review contents in BIDS.
0
NAS Cloud Backup Strategies

This article explains backup scenarios when using network storage. We review the so-called “3-2-1 strategy” and summarize the methods you can use to send NAS data to the cloud

 

Author Comment

by:motioneye
ID: 35158593
hmm is any problenm when we using select into ? what the advantages of using insert into..select ? I try to avoid any lock in the database..
0
 
LVL 14

Assisted Solution

by:Daniel_PL
Daniel_PL earned 500 total points
ID: 35158791
I don't believe there are problems with SELECT INTO, I just wanted to show you other possibility.
0
 

Author Comment

by:motioneye
ID: 35162620
Hi,
I think there might something wrong with "execute sql task" since this is the 3rd days it stopped at 11:30 .... never get completed until 23:59:59...
0
 
LVL 14

Assisted Solution

by:Daniel_PL
Daniel_PL earned 500 total points
ID: 35163397
Does it contain only select * into tableA from tableSource code?
0
 

Author Closing Comment

by:motioneye
ID: 35186905
Thanks, I resolved it myself
0

Featured Post

Enterprise Mobility and BYOD For Dummies

Like “For Dummies” books, you can read this in whatever order you choose and learn about mobility and BYOD; and how to put a competitive mobile infrastructure in place. Developed for SMBs and large enterprises alike, you will find helpful use cases, planning, and implementation.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Everyone has problem when going to load data into Data warehouse (EDW). They all need to confirm that data quality is good but they don't no how to proceed. Microsoft has provided new task within SSIS 2008 called "Data Profiler Task". It solve th…
For both online and offline retail, the cross-channel business is the most recent pattern in the B2C trade space.
Via a live example, show how to extract insert data into a SQL Server database table using the Import/Export option and Bulk Insert.
This videos aims to give the viewer a basic demonstration of how a user can query current session information by using the SYS_CONTEXT function

825 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question