Link to home
Start Free TrialLog in
Avatar of motioneye
motioneyeFlag for Singapore

asked on

Import new data from new database job should run daily few times

Hi,
I'm in the midst of creating ssism as per screeshot I have created the siurce and destination but how to have the T-sql command where I can write T-sql to copy only certain data / data which not exist in destination db for inserting ?
ssis.jpg
ASKER CERTIFIED SOLUTION
Avatar of Raja Jegan R
Raja Jegan R
Flag of India image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
to write SQL command, look at the attached screen shot.

ee.JPG
Avatar of motioneye

ASKER

Hi,
I'm trying with T-sql command windows, but then I lost the table mapping :(
I can't click oK as it ask for the mapping in lookup component too
Untitled.jpg
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Hi,
Ok successful, but again how do I save this packages in sql server and run it daily with sql jobs schedule
Oh,
It encountered me some error while doing debugging, how can we avoid this such errors?

Information: 0x400490F5 at Data Flow Task, Lookup [542]: component "Lookup" (542) has cached a total of 614783 rows.
Warning: 0x802090E4 at Data Flow Task, Lookup [542]: The Lookup transformation encountered duplicate reference key values when caching reference data. The Lookup transformation found duplicate key values when caching metadata in PreExecute. This error occurs in Full Cache mode only. Either remove the duplicate key values, or change the cache mode to PARTIAL or NO_CACHE.
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Hi Riteshah,
I want regardless of duplicate or not data must be inserted into destination table, can this be done ?
do you want to transfer all data everytime? have you tried the example I saw in my blog? I have not used CACHE.
No haven't tried as yet..
actually my data could have duplicate since I'm using datetime with getting values from getdate(), that is why our table have no PK or unique indexes, actually when we not used cache will the ssis transfer all data although its duplicate ?
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
I look at lookup transformation editor, I couldn't found general page? oh btw I'm using ssis 2008
try.jpg
half way solved my issues