motioneye
asked on
Import new data from new database job should run daily few times
Hi,
I'm in the midst of creating ssism as per screeshot I have created the siurce and destination but how to have the T-sql command where I can write T-sql to copy only certain data / data which not exist in destination db for inserting ?
ssis.jpg
I'm in the midst of creating ssism as per screeshot I have created the siurce and destination but how to have the T-sql command where I can write T-sql to copy only certain data / data which not exist in destination db for inserting ?
ssis.jpg
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
Hi,
I'm trying with T-sql command windows, but then I lost the table mapping :(
I'm trying with T-sql command windows, but then I lost the table mapping :(
ASKER
I can't click oK as it ask for the mapping in lookup component too
Untitled.jpg
Untitled.jpg
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
Hi,
Ok successful, but again how do I save this packages in sql server and run it daily with sql jobs schedule
Ok successful, but again how do I save this packages in sql server and run it daily with sql jobs schedule
ASKER
Oh,
It encountered me some error while doing debugging, how can we avoid this such errors?
Information: 0x400490F5 at Data Flow Task, Lookup [542]: component "Lookup" (542) has cached a total of 614783 rows.
Warning: 0x802090E4 at Data Flow Task, Lookup [542]: The Lookup transformation encountered duplicate reference key values when caching reference data. The Lookup transformation found duplicate key values when caching metadata in PreExecute. This error occurs in Full Cache mode only. Either remove the duplicate key values, or change the cache mode to PARTIAL or NO_CACHE.
It encountered me some error while doing debugging, how can we avoid this such errors?
Information: 0x400490F5 at Data Flow Task, Lookup [542]: component "Lookup" (542) has cached a total of 614783 rows.
Warning: 0x802090E4 at Data Flow Task, Lookup [542]: The Lookup transformation encountered duplicate reference key values when caching reference data. The Lookup transformation found duplicate key values when caching metadata in PreExecute. This error occurs in Full Cache mode only. Either remove the duplicate key values, or change the cache mode to PARTIAL or NO_CACHE.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
Hi Riteshah,
I want regardless of duplicate or not data must be inserted into destination table, can this be done ?
I want regardless of duplicate or not data must be inserted into destination table, can this be done ?
do you want to transfer all data everytime? have you tried the example I saw in my blog? I have not used CACHE.
ASKER
No haven't tried as yet..
actually my data could have duplicate since I'm using datetime with getting values from getdate(), that is why our table have no PK or unique indexes, actually when we not used cache will the ssis transfer all data although its duplicate ?
actually my data could have duplicate since I'm using datetime with getting values from getdate(), that is why our table have no PK or unique indexes, actually when we not used cache will the ssis transfer all data although its duplicate ?
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
I look at lookup transformation editor, I couldn't found general page? oh btw I'm using ssis 2008
try.jpg
try.jpg
ASKER
half way solved my issues
ee.JPG