?
Solved

Bulk import from MDS using SSIS

Posted on 2016-11-02
4
Medium Priority
?
95 Views
Last Modified: 2016-11-07
Hi

Please assist on ImportType (https://msdn.microsoft.com/en-us/library/ee633854) on MDS I can use to insert data to the <mds. stg table> without duplicating existing data?I have used 0,1,2 and all of them are giving me the same results,each time I run the SSIS package it insert new records to the table even the records that are already in the table.
0
Comment
Question by:devguru001
  • 2
  • 2
4 Comments
 
LVL 3

Expert Comment

by:Shailesh Shinde
ID: 41871624
Hi,
Each entity in SQL Server 2012 Master Data Services (MDS) will have it’s own staging table (stg.<name>_Leaf). Using this staging table, you can create, update, deactivate and delete left members in bulk.
Have you gone through with this post...


Thanks,
Shail
0
 
LVL 16

Expert Comment

by:Megan Brooks
ID: 41871648
Are you saying that the data values for two different members (codes) are the same? Are you automatically generating codes? The import doesn't check for duplicate data for a given member.

The ImportType compares members using the Code attribute. You can specify that only new members (codes) are created (ImportType = 1), or have it also update existing members (identified by code) with new data, either treating NULL attribute data as 'don't change this attribute' (ImportType = 0) or as actual data (ImportType = 2).

(While I have worked extensively with MDS, it was 3+ years ago. Apologies in advance if I am not understanding the problem correctly.)
0
 
LVL 16

Accepted Solution

by:
Megan Brooks earned 2000 total points
ID: 41871655
You may need to load an SSIS lookup with data from an MDS subscription view, and then check new incoming data against that before sending it to the staging table (so as to exclude the duplicate rows). It sounds, though, like there is an issue with your coding scheme, or that you are using MDS to store something other than attribute data, for which codes might not be meaningful.

If you can provide a little more background on what you are trying to do then I might be able to suggest something more.
0

Featured Post

Free Tool: ZipGrep

ZipGrep is a utility that can list and search zip (.war, .ear, .jar, etc) archives for text patterns, without the need to extract the archive's contents.

One of a set of tools we're offering as a way to say thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

SQL Server  2012 Release with lots of Enhancements in Database Engine functions, SSIS, SSRS and some of new services like Data Quality Server and Master Data Service. Of particular interest, and the focus of this Article is SSIS. So, time to elab…
Slowly Changing Dimension Transformation component in data task flow is very useful for us to manage and control how data changes in SSIS.
Please read the paragraph below before following the instructions in the video — there are important caveats in the paragraph that I did not mention in the video. If your PaperPort 12 or PaperPort 14 is failing to start, or crashing, or hanging, …
With just a little bit of  SQL and VBA, many doors open to cool things like synchronize a list box to display data relevant to other information on a form.  If you have never written code or looked at an SQL statement before, no problem! ...  give i…
Suggested Courses

807 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question