Can the SSIS look up function be used for complex join or lookup?

Posted on 2012-08-19
Last Modified: 2012-09-04

I have used tsql join in my ETL transformation, due to complexity and easy maintainence of my ETL script. I understand that SSIS look up function is good in terms of lookup for surrogate key from dimension table.

However, I got complex business rule where I had to translate my lookup table with customize view such as use of select statement to filter the row I need.

What is the best approach in terms lookup tsql or SSIS?

Thanks in advance
Question by:keplan
    1 Comment
    LVL 21

    Accepted Solution

    From my experience, just use the SSIS lookup, when you really need to, otherwise relay on the SQL engine to do the join and lookup for you.

    Anyway The lookup in SSIS has 3 modes,

    1-no cache  -- slower not case sensitive
    2-Partial cache - case sensitive, will cache your values as it match.
    3-Full cache   - case sensitive  - Faster - will cache your lookup table upfront.

    You might also restrict the cache size if you'll use partial or full modes.. read this article about lookups...

    Write Comment

    Please enter a first name

    Please enter a last name

    We will never share this with anyone.

    Featured Post

    Do You Know the 4 Main Threat Actor Types?

    Do you know the main threat actor types? Most attackers fall into one of four categories, each with their own favored tactics, techniques, and procedures.

    Hi All, I am here to write a simple article to move SSRS (SQL Server Reporting Services) reports from one server to another. When I have faced the same issue to move reports those were developed by developer on development server and now need to …
    How to leverage one TLS certificate to encrypt Microsoft SQL traffic and Remote Desktop Services, versus creating multiple tickets for the same server.
    Illustrator's Shape Builder tool will let you combine shapes visually and interactively. This video shows the Mac version, but the tool works the same way in Windows. To follow along with this video, you can draw your own shapes or download the file…
    Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.

    779 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    12 Experts available now in Live!

    Get 1:1 Help Now