Solved

Increase the performance of my SSIS package

Posted on 2010-09-20
4
391 Views
Last Modified: 2013-11-10
Hi experts,
   I am retrieving data from Oracle and importing to sql server. There are 1 million records in the source.
After getting from the source, I need to LookUp in the existing table whether the PK ID exists or not. For this, I am using LookUp transform in full cache mode. But it is slow.

What is the best way to increase the performance instead of Lookup?
0
Comment
Question by:rajvja
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
4 Comments
 
LVL 3

Accepted Solution

by:
novaspoonman earned 250 total points
ID: 33717619
Are you limiting the lookup query to only the columns you need?
Is there a clustered index on the PK?
Have you inspected the actual execution plan for your lookup query?

http://www.ssistalk.com/2009/09/04/ssis-lookup-cache-modes-full-partial-none/
0
 
LVL 30

Assisted Solution

by:Reza Rad
Reza Rad earned 250 total points
ID: 33722195
Lookup is good,
just  you should be careful about choosing appropriate cache mode,
this is great article from SSIS team blog about lookup cache modes:

http://blogs.msdn.com/b/mattm/archive/2008/10/18/lookup-cache-modes.aspx

0
 
LVL 11

Author Comment

by:rajvja
ID: 33724399
t
0
 
LVL 11

Author Comment

by:rajvja
ID: 33724414
Hi

Sorry mates. I clicked Accept Multiple solutions and submit, its sending Close request. Why I am not sure.
0

Featured Post

Revamp Your Training Process

Drastically shorten your training time with WalkMe's advanced online training solution that Guides your trainees to action.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Slowly Changing Dimension Transformation component in data task flow is very useful for us to manage and control how data changes in SSIS.
What if you have to shut down the entire Citrix infrastructure for hardware maintenance, software upgrades or "the unknown"? I developed this plan for "the unknown" and hope that it helps you as well. This article explains how to properly shut down …
This video shows how to set up a shell script to accept a positional parameter when called, pass that to a SQL script, accept the output from the statement back and then manipulate it in the Shell.
Viewers will learn how to use the SELECT statement in SQL and will be exposed to the many uses the SELECT statement has.

623 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question