Solved

Increase the performance of my SSIS package

Posted on 2010-09-20
4
389 Views
Last Modified: 2013-11-10
Hi experts,
   I am retrieving data from Oracle and importing to sql server. There are 1 million records in the source.
After getting from the source, I need to LookUp in the existing table whether the PK ID exists or not. For this, I am using LookUp transform in full cache mode. But it is slow.

What is the best way to increase the performance instead of Lookup?
0
Comment
Question by:rajvja
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
4 Comments
 
LVL 3

Accepted Solution

by:
novaspoonman earned 250 total points
ID: 33717619
Are you limiting the lookup query to only the columns you need?
Is there a clustered index on the PK?
Have you inspected the actual execution plan for your lookup query?

http://www.ssistalk.com/2009/09/04/ssis-lookup-cache-modes-full-partial-none/
0
 
LVL 30

Assisted Solution

by:Reza Rad
Reza Rad earned 250 total points
ID: 33722195
Lookup is good,
just  you should be careful about choosing appropriate cache mode,
this is great article from SSIS team blog about lookup cache modes:

http://blogs.msdn.com/b/mattm/archive/2008/10/18/lookup-cache-modes.aspx

0
 
LVL 11

Author Comment

by:rajvja
ID: 33724399
t
0
 
LVL 11

Author Comment

by:rajvja
ID: 33724414
Hi

Sorry mates. I clicked Accept Multiple solutions and submit, its sending Close request. Why I am not sure.
0

Featured Post

Microsoft Certification Exam 74-409

Veeam® is happy to provide the Microsoft community with a study guide prepared by MVP and MCT, Orin Thomas. This guide will take you through each of the exam objectives, helping you to prepare for and pass the examination.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

JSON is being used more and more, besides XML, and you surely wanted to parse the data out into SQL instead of doing it in some Javascript. The below function in SQL Server can do the job for you, returning a quick table with the parsed data.
Ever wondered why sometimes your SQL Server is slow or unresponsive with connections spiking up but by the time you go in, all is well? The following article will show you how to install and configure a SQL job that will send you email alerts includ…
Using examples as well as descriptions, and references to Books Online, show the documentation available for date manipulation functions and by using a select few of these functions, show how date based data can be manipulated with these functions.
Via a live example, show how to extract insert data into a SQL Server database table using the Import/Export option and Bulk Insert.

752 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question