Solved

Informtica session load taking much time

Posted on 2009-05-03
5
626 Views
Last Modified: 2012-05-06
Hi All,
I have a mapping which performs sqloveride in sourcequalifier and then route to expression transformation and from there route to 5 filter transformation to target table T1. The related session is taking 18 mins to load. I want to reduce overall load time.. I saw that sqloveride just take a second to execute and start loading to table so there is no source bottleneck. I have replaced 5 filter to single router transformation in mapping but  no performance enhance .I think the bottleneck is at target table. I am performing update else insert in mapping. The target table t1 has 5 primary keys and each key has a unique index on it.The index is on following cols- acctg_date,prod_code,balbook_code,acct_code,center
_code. Can anyone please advise me on how can I tune target table to reduce the load time.
The target table t1 contain about 4.7 million records.Thanks
0
Comment
Question by:sunilbains
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
5 Comments
 
LVL 30

Expert Comment

by:nmcdermaid
ID: 24301166
Can you capture some of the SQL that informatica is generating? If not you can always use SQL Profiler to capture it.
You really have two options:
1. Possibly improve indexes to improve update performance (though this will reduce insert performance)
2. Use an exclusive lock on the destination table
I don't know if you can do option 2 from informatica. I assume you can.
0
 

Accepted Solution

by:
shekharaj earned 500 total points
ID: 24346975
You can split the stream of mapping as update and insert. Update stream would check for existence of record in both source and target (based on primary key combination) to update the target table via PK. Tghe insert stream would check for non-existence of record in target and do a insert. This might improve performance reducing overahead on Informatica but increases load on database.
0
 

Author Closing Comment

by:sunilbains
ID: 31577321
Thanks
0

Featured Post

[Webinar] Learn How Hackers Steal Your Credentials

Do You Know How Hackers Steal Your Credentials? Join us and Skyport Systems to learn how hackers steal your credentials and why Active Directory must be secure to stop them. Thursday, July 13, 2017 10:00 A.M. PDT

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

When it comes to protecting Oracle Database servers and systems, there are a ton of myths out there. Here are the most common.
In part one, we reviewed the prerequisites required for installing SQL Server vNext. In this part we will explore how to install Microsoft's SQL Server on Ubuntu 16.04.
Via a live example, show how to extract information from SQL Server on Database, Connection and Server properties
Viewers will learn how the fundamental information of how to create a table.

630 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question