Solved

Informtica session load taking much time

Posted on 2009-05-03
5
610 Views
Last Modified: 2012-05-06
Hi All,
I have a mapping which performs sqloveride in sourcequalifier and then route to expression transformation and from there route to 5 filter transformation to target table T1. The related session is taking 18 mins to load. I want to reduce overall load time.. I saw that sqloveride just take a second to execute and start loading to table so there is no source bottleneck. I have replaced 5 filter to single router transformation in mapping but  no performance enhance .I think the bottleneck is at target table. I am performing update else insert in mapping. The target table t1 has 5 primary keys and each key has a unique index on it.The index is on following cols- acctg_date,prod_code,balbook_code,acct_code,center
_code. Can anyone please advise me on how can I tune target table to reduce the load time.
The target table t1 contain about 4.7 million records.Thanks
0
Comment
Question by:sunilbains
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
5 Comments
 
LVL 30

Expert Comment

by:nmcdermaid
ID: 24301166
Can you capture some of the SQL that informatica is generating? If not you can always use SQL Profiler to capture it.
You really have two options:
1. Possibly improve indexes to improve update performance (though this will reduce insert performance)
2. Use an exclusive lock on the destination table
I don't know if you can do option 2 from informatica. I assume you can.
0
 

Accepted Solution

by:
shekharaj earned 500 total points
ID: 24346975
You can split the stream of mapping as update and insert. Update stream would check for existence of record in both source and target (based on primary key combination) to update the target table via PK. Tghe insert stream would check for non-existence of record in target and do a insert. This might improve performance reducing overahead on Informatica but increases load on database.
0
 

Author Closing Comment

by:sunilbains
ID: 31577321
Thanks
0

Featured Post

Technology Partners: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
SQL Server Trigger 8 37
SCOM to SQL port 14xx failed? 1 31
SQL Add Parameter in Variable 4 21
How can I delete dublicated rows by using for loop in SQL? 2 17
This article explains how to reset the password of the sa account on a Microsoft SQL Server.  The steps in this article work in SQL 2005, 2008, 2008 R2, 2012, 2014 and 2016.
When table data gets too large to manage or queries take too long to execute the solution is often to buy bigger hardware or assign more CPUs and memory resources to the machine to solve the problem. However, the best, cheapest and most effective so…
Video by: Steve
Using examples as well as descriptions, step through each of the common simple join types, explaining differences in syntax, differences in expected outputs and showing how the queries run along with the actual outputs based upon a simple set of dem…
Via a live example, show how to backup a database, simulate a failure backup the tail of the database transaction log and perform the restore.

749 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question