Still celebrating National IT Professionals Day with 3 months of free Premium Membership. Use Code ITDAY17

x
?
Solved

Informtica session load taking much time

Posted on 2009-05-03
5
Medium Priority
?
632 Views
Last Modified: 2012-05-06
Hi All,
I have a mapping which performs sqloveride in sourcequalifier and then route to expression transformation and from there route to 5 filter transformation to target table T1. The related session is taking 18 mins to load. I want to reduce overall load time.. I saw that sqloveride just take a second to execute and start loading to table so there is no source bottleneck. I have replaced 5 filter to single router transformation in mapping but  no performance enhance .I think the bottleneck is at target table. I am performing update else insert in mapping. The target table t1 has 5 primary keys and each key has a unique index on it.The index is on following cols- acctg_date,prod_code,balbook_code,acct_code,center
_code. Can anyone please advise me on how can I tune target table to reduce the load time.
The target table t1 contain about 4.7 million records.Thanks
0
Comment
Question by:sunilbains
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
5 Comments
 
LVL 30

Expert Comment

by:nmcdermaid
ID: 24301166
Can you capture some of the SQL that informatica is generating? If not you can always use SQL Profiler to capture it.
You really have two options:
1. Possibly improve indexes to improve update performance (though this will reduce insert performance)
2. Use an exclusive lock on the destination table
I don't know if you can do option 2 from informatica. I assume you can.
0
 

Accepted Solution

by:
shekharaj earned 1500 total points
ID: 24346975
You can split the stream of mapping as update and insert. Update stream would check for existence of record in both source and target (based on primary key combination) to update the target table via PK. Tghe insert stream would check for non-existence of record in target and do a insert. This might improve performance reducing overahead on Informatica but increases load on database.
0
 

Author Closing Comment

by:sunilbains
ID: 31577321
Thanks
0

Featured Post

Enterprise Mobility and BYOD For Dummies

Like “For Dummies” books, you can read this in whatever order you choose and learn about mobility and BYOD; and how to put a competitive mobile infrastructure in place. Developed for SMBs and large enterprises alike, you will find helpful use cases, planning, and implementation.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Your data is at risk. Probably more today that at any other time in history. There are simply more people with more access to the Web with bad intentions.
In this article, we’ll look at how to deploy ProxySQL.
Using examples as well as descriptions, and references to Books Online, show the different Recovery Models available in SQL Server and explain, as well as show how full, differential and transaction log backups are performed
Via a live example, show how to setup several different housekeeping processes for a SQL Server.

670 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question