Solved

BULK INSERT GETTING SLOW FROM SSIS 2008

Posted on 2010-11-20
4
1,413 Views
Last Modified: 2013-11-10
We have a package where it copies about 100 million records each day from the OLTP to the OLAP enviornment.We are using OLDEDB Destination with fast load to do this.It works ok till 40 million and after that it slows down drastically and almost stalled at somepoint.
Is there anything that Im missing.
?
Currently I have row commit size to infinite and row per batch size to 1 million.
Thanks
0
Comment
Question by:venk_r
4 Comments
 
LVL 23

Accepted Solution

by:
Racim BOUDJAKDJI earned 500 total points
Comment Utility
<<Currently I have row commit size to infinite and row per batch size to 1 million.>>
Reduce both to 10000.  Also, please post the INSERT and SELECT queries so that we can help further.  Finally make sure your tempdb is well sized and that you do not have too frequent extent.  hope this helps...
0
 
LVL 30

Expert Comment

by:Reza Rad
Comment Utility
I strongly recommend to read this article carefully, and raise up performance of your data flow with it:
http://www.simple-talk.com/sql/ssis/sql-server-2005-ssis-tuning-the-dataflow-task/
0
 
LVL 12

Expert Comment

by:ill
Comment Utility
How long and when is the insert running? Common problem could be:
1. Any other processes running on source/destination box at the same time? Backup perhaps?
2. Doeas destination DB have enough free space? Could be that after first 40 mil. rows, DB space increasing causes additional IO.
3. Network load is fine?
0
 
LVL 8

Author Closing Comment

by:venk_r
Comment Utility
thanks
0

Featured Post

Complete Microsoft Windows PC® & Mac Backup

Backup and recovery solutions to protect all your PCs & Mac– on-premises or in remote locations. Acronis backs up entire PC or Mac with patented reliable disk imaging technology and you will be able to restore workstations to a new, dissimilar hardware in minutes.

Join & Write a Comment

In this article—a derivative of my DaytaBase.org blog post (http://daytabase.org/2011/06/18/what-week-is-it/)—I will explore a few different perspectives on which week today's date falls within using Microsoft SQL Server. First, to frame this stu…
For both online and offline retail, the cross-channel business is the most recent pattern in the B2C trade space.
Viewers will learn how to use the SELECT statement in SQL and will be exposed to the many uses the SELECT statement has.
Viewers will learn how to use the UPDATE and DELETE statements to change or remove existing data from their tables. Make a table: Update a specific column given a specific row using the UPDATE statement: Remove a set of values using the DELETE s…

763 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

11 Experts available now in Live!

Get 1:1 Help Now