Solved

Paralell SSIS Control Flows: What is the Optimal Parallel to Perform Well

Posted on 2008-10-03
3
494 Views
Last Modified: 2013-11-10
Hi,

We have two parallel control flows (doing the same thing) in a package. In purpose of further improving the performance, I am thinking about making more parallel flows for the package. Does it help with the performance (we have 8 AMD processors)? If so, how many parallel flows are the optimal number?

thanks for the help,
0
Comment
Question by:ebi168
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
3 Comments
 
LVL 22

Expert Comment

by:PedroCGD
ID: 22638657
It depends... in the number of the rows in the pipeline.. hardware...
but see this link and download the word document with the suggested best pratices for improve SSIS performance
http://www.microsoft.com/technet/prodtechnol/sql/2005/ssisperf.mspx
Helped?
Regards
0
 

Author Comment

by:ebi168
ID: 22638973
thanks for your comment. I did get more info from coworker that it helps. But now what I am wondering is what is the optimal number of parallelism, based on that we have 8 processors? Having too many parallel things will eventually lower the performance. thanks,
0
 
LVL 51

Accepted Solution

by:
Mark Wills earned 250 total points
ID: 22652546
Absolutely - too many will lower performance. The only way to work out "how many" is to look at the current capacity of the machine and the workload that an SSIS thread will consume. It is likely NOT to be a processor issue but a memory issue. Often the capacity of a dedicated SQL box sees relatively low CPU compared to Memory and (disk) I\O, though it is possible to have an underconfigured CPU  environment. That is most likely not your case. So, need to look at other configurations / performance criteria to calculate how many concurrent / parrallel processes are optimal given your environment.
0

Featured Post

Back Up Your Microsoft Windows Server®

Back up all your Microsoft Windows Server – on-premises, in remote locations, in private and hybrid clouds. Your entire Windows Server will be backed up in one easy step with patented, block-level disk imaging. We achieve RTOs (recovery time objectives) as low as 15 seconds.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In this article I will describe the Copy Database Wizard method as one possible migration process and I will add the extra tasks needed for an upgrade when and where is applied so it will cover all.
Slowly Changing Dimension Transformation component in data task flow is very useful for us to manage and control how data changes in SSIS.
Using examples as well as descriptions, and references to Books Online, show the documentation available for date manipulation functions and by using a select few of these functions, show how date based data can be manipulated with these functions.
Via a live example, show how to backup a database, simulate a failure backup the tail of the database transaction log and perform the restore.

749 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question