?
Solved

Store Data Flow Totals in variables

Posted on 2010-09-02
8
Medium Priority
?
301 Views
Last Modified: 2013-11-10
How can I store totals from my dataflow dataset into variables?

Currently, I collect my target dataset from SQL, manipulate it, apply conitional filtering, etc. Once the dataset is the way I want it in memory, I use Multicast to copy the dataset. On the copy, I use an Aggregate Tranform to get the count & a sum of a column. Now I need to load these 2 aggregate values in a variable.

If there is a better way to get these totals into variables other than splitting off the dataset using Multicast & an aggregate, let me know. One thing I can't do is handle all of this in the initial SQL script. The totals need to be based on the dataset in memory that was built in my Data Flow.
 
0
Comment
Question by:JeepGeekin
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 3
8 Comments
 

Author Comment

by:JeepGeekin
ID: 33588107
Also, I better mention that the dataset gets dumped in a text file at the end of this data flow. That's why I copied it to get my aggregrate totals.
0
 
LVL 16

Expert Comment

by:vdr1620
ID: 33588873
you can use record set destination but..its not advisable

if you can specify the exact filtering conditions and agrregation level with your sql...We can suggest you a way to handle everything using Sql code.
0
 

Author Comment

by:JeepGeekin
ID: 33588945
I think the main thing I am doing that I cannot do in a SQL script is to merge data with a flat file. Then we do some cleanup after that before aggregating it.
0
Use Case: Protecting a Hybrid Cloud Infrastructure

Microsoft Azure is rapidly becoming the norm in dynamic IT environments. This document describes the challenges that organizations face when protecting data in a hybrid cloud IT environment and presents a use case to demonstrate how Acronis Backup protects all data.

 

Author Comment

by:JeepGeekin
ID: 33589046
What about using a Script component? I haven't used one yet, but I see a place for variable interaction.
0
 
LVL 16

Expert Comment

by:vdr1620
ID: 33589177
Since you are actually trying to store the values of your dataset into variables ..so that they can be used in the next task in Control flow..Script Component wouldn't be of much help..

Where do you want to use these values stored in variable?
0
 

Author Comment

by:JeepGeekin
ID: 33589255
In a script task in the control flow. I need to make some decisions in this based on the totals.
0
 
LVL 16

Accepted Solution

by:
vdr1620 earned 2000 total points
ID: 33589459
why do you want o store the values in the variable..i would suggest you to derive those decisions using script component instead of storing the values in variables and using them later on in script task

I would like to know what you are exactly trying to do .. to help you better
0
 

Author Comment

by:JeepGeekin
ID: 33591419
I got that to work. Good suggestion. Thanks vdr1620.
0

Featured Post

Get MySQL database support online, now!

At Percona’s web store you can order your MySQL database support needs in minutes. No hassles, no fuss, just pick and click. Pay online with a credit card.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

For both online and offline retail, the cross-channel business is the most recent pattern in the B2C trade space.
I have a large data set and a SSIS package. How can I load this file in multi threading?
Familiarize people with the process of utilizing SQL Server functions from within Microsoft Access. Microsoft Access is a very powerful client/server development tool. One of the SQL Server objects that you can interact with from within Microsoft Ac…
Via a live example, show how to extract information from SQL Server on Database, Connection and Server properties
Suggested Courses

764 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question