Link to home
Start Free TrialLog in
Avatar of thomaszhwang
thomaszhwangFlag for United States of America

asked on

How to solve an out-of-memory error in SSIS?

I need to create a snapshot table based on aggregation of about 1 million rows every day.  I think I have developed my package correctly, but it looks like it has an out-of-memory error (0x4004800D).

Is there any way to alleviate the problem without adding more physical memory, i.e. optimizing the ETL package?  Thanks.
ASKER CERTIFIED SOLUTION
Avatar of Anuj
Anuj
Flag of India image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of thomaszhwang

ASKER

The thing is the aggregation is based on that 1 million rows.  They all need to be loaded to the ram before they can be aggregated, right?
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
I don't think so.
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
OK, but how would creating index help to solve the ram issue in my case?
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
OK, that makes sense, but my current issue is I'm trying to do an aggregation based on ALL rows (about a million) in a table.  That's to say the server needs to hold that million rows in the RAM before they can be aggregated.  The problem now is the RAM doesn't have enough space to hold every row.
Thanks.