We help IT Professionals succeed at work.
Get Started

A buffer failed while allocating 10485104 bytes; The system reports 98 percent memory load

arthrex
arthrex asked
on
5,176 Views
Last Modified: 2013-11-10
Dear Experts,

I'm running a SSIS package with 2 dataflow task.
One task is failing from time to time with error message:
Description: A buffer failed while allocating 10485104 bytes.  
End Error  Error: 2010-03-06 03:47:55.76     Code: 0xC0047011    
 Source: Aggregate EH, SKO, BE 2006 DTS.Pipeline    
 Description: The system reports 98 percent memory load.
 There are 4294660096 bytes of physical memory with 78651392 bytes free.
 There are 2147352576 bytes of virtual memory with 101441536 bytes free.
 The paging file has 6268792832 bytes with 2157301760 bytes free.  
 End Error  Error: 2010-03-06 03:47:55.76     Code: 0xC0047022    
 Source: Aggregate EH, SKO, BE 2006 DTS.Pipeline    
 Description: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  
 The ProcessInput method on component "Union All" (510) failed with
 error code 0x8007000E. Th...  The package execution fa...  The step failed.

The task is aggreagting a hudge amount of data then it unions it with two very small tables (component "Union All").
Thats all.
I read a lot about Defaultbuffersize and Defualtbuffermaxrows but at the end I didn't know how
to solve my error with changing these settings.
I increased the Defaultbuffersize to 20970208 but the error show up again.
Is deceasing the solution?


It is a 32bit windows 2003 server  with 4GB RAM. Sql Server 2005

I've also logged "BufferSizeTuning":
BufferSizeTuning,COGNOSKFD,ARTHREX\user,Aggregate EH, SKO, BE 2006,{FE01230D-545D-488A-A08F-2E01FC6BC83A},{8480C0BD-5F15-48FF-A762-0027DFC0F3C7},3/9/2010 3:46:42 AM,3/9/2010 3:46:42 AM,0,0x,Rows in buffer type 0 would cause a buffer size greater than the configured maximum. There will be only 3343 rows in buffers of this type.
BufferSizeTuning,COGNOSKFD,ARTHREX\user,Aggregate EH, SKO, BE 2006,{FE01230D-545D-488A-A08F-2E01FC6BC83A},{8480C0BD-5F15-48FF-A762-0027DFC0F3C7},3/9/2010 3:46:42 AM,3/9/2010 3:46:42 AM,0,0x,Rows in buffer type 4 would cause a buffer size greater than the configured maximum. There will be only 3995 rows in buffers of this type.
BufferSizeTuning,COGNOSKFD,ARTHREX\user,Aggregate EH, SKO, BE 2006,{FE01230D-545D-488A-A08F-2E01FC6BC83A},{8480C0BD-5F15-48FF-A762-0027DFC0F3C7},3/9/2010 3:46:42 AM,3/9/2010 3:46:42 AM,0,0x,Rows in buffer type 10 would cause a buffer size greater than the configured maximum. There will be only 9165 rows in buffers of this type.
BufferSizeTuning,COGNOSKFD,ARTHREX\user,Aggregate EH, SKO, BE 2006,{FE01230D-545D-488A-A08F-2E01FC6BC83A},{8480C0BD-5F15-48FF-A762-0027DFC0F3C7},3/9/2010 3:46:42 AM,3/9/2010 3:46:42 AM,0,0x,Rows in buffer type 18 would cause a buffer size greater than the configured maximum. There will be only 7181 rows in buffers of this type.
PackageStart,COGNOSKFD,ARTHREX\user,KfdData2Staging_SalesFactsAggr,{38531CB0-1F49-4A6C-AE49-C2DB37F5C630},{8480C0BD-5F15-48FF-A762-0027DFC0F3C7},3/9/2010 3:46:42 AM,3/9/2010 3:46:42 AM,0,0x,Beginning of package execution.

BufferSizeTuning,COGNOSKFD,ARTHREX\user,Aggregate EH, SKO, BE 2006,{FE01230D-545D-488A-A08F-2E01FC6BC83A},{8480C0BD-5F15-48FF-A762-0027DFC0F3C7},3/9/2010 3:46:43 AM,3/9/2010 3:46:43 AM,0,0x,Rows in buffer type 0 would cause a buffer size greater than the configured maximum. There will be only 3343 rows in buffers of this type.
BufferSizeTuning,COGNOSKFD,ARTHREX\user,Aggregate EH, SKO, BE 2006,{FE01230D-545D-488A-A08F-2E01FC6BC83A},{8480C0BD-5F15-48FF-A762-0027DFC0F3C7},3/9/2010 3:46:43 AM,3/9/2010 3:46:43 AM,0,0x,Rows in buffer type 4 would cause a buffer size greater than the configured maximum. There will be only 3995 rows in buffers of this type.
BufferSizeTuning,COGNOSKFD,ARTHREX\user,Aggregate EH, SKO, BE 2006,{FE01230D-545D-488A-A08F-2E01FC6BC83A},{8480C0BD-5F15-48FF-A762-0027DFC0F3C7},3/9/2010 3:46:43 AM,3/9/2010 3:46:43 AM,0,0x,Rows in buffer type 10 would cause a buffer size greater than the configured maximum. There will be only 9165 rows in buffers of this type.
BufferSizeTuning,COGNOSKFD,ARTHREX\user,Aggregate EH, SKO, BE 2006,{FE01230D-545D-488A-A08F-2E01FC6BC83A},{8480C0BD-5F15-48FF-A762-0027DFC0F3C7},3/9/2010 3:46:43 AM,3/9/2010 3:46:43 AM,0,0x,Rows in buffer type 18 would cause a buffer size greater than the configured maximum. There will be only 7181 rows in buffers of this type.
BufferSizeTuning,COGNOSKFD,ARTHREX\user,Aggregate EH, SKO, BE 2006,{FE01230D-545D-488A-A08F-2E01FC6BC83A},{8480C0BD-5F15-48FF-A762-0027DFC0F3C7},3/9/2010 3:46:43 AM,3/9/2010 3:46:43 AM,0,0x,Rows in buffer type 0 would cause a buffer size greater than the configured maximum. There will be only 3343 rows in buffers of this type.
BufferSizeTuning,COGNOSKFD,ARTHREX\user,Aggregate EH, SKO, BE 2006,{FE01230D-545D-488A-A08F-2E01FC6BC83A},{8480C0BD-5F15-48FF-A762-0027DFC0F3C7},3/9/2010 3:46:43 AM,3/9/2010 3:46:43 AM,0,0x,Rows in buffer type 4 would cause a buffer size greater than the configured maximum. There will be only 3995 rows in buffers of this type.
BufferSizeTuning,COGNOSKFD,ARTHREX\user,Aggregate EH, SKO, BE 2006,{FE01230D-545D-488A-A08F-2E01FC6BC83A},{8480C0BD-5F15-48FF-A762-0027DFC0F3C7},3/9/2010 3:46:43 AM,3/9/2010 3:46:43 AM,0,0x,Rows in buffer type 10 would cause a buffer size greater than the configured maximum. There will be only 9165 rows in buffers of this type.
BufferSizeTuning,COGNOSKFD,ARTHREX\user,Aggregate EH, SKO, BE 2006,{FE01230D-545D-488A-A08F-2E01FC6BC83A},{8480C0BD-5F15-48FF-A762-0027DFC0F3C7},3/9/2010 3:46:43 AM,3/9/2010 3:46:43 AM,0,0x,Rows in buffer type 18 would cause a buffer size greater than the configured maximum. There will be only 7181 rows in buffers of this type.

Thanks for your help!!
Comment
Watch Question
SQL Server DBA & Architect, EE Solution Guide
CERTIFIED EXPERT
Awarded 2009
Distinguished Expert 2019
Commented:
This problem has been solved!
Unlock 1 Answer and 10 Comments.
See Answer
Why Experts Exchange?

Experts Exchange always has the answer, or at the least points me in the correct direction! It is like having another employee that is extremely experienced.

Jim Murphy
Programmer at Smart IT Solutions

When asked, what has been your best career decision?

Deciding to stick with EE.

Mohamed Asif
Technical Department Head

Being involved with EE helped me to grow personally and professionally.

Carl Webster
CTP, Sr Infrastructure Consultant
Ask ANY Question

Connect with Certified Experts to gain insight and support on specific technology challenges including:

  • Troubleshooting
  • Research
  • Professional Opinions
Did You Know?

We've partnered with two important charities to provide clean water and computer science education to those who need it most. READ MORE