Advertisement

04.11.2008 at 07:42AM PDT, ID: 23315247
[x]
Attachment Details

Virtual Memory Error while Exporting Large Amount of Data to Oracle using SSIS

Asked by 9413systems in MS SQL DTS, MS SQL Server, SQL Server 2005

Tags: Microsoft, SQL, 2005, SSIS

I am exporting about 14 Million records from SQL2005 to Oracle (8).  I am using the Microsfot OLE DB Oracle connection is SSIS.  The job has failed on me about 3 different times.  I get up to about 7-8 million and then start getting Virtual Memory errors and the job ends.  I've arleady modifed the Buffer (DefaultBufferMaxRow and DefualtBufferSize) Paramenters and the BufferTempStoragePath to a drive with over 50gb:, but still get the errors.  
Does anybody have any recommendations on running a big job like this.  I have about 2 gigs of physical ram and 2 gigs of virtual memory.  
Does anybody know of a way to import the records 1-7000000 and then 7000000-14000000?

[DTS.Pipeline] Information: The buffer manager detected that the system was low on virtual memory, but was unable to swap out any buffers. 16 buffers were considered and 16 were locked. Either not enough memory is available to the pipeline because not enough is installed, other processes are using it, or too many buffers are locked.


[Destination - TPA_FEE_SCHED [58]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x8007000E. An OLE DB record is available.  Source: "Microsoft Cursor Engine"  Hresult: 0x8007000E  Description: "Out of memory.".
Start Free Trial
 
Keywords: Virtual Memory Error while Exporting L…
 
Loading Advertisement...
 
[+][-]04.13.2008 at 05:01PM PDT, ID: 21346782

At Experts Exchange, members can ask their questions to thousands of technology professionals, also known as Experts. Experts compete and collaborate to answer those questions by leaving comments like this one.

Start your 7-day free trial to view this Expert Comment or ask the Experts your question.

 
[+][-]04.18.2008 at 09:28AM PDT, ID: 21387296

Often, when Experts are collaborating with members who have asked questions, they will request additional information about the problem. Askers respond with an author comment like this one.

Start your 7-day free trial to view this Author Comment or ask the Experts your question.

 
[+][-]04.19.2008 at 11:12PM PDT, ID: 21395165

View this solution now by starting your 7-day free trial. Setting up your free trial is quick, easy, and secure. We will return you to this solution, unlocked, when you're done.

 

About this solution

Zones: MS SQL DTS, MS SQL Server, SQL Server 2005
Tags: Microsoft, SQL, 2005, SSIS
Sign Up Now!
Solution Provided By: 9413systems
Participating Experts: 1
Solution Grade: A
 
 
 
Loading Advertisement...
20080716-EE-VQP-32 / EE_QW_2_20070628