Advertisement

03.25.2008 at 12:26AM PDT, ID: 23266264
[x]
Attachment Details
[x]
The Solution Rating System

With so many solutions, how can you tell which solutions are most likely to help you and which ones are not? To provide you with a tool to use, we rate our solutions based on various elements that most accurately determine if a solution is a quality solution. To explain what factors affect the solution rating, here are the elements we take into consideration when formulating our solution rating.

  • The Grade of the Solution
  • The Zone Rank of the Expert Providing the Solution
  • The Number of Author and Expert Comments
  • The Number of Experts Contributing
  • The Feedback of the Community

Your Input Matters
Because of the way the system is set up, the most important variable in this equation is you. As a member of Experts Exchange, you are able to cast your vote on the quality of the solutions in regard to how complete, accurate, helpful and easy to understand each solution is. When you provide your feedback, each rating is adjusted accordingly. So, if you see a solution that has a poor rating that you think is a good solution, let us know by rating it. As you do, the rating will be adjusted and will become more accurate for other members of our site.

If you have any suggestions that you would like to make for our rating system, please ask a question in the Suggestions Zone of Community Support.

Thank you!

8.5

MemoryStream - Out Of Memory

Asked by thetimp in Microsoft Visual C#.Net, .NET, SQL Server 2005

Tags: , ,

I am reading from PDF's from a SQL Server 2005 Database.

I have a method I modified from its original "Write to file" style to "Write to Stream" style, as i dont want the data to be written to the file system.

It extracts from the database fine, and for small PDF's (8k) creates the MemoryStream fine also.

But  my bigger PDf's (300 MB+) are bringing up the following error:

'System.OutOfMemoryException' was thrown.

   at System.IO.MemoryStream.set_Capacity(Int32 value)
   at System.IO.MemoryStream.EnsureCapacity(Int32 value)
   at System.IO.MemoryStream.SetLength(Int64 value)
   at <...>WriteBinaryToMemoryStream() in <blah blah blah> :line 552

Line 552 relates to the "stBinaryFileStream.Write" line in the attached code snippet.

I have 2GB of Ram in the server, and it doesnt get past 75%

What do I need to change to allow the 300MB + streams to be created?

regards

DancesWithData
Start Free Trial
1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
const int CHUNK_SIZE = 1024 * 8; //8K write buffer.
                    using (SqlDataReader reader = cmd.ExecuteReader(CommandBehavior.SequentialAccess))
                    {
                        reader.Read();
                        // Get the file size by passing null as the byte array parameter.
                        long fileSize = reader.GetBytes(0, 0, null, 0, 0);
                        stBinaryFileStream.SetLength(fileSize + CHUNK_SIZE);// Set the Memory Streams internal array size in bytes to the anticipated file size + 1 chunk for luck.
                        long bytesRead = 0;
                        byte[] buffer = new byte[CHUNK_SIZE];
                        int read = 0;
                        while (bytesRead < fileSize)
                        {
                            read = (int)reader.GetBytes(0, bytesRead, buffer, 0, buffer.Length);
                            stBinaryFileStream.Write(buffer, 0, read);
                            bytesRead += read;
                        }
                        lTotalBytesRead = bytesRead;
                        reader.Close();// explicitly close the reader.
                    }
[+][-]03.25.2008 at 09:18AM PDT, ID: 21203333

At Experts Exchange, members can ask their questions to thousands of technology professionals, also known as Experts. Experts compete and collaborate to answer those questions by leaving comments like this one.

Start your 7-day free trial to view this Expert Comment or ask the Experts your question.

 
[+][-]03.25.2008 at 09:41AM PDT, ID: 21203587

At Experts Exchange, members can ask their questions to thousands of technology professionals, also known as Experts. Experts compete and collaborate to answer those questions by leaving comments like this one.

Start your 7-day free trial to view this Expert Comment or ask the Experts your question.

 
[+][-]03.25.2008 at 10:17AM PDT, ID: 21203933

At Experts Exchange, members can ask their questions to thousands of technology professionals, also known as Experts. Experts compete and collaborate to answer those questions by leaving comments like this one.

Start your 7-day free trial to view this Expert Comment or ask the Experts your question.

 
[+][-]03.25.2008 at 12:18PM PDT, ID: 21205118

At Experts Exchange, members can ask their questions to thousands of technology professionals, also known as Experts. Experts compete and collaborate to answer those questions by leaving comments like this one.

Start your 7-day free trial to view this Expert Comment or ask the Experts your question.

 
[+][-]03.26.2008 at 07:37AM PDT, ID: 21212066

Often, when Experts are collaborating with members who have asked questions, they will request additional information about the problem. Askers respond with an author comment like this one.

Start your 7-day free trial to view this Author Comment or ask the Experts your question.

 
[+][-]03.26.2008 at 03:03PM PDT, ID: 21216839

At Experts Exchange, members can ask their questions to thousands of technology professionals, also known as Experts. Experts compete and collaborate to answer those questions by leaving comments like this one.

Start your 7-day free trial to view this Expert Comment or ask the Experts your question.

 
[+][-]03.26.2008 at 03:37PM PDT, ID: 21217161

View this solution now by starting your 7-day free trial. Setting up your free trial is quick, easy, and secure. We will return you to this solution, unlocked, when you're done.

 

About this solution

Zones: Microsoft Visual C#.Net, .NET, SQL Server 2005
Tags: c#, N/a, N/a
Sign Up Now!
Solution Provided By: gregoryyoung
Participating Experts: 3
Solution Grade: B
 
 
 
Loading Advertisement...
20080716-EE-VQP-32 / EE_QW_2_20070628