Solved

C# How to download large files?

Posted on 2009-05-06
8
4,185 Views
Last Modified: 2013-12-17
I wrote file downloader but it doesn't work with bigger files like 100mb...
have problem in this line:
iByteSize = streamRemote.Read(byteBuffer, 0, byteBuffer.Length)
error:
Unable to read data from the transport connection.. no space for buffer etc

when i trying to make this buffer smaller
byte[] byteBuffer = new byte[655336];
it doesn't works too ;/
what I should change in my code to download bigger files?
have you know any good examples to download large files using httpwebresponse?
thx

best regards
// the URL to download the file from
            string sUrlToReadFileFrom = _dl;    
            // the path to write the file to
            Uri _uri = new Uri(_dl);
            string sFilePathToWriteFileTo = _path+Path.GetFileName(_uri.AbsolutePath);
 
            // first, we need to get the exact size (in bytes) of the file we are downloading    
            Uri url = new Uri(sUrlToReadFileFrom);    
            System.Net.HttpWebRequest request = (System.Net.HttpWebRequest)System.Net.WebRequest.Create(url);    
            System.Net.HttpWebResponse response = (System.Net.HttpWebResponse)request.GetResponse();    
            response.Close();    
            // gets the size of the file in bytes    
            Int64 iSize = response.ContentLength;
 
            // keeps track of the total bytes downloaded so we can update the progress bar    
            Int64 iRunningByteTotal = 0;
 
            // use the webclient object to download the file    
            using (System.Net.WebClient client = new System.Net.WebClient())
            {
                // open the file at the remote URL for reading        
                using (System.IO.Stream streamRemote = client.OpenRead(new Uri(sUrlToReadFileFrom)))
                {
                    // using the FileStream object, we can write the downloaded bytes to the file system            
                    using (Stream streamLocal = new FileStream(sFilePathToWriteFileTo, FileMode.Create, FileAccess.Write, FileShare.None))
                    {
                        // loop the stream and get the file into the byte buffer                
                        int iByteSize = 0;                
                        byte[] byteBuffer = new byte[iSize];
                        while ((iByteSize = streamRemote.Read(byteBuffer, 0, byteBuffer.Length)) > 0)
                        {
                            // write the bytes to the file system at the file path specified                    
                            streamLocal.Write(byteBuffer, 0, iByteSize);                    
                            iRunningByteTotal += iByteSize;                     
                            // calculate the progress out of a base "100"                    
                            double dIndex = (double)(iRunningByteTotal);                    
                            double dTotal = (double)byteBuffer.Length;                    
                            double dProgressPercentage = (dIndex / dTotal);                    
                            int iProgressPercentage = (int)(dProgressPercentage * 100);                     
                            
                            // update the progress bar                    
                            backgroundWorker1.ReportProgress(iProgressPercentage);
                        }
                        // clean up the file stream                
                        streamLocal.Close();
                    }
                    // close the connection to the remote server            
                    streamRemote.Close();
                }
            }

Open in new window

0
Comment
Question by:F0x88
  • 4
  • 3
8 Comments
 
LVL 13

Expert Comment

by:copyPasteGhost
ID: 24314367
0
 
LVL 2

Author Comment

by:F0x88
ID: 24314553
no it doesn't help me
0
 
LVL 13

Expert Comment

by:copyPasteGhost
ID: 24314613
0
Master Your Team's Linux and Cloud Stack

Come see why top tech companies like Mailchimp and Media Temple use Linux Academy to build their employee training programs.

 
LVL 2

Author Comment

by:F0x88
ID: 24314876
still it's not it problem is with buffer is so big but with my own set buffersize it breaks
0
 
LVL 16

Expert Comment

by:CuteBug
ID: 24315472
0
 
LVL 2

Author Comment

by:F0x88
ID: 24316676
i know this one is so big project i need simple solution my code needs few small changes to make buffer for example 1024 and download all file, it can't be that hard
0
 
LVL 13

Accepted Solution

by:
copyPasteGhost earned 500 total points
ID: 24316703
0
 
LVL 2

Author Comment

by:F0x88
ID: 24317060
I found why my app broke with custom buffer, I changed not this parametr what i should
thx for help
0

Featured Post

Master Your Team's Linux and Cloud Stack

Come see why top tech companies like Mailchimp and Media Temple use Linux Academy to build their employee training programs.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
How to prevent website from publishing with errors 9 43
2 questions 10 25
Alert on Server memory 2 19
HTML - Color not displaying correctly in EMAIL. 6 31
Today I had a very interesting conundrum that had to get solved quickly. Needless to say, it wasn't resolved quickly because when we needed it we were very rushed, but as soon as the conference call was over and I took a step back I saw the correct …
Entity Framework is a powerful tool to help you interact with the DataBase but still doesn't help much when we have a Stored Procedure that returns more than one resultset. The solution takes some of out-of-the-box thinking; read on!
This Micro Tutorial demonstrates using Microsoft Excel pivot tables, how to reverse engineer competitors' marketing strategies through backlinks.
This is used to tweak the memory usage for your computer, it is used for servers more so than workstations but just be careful editing registry settings as it may cause irreversible results. I hold no responsibility for anything you do to the regist…

816 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now