Solved

C# How to download large files?

Posted on 2009-05-06
8
4,244 Views
Last Modified: 2013-12-17
I wrote file downloader but it doesn't work with bigger files like 100mb...
have problem in this line:
iByteSize = streamRemote.Read(byteBuffer, 0, byteBuffer.Length)
error:
Unable to read data from the transport connection.. no space for buffer etc

when i trying to make this buffer smaller
byte[] byteBuffer = new byte[655336];
it doesn't works too ;/
what I should change in my code to download bigger files?
have you know any good examples to download large files using httpwebresponse?
thx

best regards
// the URL to download the file from
            string sUrlToReadFileFrom = _dl;    
            // the path to write the file to
            Uri _uri = new Uri(_dl);
            string sFilePathToWriteFileTo = _path+Path.GetFileName(_uri.AbsolutePath);
 
            // first, we need to get the exact size (in bytes) of the file we are downloading    
            Uri url = new Uri(sUrlToReadFileFrom);    
            System.Net.HttpWebRequest request = (System.Net.HttpWebRequest)System.Net.WebRequest.Create(url);    
            System.Net.HttpWebResponse response = (System.Net.HttpWebResponse)request.GetResponse();    
            response.Close();    
            // gets the size of the file in bytes    
            Int64 iSize = response.ContentLength;
 
            // keeps track of the total bytes downloaded so we can update the progress bar    
            Int64 iRunningByteTotal = 0;
 
            // use the webclient object to download the file    
            using (System.Net.WebClient client = new System.Net.WebClient())
            {
                // open the file at the remote URL for reading        
                using (System.IO.Stream streamRemote = client.OpenRead(new Uri(sUrlToReadFileFrom)))
                {
                    // using the FileStream object, we can write the downloaded bytes to the file system            
                    using (Stream streamLocal = new FileStream(sFilePathToWriteFileTo, FileMode.Create, FileAccess.Write, FileShare.None))
                    {
                        // loop the stream and get the file into the byte buffer                
                        int iByteSize = 0;                
                        byte[] byteBuffer = new byte[iSize];
                        while ((iByteSize = streamRemote.Read(byteBuffer, 0, byteBuffer.Length)) > 0)
                        {
                            // write the bytes to the file system at the file path specified                    
                            streamLocal.Write(byteBuffer, 0, iByteSize);                    
                            iRunningByteTotal += iByteSize;                     
                            // calculate the progress out of a base "100"                    
                            double dIndex = (double)(iRunningByteTotal);                    
                            double dTotal = (double)byteBuffer.Length;                    
                            double dProgressPercentage = (dIndex / dTotal);                    
                            int iProgressPercentage = (int)(dProgressPercentage * 100);                     
                            
                            // update the progress bar                    
                            backgroundWorker1.ReportProgress(iProgressPercentage);
                        }
                        // clean up the file stream                
                        streamLocal.Close();
                    }
                    // close the connection to the remote server            
                    streamRemote.Close();
                }
            }

Open in new window

0
Comment
Question by:F0x88
  • 4
  • 3
8 Comments
 
LVL 13

Expert Comment

by:copyPasteGhost
ID: 24314367
0
 
LVL 2

Author Comment

by:F0x88
ID: 24314553
no it doesn't help me
0
 
LVL 13

Expert Comment

by:copyPasteGhost
ID: 24314613
0
Master Your Team's Linux and Cloud Stack!

The average business loses $13.5M per year to ineffective training (per 1,000 employees). Keep ahead of the competition and combine in-person quality with online cost and flexibility by training with Linux Academy.

 
LVL 2

Author Comment

by:F0x88
ID: 24314876
still it's not it problem is with buffer is so big but with my own set buffersize it breaks
0
 
LVL 16

Expert Comment

by:CuteBug
ID: 24315472
0
 
LVL 2

Author Comment

by:F0x88
ID: 24316676
i know this one is so big project i need simple solution my code needs few small changes to make buffer for example 1024 and download all file, it can't be that hard
0
 
LVL 13

Accepted Solution

by:
copyPasteGhost earned 500 total points
ID: 24316703
0
 
LVL 2

Author Comment

by:F0x88
ID: 24317060
I found why my app broke with custom buffer, I changed not this parametr what i should
thx for help
0

Featured Post

Master Your Team's Linux and Cloud Stack!

The average business loses $13.5M per year to ineffective training (per 1,000 employees). Keep ahead of the competition and combine in-person quality with online cost and flexibility by training with Linux Academy.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
VB.NET 2008 - SQL Timeout 9 34
MailAddress in vb 4 29
C# class library debugging - Breakpoint will not hit. 8 17
need to convert function to c# 5 29
Many of us here at EE write code. Many of us write exceptional code; just as many of us write exception-prone code. As we all should know, exceptions are a mechanism for handling errors which are typically out of our control. From database errors, t…
Exception Handling is in the core of any application that is able to dignify its name. In this article, I'll guide you through the process of writing a DRY (Don't Repeat Yourself) Exception Handling mechanism, using Aspect Oriented Programming.
Microsoft Active Directory, the widely used IT infrastructure, is known for its high risk of credential theft. The best way to test your Active Directory’s vulnerabilities to pass-the-ticket, pass-the-hash, privilege escalation, and malware attacks …
Two types of users will appreciate AOMEI Backupper Pro: 1 - Those with PCIe drives (and haven't found cloning software that works on them). 2 - Those who want a fast clone of their boot drive (no re-boots needed) and it can clone your drive wh…

856 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question