Better/faster way to access the internet for scraping?

Posted on 2006-04-09
Last Modified: 2010-04-16
I am presently using WebRequest and WebResponse to access a particular web site, which is very slow compared to accessing by browser.  Is there a better/faster way to access a web page for scraping?
Question by:rmmarsh
    1 Comment
    LVL 44

    Accepted Solution

    Hello rmmarsh,

    if it is faster i do not know that also depends on how you parse the contents, but you could look at the webclient class in .NET

    that sample even gives a small hint about extracting parts with regular expressions in this case to extract all links on the page

    hope this helps a bit

    Featured Post

    IT, Stop Being Called Into Every Meeting

    Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

    Join & Write a Comment

    Suggested Solutions

    Title # Comments Views Activity
    Query datatable in LINQ 6 29
    Parse CSS value with RegEx 2 29
    report c# 9 58
    send mail from 8 12
    Introduction This article series is supposed to shed some light on the use of IDisposable and objects that inherit from it. In essence, a more apt title for this article would be: using (IDisposable) {}. I’m just not sure how many people would ge…
    Calculating holidays and working days is a function that is often needed yet it is not one found within the Framework. This article presents one approach to building a working-day calculator for use in .NET.
    This video is in connection to the article "The case of a missing mobile phone (". It will help one to understand clearly the steps to track a lost android phone.
    Sending a Secure fax is easy with eFax Corporate ( First, Just open a new email message.  In the To field, type your recipient's fax number You can even send a secure international fax — just include t…

    733 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    20 Experts available now in Live!

    Get 1:1 Help Now