Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people, just like you, are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
Solved

HTMLAgilitypack -> downloading full page (including JavaScript renders)

Posted on 2014-02-07
1
920 Views
Last Modified: 2014-02-08
Hi all,


Im using HTMLagilitypack to get a sites html but the issue is its not loading all the content.
I belive this is do to the fact that a javascript file populates all the information..

Is it possible to change my current code so it pulls the html AFTER the JavaScript has done its work??

   Dim htmlWeb As New HtmlWeb()

        Dim document As HtmlAgilityPack.HtmlDocument = htmlWeb.Load(DownloadDataInBackground("http://www.futbol24.com/Live/"))
        test.Text = document.DocumentNode.InnerHtml
0
Comment
Question by:runnerjp2005
1 Comment
 
LVL 83

Accepted Solution

by:
CodeCruiser earned 500 total points
ID: 39842715
You have to use a rendering engine, such as Webbrowser control, to render the website so that Javascript can do its magic. Then the HTML document would contain the scores that you are looking for.
0

Featured Post

Free Tool: Port Scanner

Check which ports are open to the outside world. Helps make sure that your firewall rules are working as intended.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

The ECB site provides FX rates for major currencies since its inception in 1999 in the form of an XML feed. The files have the following format (reducted for brevity) (CODE) There are three files available HERE (http://www.ecb.europa.eu/stats/exch…
It was really hard time for me to get the understanding of Delegates in C#. I went through many websites and articles but I found them very clumsy. After going through those sites, I noted down the points in a easy way so here I am sharing that unde…
Nobody understands Phishing better than an anti-spam company. That’s why we are providing Phishing Awareness Training to our customers. According to a report by Verizon, only 3% of targeted users report malicious emails to management. With compan…

789 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question