Solved

HTMLAgilitypack -> downloading full page (including JavaScript renders)

Posted on 2014-02-07
1
932 Views
Last Modified: 2014-02-08
Hi all,


Im using HTMLagilitypack to get a sites html but the issue is its not loading all the content.
I belive this is do to the fact that a javascript file populates all the information..

Is it possible to change my current code so it pulls the html AFTER the JavaScript has done its work??

   Dim htmlWeb As New HtmlWeb()

        Dim document As HtmlAgilityPack.HtmlDocument = htmlWeb.Load(DownloadDataInBackground("http://www.futbol24.com/Live/"))
        test.Text = document.DocumentNode.InnerHtml
0
Comment
Question by:runnerjp2005
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
1 Comment
 
LVL 83

Accepted Solution

by:
CodeCruiser earned 500 total points
ID: 39842715
You have to use a rendering engine, such as Webbrowser control, to render the website so that Javascript can do its magic. Then the HTML document would contain the scores that you are looking for.
0

Featured Post

Industry Leaders: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

ASP.Net to Oracle Connectivity Recently I had to develop an ASP.NET application connecting to an Oracle database.As I am doing it first time ,I had to solve several problems. This article will help to such developers  to develop an ASP.NET client…
The article shows the basic steps of integrating an HTML theme template into an ASP.NET MVC project
Finds all prime numbers in a range requested and places them in a public primes() array. I've demostrated a template size of 30 (2 * 3 * 5) but larger templates can be built such 210  (2 * 3 * 5 * 7) or 2310  (2 * 3 * 5 * 7 * 11). The larger templa…
I've attached the XLSM Excel spreadsheet I used in the video and also text files containing the macros used below. https://filedb.experts-exchange.com/incoming/2017/03_w12/1151775/Permutations.txt https://filedb.experts-exchange.com/incoming/201…

749 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question