Solved

HTMLAgilitypack -> downloading full page (including JavaScript renders)

Posted on 2014-02-07
1
864 Views
Last Modified: 2014-02-08
Hi all,


Im using HTMLagilitypack to get a sites html but the issue is its not loading all the content.
I belive this is do to the fact that a javascript file populates all the information..

Is it possible to change my current code so it pulls the html AFTER the JavaScript has done its work??

   Dim htmlWeb As New HtmlWeb()

        Dim document As HtmlAgilityPack.HtmlDocument = htmlWeb.Load(DownloadDataInBackground("http://www.futbol24.com/Live/"))
        test.Text = document.DocumentNode.InnerHtml
0
Comment
Question by:runnerjp2005
1 Comment
 
LVL 83

Accepted Solution

by:
CodeCruiser earned 500 total points
ID: 39842715
You have to use a rendering engine, such as Webbrowser control, to render the website so that Javascript can do its magic. Then the HTML document would contain the scores that you are looking for.
0

Featured Post

Enabling OSINT in Activity Based Intelligence

Activity based intelligence (ABI) requires access to all available sources of data. Recorded Future allows analysts to observe structured data on the open, deep, and dark web.

Join & Write a Comment

ASP.Net to Oracle Connectivity Recently I had to develop an ASP.NET application connecting to an Oracle database.As I am doing it first time ,I had to solve several problems. This article will help to such developers  to develop an ASP.NET client…
Wouldn’t it be nice if you could test whether an element is contained in an array by using a Contains method just like the one available on List objects? Wouldn’t it be good if you could write code like this? (CODE) In .NET 3.5, this is possible…
This video shows how to remove a single email address from the Outlook 2010 Auto Suggestion memory. NOTE: For Outlook 2016 and 2013 perform the exact same steps. Open a new email: Click the New email button in Outlook. Start typing the address: …
This tutorial demonstrates a quick way of adding group price to multiple Magento products.

757 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

20 Experts available now in Live!

Get 1:1 Help Now