Solved

HTMLAgilitypack -> downloading full page (including JavaScript renders)

Posted on 2014-02-07
1
906 Views
Last Modified: 2014-02-08
Hi all,


Im using HTMLagilitypack to get a sites html but the issue is its not loading all the content.
I belive this is do to the fact that a javascript file populates all the information..

Is it possible to change my current code so it pulls the html AFTER the JavaScript has done its work??

   Dim htmlWeb As New HtmlWeb()

        Dim document As HtmlAgilityPack.HtmlDocument = htmlWeb.Load(DownloadDataInBackground("http://www.futbol24.com/Live/"))
        test.Text = document.DocumentNode.InnerHtml
0
Comment
Question by:runnerjp2005
1 Comment
 
LVL 83

Accepted Solution

by:
CodeCruiser earned 500 total points
ID: 39842715
You have to use a rendering engine, such as Webbrowser control, to render the website so that Javascript can do its magic. Then the HTML document would contain the scores that you are looking for.
0

Featured Post

DevOps Toolchain Recommendations

Read this Gartner Research Note and discover how your IT organization can automate and optimize DevOps processes using a toolchain architecture.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

IntroductionWhile developing web applications, a single page might contain many regions and each region might contain many number of controls with the capability to perform  postback. Many times you might need to perform some action on an ASP.NET po…
A long time ago (May 2011), I have written an article showing you how to create a DLL using Visual Studio 2005 to be hosted in SQL Server 2005. That was valid at that time and it is still valid if you are still using these versions. You can still re…
This Micro Tutorial will teach you how to censor certain areas of your screen. The example in this video will show a little boy's face being blurred. This will be demonstrated using Adobe Premiere Pro CS6.
Although Jacob Bernoulli (1654-1705) has been credited as the creator of "Binomial Distribution Table", Gottfried Leibniz (1646-1716) did his dissertation on the subject in 1666; Leibniz you may recall is the co-inventor of "Calculus" and beat Isaac…

777 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question