Solved

HTMLAgilitypack -> downloading full page (including JavaScript renders)

Posted on 2014-02-07
1
885 Views
Last Modified: 2014-02-08
Hi all,


Im using HTMLagilitypack to get a sites html but the issue is its not loading all the content.
I belive this is do to the fact that a javascript file populates all the information..

Is it possible to change my current code so it pulls the html AFTER the JavaScript has done its work??

   Dim htmlWeb As New HtmlWeb()

        Dim document As HtmlAgilityPack.HtmlDocument = htmlWeb.Load(DownloadDataInBackground("http://www.futbol24.com/Live/"))
        test.Text = document.DocumentNode.InnerHtml
0
Comment
Question by:runnerjp2005
1 Comment
 
LVL 83

Accepted Solution

by:
CodeCruiser earned 500 total points
ID: 39842715
You have to use a rendering engine, such as Webbrowser control, to render the website so that Javascript can do its magic. Then the HTML document would contain the scores that you are looking for.
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

IntroductionWhile developing web applications, a single page might contain many regions and each region might contain many number of controls with the capability to perform  postback. Many times you might need to perform some action on an ASP.NET po…
Parsing a CSV file is a task that we are confronted with regularly, and although there are a vast number of means to do this, as a newbie, the field can be confusing and the tools can seem complex. A simple solution to parsing a customized CSV fi…
Concerto provides fully managed cloud services and the expertise to provide an easy and reliable route to the cloud. Our best-in-class solutions help you address the toughest IT challenges, find new efficiencies and deliver the best application expe…
With Secure Portal Encryption, the recipient is sent a link to their email address directing them to the email laundry delivery page. From there, the recipient will be required to enter a user name and password to enter the page. Once the recipient …

948 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

23 Experts available now in Live!

Get 1:1 Help Now