We help IT Professionals succeed at work.

We've partnered with Certified Experts, Carl Webster and Richard Faulkner, to bring you two Citrix podcasts. Learn about 2020 trends and get answers to your biggest Citrix questions!Listen Now

x

Extracting Data from tables on HTML pages

useless_eater
on
Medium Priority
236 Views
Last Modified: 2010-04-23
I'm trying to write a sports betting application that will spider websites to get the upcoming fixtures and previous form and then apply various selection criteria to the data.  The data is found mainly in HTML table cells.  How do I write code to loop through all the rows in all of the tables in a HTML page and extract the rows and treat them as individual records, and then extract the data from the cells and treat them as the record fields?  I just want to extract each row so that I can stick the data into a database.

This is done in VB.Net.

Thanks
Comment
Watch Question

The trouble you have is that although this could be done, it may not be the best way.

For example, you could add the webbrowser control to a form and load a web page. Then loop through the elements on the document (html page), locate the tags your looking for that contain the data you need.

BUT, these pages are bound to be asp type pages and prone to change. Then your back to square one again.
This WILL happen frequently !

It sounds like your looking for a shortcut, but your not going to get it so easliy.

I was asked to a do a smiliar thing with energy proces, in the end I gave up.

You could search for some sites that offer web services ?
Could be your only possible solution.

Not the solution you were looking for? Getting a personalized solution is easy.

Ask the Experts
Access more of Experts Exchange with a free account
Thanks for using Experts Exchange.

Create a free account to continue.

Limited access with a free account allows you to:

  • View three pieces of content (articles, solutions, posts, and videos)
  • Ask the experts questions (counted toward content limit)
  • Customize your dashboard and profile

*This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

OR

Please enter a first name

Please enter a last name

8+ characters (letters, numbers, and a symbol)

By clicking, you agree to the Terms of Use and Privacy Policy.