Solved

Extracting Data from tables on HTML pages

Posted on 2006-10-30
3
206 Views
Last Modified: 2010-04-23
I'm trying to write a sports betting application that will spider websites to get the upcoming fixtures and previous form and then apply various selection criteria to the data.  The data is found mainly in HTML table cells.  How do I write code to loop through all the rows in all of the tables in a HTML page and extract the rows and treat them as individual records, and then extract the data from the cells and treat them as the record fields?  I just want to extract each row so that I can stick the data into a database.

This is done in VB.Net.

Thanks
0
Comment
Question by:useless_eater
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
3 Comments
 
LVL 10

Accepted Solution

by:
Kinger247 earned 500 total points
ID: 17854109
The trouble you have is that although this could be done, it may not be the best way.

For example, you could add the webbrowser control to a form and load a web page. Then loop through the elements on the document (html page), locate the tags your looking for that contain the data you need.

BUT, these pages are bound to be asp type pages and prone to change. Then your back to square one again.
This WILL happen frequently !

It sounds like your looking for a shortcut, but your not going to get it so easliy.

I was asked to a do a smiliar thing with energy proces, in the end I gave up.

You could search for some sites that offer web services ?
Could be your only possible solution.
0

Featured Post

Industry Leaders: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Article by: Kraeven
Introduction Remote Share is a simple remote sharing tool, enabling you to see, add and remove remote or local shares. The application is written in VB.NET targeting the .NET framework 2.0. The source code and the compiled programs have been in…
I think the Typed DataTable and Typed DataSet are very good options when working with data, but I don't like auto-generated code. First, I create an Abstract Class for my DataTables Common Code.  This class Inherits from DataTable. Also, it can …
Monitoring a network: why having a policy is the best policy? Michael Kulchisky, MCSE, MCSA, MCP, VTSP, VSP, CCSP outlines the enormous benefits of having a policy-based approach when monitoring medium and large networks. Software utilized in this v…
Monitoring a network: how to monitor network services and why? Michael Kulchisky, MCSE, MCSA, MCP, VTSP, VSP, CCSP outlines the philosophy behind service monitoring and why a handshake validation is critical in network monitoring. Software utilized …

690 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question