I'm trying to write a sports betting application that will spider websites to get the upcoming fixtures and previous form and then apply various selection criteria to the data. The data is found mainly in HTML table cells. How do I write code to loop through all the rows in all of the tables in a HTML page and extract the rows and treat them as individual records, and then extract the data from the cells and treat them as the record fields? I just want to extract each row so that I can stick the data into a database.
This is done in VB.Net.