I feel that I may have bitten into too large a pie, but here goes:
in VB 2005
I have a datatable with new information, I also have a recordset with the same data. The recordset is extracted from a master record keeping xlsx woorkbook, the datatable is from a DBF. The column structures of each is the same. The DBF contains new data as well as some old data. I need to only take the new data and place it into the recordset so that I can update the master record.
The way to identify new data is to compare 2 columns Name and Date if the NEW name & date do not
match any Name & Date in the master file then the record goes in.
The first time this needs to run I will have over 11,000 DBF files to place into the master woorkbook, after that the load is 3-10 a day. I have already got a solution that works using excel opened by VB.net and I loop through the (dbf) datatable using dataview and then search each record individually using the Find command in the excel woorkbok to see if the record exists if not then I place it in and so on. This way takes about 45sec to do each DBF ..... not too bad with 3 - 10 but a disaster with 11,000.
I am not at all experianced with this and have already tried a few different alternatives. However I do need the master to be an excel woorkbook, and the updates do come from the dbf files those are my constants, anything else is up for grabs.
Can anyone help me to put together some kind of strategy to do this fast if my idea of the recordset is not the best.