Read a large database into memory more efficiently
Posted on 2006-03-27
I have a program that I would like to make more efficient. A large part of the processing time is spent reading two large databases into memory (about 150,000 records each) so that I can do computations on them. I am reading them in with the construction:
while not mydatabasetable.eof do begin
<assign the database fields to various variables>.
I am finding that it takes several minutes to read each database. Is there a faster way to get the data into memory?