I want to cache a recordset of 500,000 records with 7 fields in it (date, stock, open, high, low, close, volume). Assume the first field is the date, and the second field is a stock.
I was thinking I could put them into an array. However I am worried that I will not be able to sort these records effieciently. Like if I wanted to find IBM from 1-1-01 to 1-1-02. Or if i wanted to all stocks and their respective prices on 1-1-01.
I know this has been done before and I dont want to reinvent the wheel here. What is the best way to cache all this info into memery, and still have the functionality of doing simple select queries?
Thanks for your help!