I have a question about data storage/retrieval methods.
I am developing a multi-threaded C# application that will be dealing with very large arrays of data objects. Due to the size and number of these data objects, it would be highly impractical to store them in process memory and the objects will also have to be available across processes/threads. I want to put a representation (serialization, etc) of the objects into a data store that can be paged to fetch the data object representation as needed. The processes/threads will be running on the same machine as the data store, so you can assume that there won't be any delays due to different environments. I'm curious what would be the fastest data storage method for storing and retrieving the items? I wasn't sure if using an XML file, or just plain text would be better than using a database to store the objects, or if there was something else that would be better than any of those.
Start Free Trial
