C# DataReader vs DataSet

Hi,

I am writing some code in C# that retrieves data from a microsoft access database. The question I have is when I should use a DataReader or DataSet? As I understand it DataReader is quicker and forward only where as a DataSet allows you more flexibility with your data.

When retriving the data I run one sql query once. It will typically return between 30,000 & 90,000 rows of data with between 4 to 10 fields (depends on the table called). Would this be to much in memory terms for a DataSet to work properly?

Thanks
mcs26Asked:
Who is Participating?
 
Naman GoelConnect With a Mentor Software engineer 1Commented:
30,000 & 90,000 rows are good enough in DataSet but if your data will be growing in future use DataReader.

http://msdn.microsoft.com/en-us/library/ms971481.aspx#adonetbest_topic3
0
 
binaryevoCommented:
My suggestion would be to create an object with properties and then use a datareader, itterate through the data creating a new object each time and adding it to a generic list of that object...  See below (note check the syntax, i did this from memory):

List<TestObject> myTestObjectList = new List<TestObject>();
while (reader.Read())
{
	TestObject myTestObject = new TestObject();
	myTestObject.Property1 = reader["WebUserID"].ToString();
	myTestObject.Property2 = reader["TestColumn2"].ToString();
	myTestObjectList.Add(myTestObject);
}

Open in new window


I am not a fan of datasets as they are designed to somewhat act like mini in memory databases therefore, by nature making them less efficient.  With that being said, be careful not to bloat your objects too much aswell because they can also very easily become inefficient.
0
 
mcs26Author Commented:
Thanks for the replies. But when it says,

"Use the DataReader in your application if you:

•Are processing a set of results too large to fit into memory."

How do you know or whats the rule of thumb when saying "to large to fit into memory"?

Cheers
0
 
Naman GoelSoftware engineer 1Commented:
see if you are expecting 1 million records it is not advisable to store those in DataSet for further processing as that will be stored in memory for a while, on the other hand we can use DataReader will read one row at a time and the process it. That will save memory as well as processing time.
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.