[Last Call] Learn how to a build a cloud-first strategyRegister Now


NEWBIE: How much "disconnected data" it too much?

Posted on 2006-04-27
Medium Priority
Last Modified: 2010-04-16
Dear Experts,

I'm a C# newbie (via Java) looking at ADO.NET for the first time.

I'm trying to understand when you would use "disconnected data", using DataSets and DataAdapters.  My understanding so far is that although the "disconnected data" behaves as though it were a little mini-database, it's all actually being stored IN MEMORY.  Is that right?

If so, it seems there must be some vague upper limit.  For instance, my Java application might currently retrieve 100,000 customer records, each of say 500 bytes (=50Meg), using a traditional "connected" ResultSet.  Is it practical to hold all that in a "disconnected" DataSet?

Question by:BrianMc1958

Accepted Solution

PoeticAudio earned 300 total points
ID: 16552517
It is true that datasets hold the data in memory.

Although I don't know the upper-limit, I would definitely say that 100,000 records is a bit too much to hold in memory. It's wise to select only the data that you need. It's better to connect a few times to do your database processing then it is to connect once and get a huge lump of data, I believe. Someone will probably know more about this then I do, but that's my opinion.

Assisted Solution

rfgkev earned 200 total points
ID: 16552742
it really depends on how much your machine and application can cope with, aswell as what the data is used for

for a windows app on a machine with a gig of ram, 50meg is nothing really
for a web app on a server with 32 gig of ram, 50meg per session will be fine for a small number of users but once you get a few hundred it'll die

if you're constantly using the data, and it's pretty static, it may be best to keep it in memory instead of repeatedly retrieving it from a database/file.

Author Comment

ID: 16553182
Thanks again!

Featured Post

What does it mean to be "Always On"?

Is your cloud always on? With an Always On cloud you won't have to worry about downtime for maintenance or software application code updates, ensuring that your bottom line isn't affected.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In order to hide the "ugly" records selectors (triangles) in the rowheaders, here are some suggestions. Microsoft doesn't have a direct method/property to do it. You can only hide the rowheader column. First solution, the easy way The first sol…
Introduction Although it is an old technology, serial ports are still being used by many hardware manufacturers. If you develop applications in C#, Microsoft .NET framework has SerialPort class to communicate with the serial ports.  I needed to…
This Micro Tutorial will teach you how to add a cinematic look to any film or video out there. There are very few simple steps that you will follow to do so. This will be demonstrated using Adobe Premiere Pro CS6.
We’ve all felt that sense of false security before—locking down external access to a database or component and feeling like we’ve done all we need to do to secure company data. But that feeling is fleeting. Attacks these days can happen in many w…
Suggested Courses
Course of the Month18 days, 8 hours left to enroll

825 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question