Want to protect your cyber security and still get fast solutions? Ask a secure question today.Go Premium


Best data structure for a large database application

Posted on 2006-04-12
Medium Priority
Last Modified: 2008-01-09


I have a really large db application and it needs to do basic operation such as insert, modify, and delete records...

For example, one of the task is to read about 30 000 entries in the Excel file and import it to the database.

What is the best data structure to be used in this situation? (dataset, arraylist, etc...) ?

Thanks for your help
Question by:TungVan
  • 2

Accepted Solution

winsoftech earned 300 total points
ID: 16443890
its good to use dataset
LVL 41

Assisted Solution

graye earned 200 total points
ID: 16446077
Actually, I wouldn't be too concerned about the "data base structure" at the client end.... as much as how I plan to manipulate the data at the server end.  The "traditonal" ADO.Net disconnected model isn't well suited for doing 30,000 inserts into a database.

So, I'd be thinking about how I could iterate thru the Excel file in "chunks" and use stored procedures at the database end to do the inserts.

...this making sense?

Tell us more about the language you're using (VB.net?), the version of the .Net framework (v2.0?), and the database (SQL Server 2005?), etc.

Author Comment

ID: 16446278

I am using C#, .Net 1.1 and SQL Server 2000
LVL 41

Expert Comment

ID: 16446797
OK, that's what we needed to know.

Here is a good article on how to simulate a "bulk copy" inserts using XML and stored procedures.

I'd put my effort on that "end" of the solution, and not worry about how to store the data in the client.

Featured Post

Free Tool: ZipGrep

ZipGrep is a utility that can list and search zip (.war, .ear, .jar, etc) archives for text patterns, without the need to extract the archive's contents.

One of a set of tools we're offering as a way to say thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

A basic question.. “What is the Garbage Collector?” The usual answer given back: “Garbage collector is a background thread run by the CLR for freeing up the memory space used by the objects which are no longer used by the program.” I wondered …
Wouldn’t it be nice if you could test whether an element is contained in an array by using a Contains method just like the one available on List objects? Wouldn’t it be good if you could write code like this? (CODE) In .NET 3.5, this is possible…
this video summaries big data hadoop online training demo (http://onlineitguru.com/big-data-hadoop-online-training-placement.html) , and covers basics in big data hadoop .
This lesson discusses how to use a Mainform + Subforms in Microsoft Access to find and enter data for payments on orders. The sample data comes from a custom shop that builds and sells movable storage structures that are delivered to your property. …
Suggested Courses
Course of the Month10 days, 20 hours left to enroll

571 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question