Do not use on any
shared computer
September 7, 2008 11:40pm pdt
 
[x]
Attachment Details

Moving data from one database table to another database and table.

Tags: commerical database to home database
I am asking a little advice before I begin something.

I need to read every row from a database/table and INSERT a row in another database/table.
The FROM database is a commercial database like SEQUEL or ORACLE and the TO database is Access or FoxPro.  I say this because I am assuming I can read faster from say SEQUEL than I can INSERT into FoxPro.

For now I am only expecting to be transferring a few thousand rows, but I cannot predict how large the tables will become in the future.  Tables in both databases have very similar schemas.  Lastly, both databases are on the same physical server, and that is not likely to change.  

READER = select * from SEQUEL table; //is select * a dirty read?  does it depend on database vendor?
WHILE Rows in READER
{
      1. Read a row
      2. Convert data into FoxPro Schema
      3. Build an Insert Statement
      4. Insert the row FoxPro
}

Question:  Is it a concern that SEQUEL/ORACLE will be waiting to do step 1 while waiting for C# to do steps 2 and 3 and FoxPro/Access is performing step 4?  Can I tell the reader to do a dirty read?

Should I try to buffer it?  I mean read 10,000 rows into a collection in step 1 and then do the other tasks, in the hope that most of the time a table will not contain 10,000 rows? Am I showing my age by asking this question?

Does this job really call out to be done in two threads?  I did want this code to be as simple as possible.

Thank you for taking the time to read all this.  All opinions are welcome.


Start your free trial to view this solution
[x]
The Solution Rating System

With so many solutions, how can you tell which solutions are most likely to help you and which ones are not? To provide you with a tool to use, we rate our solutions based on various elements that most accurately determine if a solution is a quality solution. To explain what factors affect the solution rating, here are the elements we take into consideration when formulating our solution rating.

  • The Grade of the Solution
  • The Zone Rank of the Expert Providing the Solution
  • The Number of Author and Expert Comments
  • The Number of Experts Contributing
  • The Feedback of the Community

Your Input Matters
Because of the way the system is set up, the most important variable in this equation is you. As a member of Experts Exchange, you are able to cast your vote on the quality of the solutions in regard to how complete, accurate, helpful and easy to understand each solution is. When you provide your feedback, each rating is adjusted accordingly. So, if you see a solution that has a poor rating that you think is a good solution, let us know by rating it. As you do, the rating will be adjusted and will become more accurate for other members of our site.

If you have any suggestions that you would like to make for our rating system, please ask a question in the Suggestions Zone of Community Support.

Thank you!

Question Stats
Zone: Programming
Question Asked By: wilfordrocks
Solution Provided By: rolutola
Participating Experts: 3
Solution Grade: A
Views: 56
Translate:
Loading Advertisement...
 
[+][-]Expert Comment by faiga16

Rank: Master

Expert Comment by faiga16:

All comments and solutions are available to Premium Service Members only.

Start your 7-day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
 
[+][-]Author Comment by wilfordrocks
Author Comment by wilfordrocks:

All comments and solutions are available to Premium Service Members only.

Start your 7-day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
 
[+][-]Accepted Solution by rolutola

Rank: Master

Accepted Solution by rolutola:

All comments and solutions are available to Premium Service Members only.

Start your 7-day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
 
[+][-]Expert Comment by Geert_Gruwez
Expert Comment by Geert_Gruwez:

All comments and solutions are available to Premium Service Members only.

Start your 7-day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
 
Loading Advertisement...
20080723-EE-VQP-34 / EE_QW_2_20070628