Copy data from MYSQL to Oracle

Hello,

What is the best way to copy data from MYSQL tables with 8 million records copied over to ORACLE database without performance issue?

Please shed some light.

thank you
angel7170Asked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Guy Hengel [angelIII / a3]Billing EngineerCommented:
3 questions:
* do you have already some way(s) to copy data over?
* what are your expectations in this job: one-time, daily, or something like near-real-time or even real-time?
* what exactly you do consider "performance issue"
0
angel7170Author Commented:
do you have already some way(s) to copy data over?
We tried to use Oracle SQL developer to copy data but bring 8 millions records seems to take lot of time and even it doesn't return results.
* what are your expectations in this job: one-time, daily, or something like near-real-time or even real-time?
on daily
* what exactly you do consider "performance issue"
It just doesn't return results
0
Mark GeerlingsDatabase AdministratorCommented:
I don't know MySQL, so I can't address your options for getting the data out of MySQL.  And, you didn't tell us anything about your network between the two systems, or what kind of storage systems either or both databases use, so I can't address those either.  For Oracle, the fastest way to load data into Oracle tables is with Oracle's SQL*Loader utility.  This can process ASCII text files in either fixed-length or delimitted formats at speeds up to 20x faster than via SQL insert statements.  This assumes though that you can create consistently-formatted ASCII text files and get them to a disk device that is accessible from your Oracle server.  Also, this requires that you write a control file for SQL*Loader that tells Oracle how to interpret the ASCII data.

If this data will be going into new tables in Oracle, there should be no indexes on the table as the data is loaded.  Create the index(es) after the data is loaded for the fastest total time, and to get indexes that are as compact as they can be.  If you will be loading this data into existing tables and you need to support access to the existing data while new data is being loaded, you will have to leave the existing indexes in place while you load the data.  That will slow the process a bit.
0
Determine the Perfect Price for Your IT Services

Do you wonder if your IT business is truly profitable or if you should raise your prices? Learn how to calculate your overhead burden with our free interactive tool and use it to determine the right price for your IT services. Download your free eBook now!

Guy Hengel [angelIII / a3]Billing EngineerCommented:
0
angel7170Author Commented:
I tried SQL developer but it errors out with table space. Since the table has about 8-12 million records it is not able to do it.
0
Mark GeerlingsDatabase AdministratorCommented:
This does not indicate a problem in SQL Developer.  This indicates an "out-of-space" problem in the database.  You didn't tell us which tablespace this error happens in.  It could be:
1. the data tablespace where this table is
2. the undo (or rollback) tablespace
3. an index tablespace (assuming the table has indexes in place as the data is loaded)
4. a temp tablespace

It looks like you need to add space in one or more of these tablespaces.  Yo ucan use SQL Developer or another tool for this.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Oracle Database

From novice to tech pro — start learning today.