Solved

Copy data from MYSQL to Oracle

Posted on 2014-12-16
6
264 Views
Last Modified: 2014-12-22
Hello,

What is the best way to copy data from MYSQL tables with 8 million records copied over to ORACLE database without performance issue?

Please shed some light.

thank you
0
Comment
Question by:angel7170
  • 2
  • 2
  • 2
6 Comments
 
LVL 142

Expert Comment

by:Guy Hengel [angelIII / a3]
ID: 40503219
3 questions:
* do you have already some way(s) to copy data over?
* what are your expectations in this job: one-time, daily, or something like near-real-time or even real-time?
* what exactly you do consider "performance issue"
0
 

Author Comment

by:angel7170
ID: 40503252
do you have already some way(s) to copy data over?
We tried to use Oracle SQL developer to copy data but bring 8 millions records seems to take lot of time and even it doesn't return results.
* what are your expectations in this job: one-time, daily, or something like near-real-time or even real-time?
on daily
* what exactly you do consider "performance issue"
It just doesn't return results
0
 
LVL 35

Expert Comment

by:Mark Geerlings
ID: 40504012
I don't know MySQL, so I can't address your options for getting the data out of MySQL.  And, you didn't tell us anything about your network between the two systems, or what kind of storage systems either or both databases use, so I can't address those either.  For Oracle, the fastest way to load data into Oracle tables is with Oracle's SQL*Loader utility.  This can process ASCII text files in either fixed-length or delimitted formats at speeds up to 20x faster than via SQL insert statements.  This assumes though that you can create consistently-formatted ASCII text files and get them to a disk device that is accessible from your Oracle server.  Also, this requires that you write a control file for SQL*Loader that tells Oracle how to interpret the ASCII data.

If this data will be going into new tables in Oracle, there should be no indexes on the table as the data is loaded.  Create the index(es) after the data is loaded for the fastest total time, and to get indexes that are as compact as they can be.  If you will be loading this data into existing tables and you need to support access to the existing data while new data is being loaded, you will have to leave the existing indexes in place while you load the data.  That will slow the process a bit.
0
PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

 
LVL 142

Expert Comment

by:Guy Hengel [angelIII / a3]
ID: 40504281
0
 

Author Comment

by:angel7170
ID: 40507880
I tried SQL developer but it errors out with table space. Since the table has about 8-12 million records it is not able to do it.
0
 
LVL 35

Accepted Solution

by:
Mark Geerlings earned 500 total points
ID: 40507946
This does not indicate a problem in SQL Developer.  This indicates an "out-of-space" problem in the database.  You didn't tell us which tablespace this error happens in.  It could be:
1. the data tablespace where this table is
2. the undo (or rollback) tablespace
3. an index tablespace (assuming the table has indexes in place as the data is loaded)
4. a temp tablespace

It looks like you need to add space in one or more of these tablespaces.  Yo ucan use SQL Developer or another tool for this.
0

Featured Post

PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Oracle Finace 3 66
Oracle Database creation fails 5 49
Oracle TEXT search question 9 43
scheduler for Procedure in DB with 3 arguments in 10g 7 27
Subquery in Oracle: Sub queries are one of advance queries in oracle. Types of advance queries: •      Sub Queries •      Hierarchical Queries •      Set Operators Sub queries are know as the query called from another query or another subquery. It can …
Introduction A previously published article on Experts Exchange ("Joins in Oracle", http://www.experts-exchange.com/Database/Oracle/A_8249-Joins-in-Oracle.html) makes a statement about "Oracle proprietary" joins and mixes the join syntax with gen…
This video shows how to configure and send email from and Oracle database using both UTL_SMTP and UTL_MAIL, as well as comparing UTL_SMTP to a manual SMTP conversation with a mail server.
This video explains what a user managed backup is and shows how to take one, providing a couple of simple example scripts.

948 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

23 Experts available now in Live!

Get 1:1 Help Now