ETL (Extract, Transform, Load) out of Oracle

I'm starting an ETL project on an Oracle database by which I'll Extract, Transform & Load data into a Data Warehouse or other file system, and I have 2 questions;

1- Do I need a 3rd party tool?
2- I need to validate certain elements of the data against a matching content in an TXT or a CSV files, change the data accordingly then continue, what's the recommended approach?
Roberto Madro R.Programmer AnalystAsked:
Who is Participating?
 
slightwv (䄆 Netminder) Commented:
1:  We have no way of knowing.  We don't know the end-to-end requirements.  Getting data out of Oracle is simple.  Use sqlplus or SQLCl.

2:  I would say it depends on exactly how you plan on performing each step, what OS you are using and how involved the transform requirements are.

I'm a database guy so I would think I might validate and transform my data as I extract it so the load would be simple.  That might be more problems that its worth so you might need to write some small apps to help with the transform.  If you are on Unix you have several utilities to assist with file processing.  Windows has Powershell.
0
 
Roberto Madro R.Programmer AnalystAuthor Commented:
I'm a fan of Oracle Golden Gate, which is a very capable ETL package & more,  but could never find their pricing model online, I agree with your answer (#1), getting the data out is rather straightforward, it's what follows that's involved.
0
 
slightwv (䄆 Netminder) Commented:
0
 
Roberto Madro R.Programmer AnalystAuthor Commented:
When I lived in Silicon Valley the joke was, God doesn't think he's Larry Ellison.

Yep, sure is a pricey product, no wonder Ellison is so rich.

I'm testing with the SQL Server Tools for Visual Studio, a solution for SSIS Package development  that can tap into Oracle, I'll see what develops.

Thx
0
All Courses

From novice to tech pro — start learning today.