ETL (Extract, Transform, Load) out of Oracle

I'm starting an ETL project on an Oracle database by which I'll Extract, Transform & Load data into a Data Warehouse or other file system, and I have 2 questions;

1- Do I need a 3rd party tool?
2- I need to validate certain elements of the data against a matching content in an TXT or a CSV files, change the data accordingly then continue, what's the recommended approach?
Roberto Madro R.Programmer AnalystAsked:
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

slightwv (䄆 Netminder) Commented:
1:  We have no way of knowing.  We don't know the end-to-end requirements.  Getting data out of Oracle is simple.  Use sqlplus or SQLCl.

2:  I would say it depends on exactly how you plan on performing each step, what OS you are using and how involved the transform requirements are.

I'm a database guy so I would think I might validate and transform my data as I extract it so the load would be simple.  That might be more problems that its worth so you might need to write some small apps to help with the transform.  If you are on Unix you have several utilities to assist with file processing.  Windows has Powershell.
Roberto Madro R.Programmer AnalystAuthor Commented:
I'm a fan of Oracle Golden Gate, which is a very capable ETL package & more,  but could never find their pricing model online, I agree with your answer (#1), getting the data out is rather straightforward, it's what follows that's involved.
slightwv (䄆 Netminder) Commented:
Roberto Madro R.Programmer AnalystAuthor Commented:
When I lived in Silicon Valley the joke was, God doesn't think he's Larry Ellison.

Yep, sure is a pricey product, no wonder Ellison is so rich.

I'm testing with the SQL Server Tools for Visual Studio, a solution for SSIS Package development  that can tap into Oracle, I'll see what develops.

It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today

From novice to tech pro — start learning today.