We help IT Professionals succeed at work.
Get Started

What is the big deal with ETL tools ? are they even needed ?

496 Views
Last Modified: 2016-02-15
I've done a lot of custom Oracle ETL, have dabbled in Informatica (and worked beside the Infa team for a long time), and have done a bit of work in SSIS plus worked alongside the team. So I have a good sense of what's going on, I'm just not an expert on those tools.

I also see tons of job postings for Informatica and SSIS.

But are they really needed ? Why isn't custom ETL better? They're all going to be processing flat files, no ? I'm just not seeing the advantage.

I did enough with Informatica and SSIS to know that their are limitations. With Informatica, the guys just shrugged their shoulders. With SSIS, I found limitations even quicker, plus others would just write a stored procedure and then the only thing the SSIS program did was call the stored procedure.

So what is the good points for the ETL tools ?

It's a huge learning curve to be really good with these tools, and so it requires another skill set, tool base, etc., etc. Plus I've also found the ETL developers knew a lot about the tools, but less about Sql and even less about whatever business is at hand.

So what IS the big draw for these tools, and what do the old-timers here say ? The only thing I can think of is that is Windows based and so you don't have to fiddle with Unix, scripts, etc.
Comment
Watch Question
Database Developer & Administrator
CERTIFIED EXPERT
Most Valuable Expert 2011
Top Expert 2012
Commented:
This problem has been solved!
Unlock 2 Answers and 9 Comments.
See Answers
Why Experts Exchange?

Experts Exchange always has the answer, or at the least points me in the correct direction! It is like having another employee that is extremely experienced.

Jim Murphy
Programmer at Smart IT Solutions

When asked, what has been your best career decision?

Deciding to stick with EE.

Mohamed Asif
Technical Department Head

Being involved with EE helped me to grow personally and professionally.

Carl Webster
CTP, Sr Infrastructure Consultant
Ask ANY Question

Connect with Certified Experts to gain insight and support on specific technology challenges including:

  • Troubleshooting
  • Research
  • Professional Opinions
Did You Know?

We've partnered with two important charities to provide clean water and computer science education to those who need it most. READ MORE