The ETL tier scaleout

Dear all,

right now found out that the MS SSIS on standard edition and enterprise edition can't scare out by adding more than one SSIS instance.

I would like to know if the Oracle Golden gate, IBM DBMOTO or Sybase replication server has the same problem?

which one can scareout so that an additional ETL server can scare up the performance ?
LVL 1
marrowyungSenior Technical architecture (Data)Asked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

F PCommented:
Consider replication using IBM i and the build in DB2 journaling which is an operating system feature. Replicate with the iTERA or MiMiX software. It's incredibly scalable, and a true mainframe architecture.

http://www-03.ibm.com/systems/power/software/i/

http://www.visionsolutions.com/

.. Vision pretty much owns the replication market on IBM i.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
marrowyungSenior Technical architecture (Data)Author Commented:
so one question is, oracle goldengate and IBM DB MOTO really not  scaleable ?
0
marrowyungSenior Technical architecture (Data)Author Commented:
http://www-03.ibm.com/systems/power/software/i/

so that one is called IBM i ? if it is ok why we need IBM DBMOTO ?
0
Ultimate Tool Kit for Technology Solution Provider

Broken down into practical pointers and step-by-step instructions, the IT Service Excellence Tool Kit delivers expert advice for technology solution providers. Get your free copy now.

F PCommented:
IBM i is the hardware/operating system/mainframe which runs IBM DBMOTO. You then can replicate it using the journaling file system which is built into the OS and replicate using Vision products.
0
F PCommented:
IBM has a thing where they like to rename the freaking system too many times. I used to be an AS/400 .. iSeries .. System i .. IBM i ... whatever administrator running OS400 or i5/OS ... V5R3 ... V5R4 .. V6R1 ... V7R1 , Here's a picture of a bigger system at a casino corporation in Chicago. We ran one here, and one in Kansas City MO, and both systems I upgraded from a power 5+ processor to a power 6. They would, one at a time, run 10 casinos concurrently.

IMG-127361051793294.jpeg
IMG-127357150160455.jpeg
0
marrowyungSenior Technical architecture (Data)Author Commented:
wait, what is that mean? so all hardware here run IBMDBMOTO and they are not in the same site and they working together to ETL data?
0
F PCommented:
MS SSIS is to Windows/Server/Vista/XP -- as -- IBM DBMOTO is to IBM i/iSeries/System i
MS SQL is to Windows/Server/Vista/XP -- as -- IBM DB2 is to IBM i/iSeries/System i

That help clarify a bit? Oracle can run on many differing types of DB's, including MS SQL, IBM DB2, and MySQL, but I couldn't find anywhere where it speaks to the architecture underlying. There c;an be many OS variations underneath everything by MS SQL, which has to be Windows.
0
marrowyungSenior Technical architecture (Data)Author Commented:
"MS SSIS is to Windows/Server/Vista/XP -- as -- IBM DBMOTO is to IBM i/iSeries/System i
MS SQL is to Windows/Server/Vista/XP -- as -- IBM DB2 is to IBM i/iSeries/System i"

the IBM one can ETL to diff DB on diff platform, it just use messaging technology.

IBM is quite well on talk to diff site and the replication server can make the primary site and DR server active/active.

so to ETL between diff OS/DB, IBM can be one of the choice but I don't know if Oracle goldengate doing the same thing and challenge IBM on that.

so I focus on scalable or not !

this is what I mean.

do you mean IBM i and DBMOTO focus in diff area and we have to buy both ?
0
F PCommented:
I'm saying in terms of scalability and performance, you can't do better with IBM i . DBMOTO runs on the IBM i, and nothing else I saw runs on that. I think the best way to describe it is that if you had a server sitting in a rack, do you need a monitor? Every single intel processor is designed for and integrates graphic performance into the architecture. IBM i and the Power processor is a great architecture, and the power processor was even dropped by Apple because of that exact same reason.
0
marrowyungSenior Technical architecture (Data)Author Commented:
", and the power processor was even dropped by Apple because of that exact same reason."

I don't understand this

so you mean the ETL is the best using IBM i and IBM DBMOTO, so as DBMOTO is already doing ETL and why I need i for ?
0
F PCommented:
I'm saying that when the chip itself is built from Intel (Xeon, Core i Series chips) or Motorola (PowerPC processors including CISC and RISC), there is a graphics processor built into the chip itself with Intel, and it is designed to work with graphics. The PowerPC processor is not. Adobe Flash and visual effects were terrible with Apple, and the processors couldn't handle it. That's why they went to Intel chips. If i'm building a server for scalability and power, I would use the system that's designed to be scalable and a true server architecture. When they went from 32, to 48 ,to 64 bits in the PowerPC processor line, none of the applications on the IBM i needed to be recompiled to take advantage. Have a look...


http://en.wikipedia.org/wiki/IBM_i
0
marrowyungSenior Technical architecture (Data)Author Commented:
"Adobe Flash and visual effects were terrible with Apple, and the processors couldn't handle it. "

I heard that this is because steve jobs hate the boss of adobe and that's why adobe can't works well on apple OSX. so and therefore !

"When they went from 32, to 48 ,to 64 bits in the PowerPC processor line, none of the applications on the IBM i needed to be recompiled to take advantage. Have a look..."

so this mean IBM i hardware scale well, right?
0
F PCommented:
Apple and Adobe went back and forth with Adobe saying use better hardware to support our systems, and Apple saying fix your code to run on what we have. Eventually Apple rolled over and pushed their code onto Intel's architecture around 10.5 with 10.6 still having legacy PowerPC binaries, but everything 10.6+ is all Intel support only. It's what I'm running as I write this, and honestly Apple strong arms companies into what they want, but then again thier name is on the line, and they are giving the guarantee it'll work, not the developers and companies who make the software. You can't call Microsoft if your Dell isn't working.

...

Yes, it scales very well. It uses what's called a TIMI, or Technology Independent Machine Interface, which abstracts the compiled machine language with the hardware. It's a copy and paste onto new architectures, and it just works. You typically use a HMC to manage LPARs and up to 200+ servers with a single linux 1U server that's a custom Java app IBM makes. It's how you would terminal into the system, and even though they're not cheap... (least expensive being between 5-15k) they're more than worth it. They have higher uptime, the journaled IBM DB2 operating system, increased security, and the only thing bigger is the IBM mainframes Z series systems. They're on the same hardware as the P series now as well, which means if you buy an AIX/UNIX system from IBM, it comes on the IBM i hardware.

Here's the midrange specs I ran 10 casinos on, which was the 520 (not the express) which we did an in place upgrade to a 575...

IBM POWER6 servers
Name      Number of sockets      Number of cores      CPU clock frequency
520 Express      2      4      4.2 GHz or 4.7 GHz
550 Express      4      8      4.2 GHz or 5.0 GHz
560 Express      8      16      3.6 GHz
570      8      16      4.4 GHz or 5.0 GHz
570      16      32      4.2 GHz
575      16      32      4.7 GHz
595      32      64      4.2 GHz or 5.0 GHz

That's from Wikipedia...
0
F PCommented:
Oh yeah, they're all made in Rochester, NY - and even supported there. If you call support, which is great, you only get NY.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Microsoft SQL Server

From novice to tech pro — start learning today.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.