Solved

SSIS v BCP

Posted on 2013-12-03
4
1,052 Views
Last Modified: 2016-02-10
Hi All,
Just wondering if you had any preference on how to transfer data between data centers.

We are using SQL Server 2005 in the US and want to transfer data to a different data center in Europe, the database in Europe will be an oracle database.

two options we are working with are Batch copy process.
Transferring txt files from our sql server to a location where our counterparts can pick up and ingest into their own systems.

Or using SSIS ETL solution- linking our source data sql server tables to the destination tables in Europe (oracle db destination)

Using BCP before, I have pulled data from the same data center from one database and inserted to a different database, this process was taking possibly 3 hours to run.
When I started using SSIS to preform this process, it shortened the processing time to aprox 15 mins. So I know using SSIS when transferring data between two different SQL server databases is the way to go. But i'm wondering, if i'm transferring from SQL server database on one data center on one continent to another data center to an oracle db on a different continent would this be quicker than bcp?

thank you,
P
0
Comment
Question by:Putoch
4 Comments
 
LVL 44

Accepted Solution

by:
Rainer Jeschor earned 500 total points
ID: 39694921
Hi,
it depends a lot on your connectivity between the data centers (and of course the amount of data): speed, bandwith, latency, availability

If you estimate that the transfer would not take longer as 15-30 minutes, then I would use SSIS directly to read from SQL and write to Oracle.

If this process might take multiple hours,
Alternative 1:
use SSIS to create well formatted text files, copy that files to your Oracle Data Center and start importing there
Alternative 2:
use SSIS to create RAW files, ZIP them, copy them to the other data center and using SSIS there (so there has to be a SQL Server instance) to import into Oracle.

Just my 2ct
Rainer
0
 
LVL 15

Expert Comment

by:jorge_toriz
ID: 39697575
I think both approaches are valid, the thing is to set up the right network packet size and batch size.
0
 

Author Comment

by:Putoch
ID: 39701868
Yea the amount of detail being transferred and connectivity would have to be considered.
Thank you all for your feedback,
0

Featured Post

Free Tool: IP Lookup

Get more info about an IP address or domain name, such as organization, abuse contacts and geolocation.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Checking the Alert Log in AWS RDS Oracle can be a pain through their user interface.  I made a script to download the Alert Log, look for errors, and email me the trace files.  In this article I'll describe what I did and share my script.
Ever wondered why sometimes your SQL Server is slow or unresponsive with connections spiking up but by the time you go in, all is well? The following article will show you how to install and configure a SQL job that will send you email alerts includ…
This video shows syntax for various backup options while discussing how the different basic backup types work.  It explains how to take full backups, incremental level 0 backups, incremental level 1 backups in both differential and cumulative mode a…
Viewers will learn how the fundamental information of how to create a table.

765 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question