Solved

SSIS v BCP

Posted on 2013-12-03
4
976 Views
Last Modified: 2016-02-10
Hi All,
Just wondering if you had any preference on how to transfer data between data centers.

We are using SQL Server 2005 in the US and want to transfer data to a different data center in Europe, the database in Europe will be an oracle database.

two options we are working with are Batch copy process.
Transferring txt files from our sql server to a location where our counterparts can pick up and ingest into their own systems.

Or using SSIS ETL solution- linking our source data sql server tables to the destination tables in Europe (oracle db destination)

Using BCP before, I have pulled data from the same data center from one database and inserted to a different database, this process was taking possibly 3 hours to run.
When I started using SSIS to preform this process, it shortened the processing time to aprox 15 mins. So I know using SSIS when transferring data between two different SQL server databases is the way to go. But i'm wondering, if i'm transferring from SQL server database on one data center on one continent to another data center to an oracle db on a different continent would this be quicker than bcp?

thank you,
P
0
Comment
Question by:Putoch
4 Comments
 
LVL 44

Accepted Solution

by:
Rainer Jeschor earned 500 total points
Comment Utility
Hi,
it depends a lot on your connectivity between the data centers (and of course the amount of data): speed, bandwith, latency, availability

If you estimate that the transfer would not take longer as 15-30 minutes, then I would use SSIS directly to read from SQL and write to Oracle.

If this process might take multiple hours,
Alternative 1:
use SSIS to create well formatted text files, copy that files to your Oracle Data Center and start importing there
Alternative 2:
use SSIS to create RAW files, ZIP them, copy them to the other data center and using SSIS there (so there has to be a SQL Server instance) to import into Oracle.

Just my 2ct
Rainer
0
 
LVL 15

Expert Comment

by:jorge_toriz
Comment Utility
I think both approaches are valid, the thing is to set up the right network packet size and batch size.
0
 

Author Comment

by:Putoch
Comment Utility
Yea the amount of detail being transferred and connectivity would have to be considered.
Thank you all for your feedback,
0

Featured Post

Better Security Awareness With Threat Intelligence

See how one of the leading financial services organizations uses Recorded Future as part of a holistic threat intelligence program to promote security awareness and proactively and efficiently identify threats.

Join & Write a Comment

Suggested Solutions

My client sends data in an Excel file to me to load them into Staging database. The file contains many sheets that they have same structure. In this article, I would like to share the simple way to load data of multiple sheets by using SSIS.
My client sends a request to me that they want me to load data, which will be returned by Web Service APIs, and do some transformation before importing to database. In this article, I will provide an approach to load data with Web Service Task and X…
This video shows how to recover a database from a user managed backup
Via a live example, show how to restore a database from backup after a simulated disk failure using RMAN.

743 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

8 Experts available now in Live!

Get 1:1 Help Now