SSIS ,BCP or Bulk Insert for 100 million X N tables

Posted on 2012-03-29
Last Modified: 2012-04-10
I have number of de-normalised 20 column DW tables. I am receiving files in text format and wish to load them at SQL server.

Speed and accuracy is my top priority due to size of table data. Which one is best?

Does anyone have comparison table between these SQL utilities?

Question by:crazywolf2010
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
LVL 22

Accepted Solution

PedroCGD earned 334 total points
ID: 37781659
If the source files ate in CSV I suggest you to use BULK INSERT
If not using OLE DB Destination with FAST LOAD option you get very good resuts also.

Author Comment

ID: 37781667
Hi Pedro,
What is OLE DB Destination with FAST LOAD option? Do you have an example?

Assisted Solution

waltersnowslinarnold earned 166 total points
ID: 37781686
I guess @Pedro is refering SSIS package with Fast Load option for OLEDB Destination. As @Pedro suggusts, SSIS package with Fast load would yeild good result as you said, you have a text file.
LVL 22

Assisted Solution

PedroCGD earned 334 total points
ID: 37781957
OLE DB Destination is a destination component under the data flow task!
Otherwords, you can add a data flow task to your control flow and add a source and a destination like OLEDB Destination!

Featured Post

Efficient way to get backups off site to Azure

This user guide provides instructions on how to deploy and configure both a StoneFly Scale Out NAS Enterprise Cloud Drive virtual machine and Veeam Cloud Connect in the Microsoft Azure Cloud.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

There have been several questions about Large Transaction Log Files in SQL Server 2008, and how to get rid of them when disk space has become critical. This article will explain how to disable full recovery and implement simple recovery that carries…
Introduction: When running hybrid database environments, you often need to query some data from a remote db of any type, while being connected to your MS SQL Server database. Problems start when you try to combine that with some "user input" pass…
Although Jacob Bernoulli (1654-1705) has been credited as the creator of "Binomial Distribution Table", Gottfried Leibniz (1646-1716) did his dissertation on the subject in 1666; Leibniz you may recall is the co-inventor of "Calculus" and beat Isaac…
The Email Laundry PDF encryption service allows companies to send confidential encrypted  emails to anybody. The PDF document can also contain attachments that are embedded in the encrypted PDF. The password is randomly generated by The Email Laundr…

726 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question