Want to win a PS4? Go Premium and enter to win our High-Tech Treats giveaway. Enter to Win


SSIS ,BCP or Bulk Insert for 100 million X N tables

Posted on 2012-03-29
Medium Priority
Last Modified: 2012-04-10
I have number of de-normalised 20 column DW tables. I am receiving files in text format and wish to load them at SQL server.

Speed and accuracy is my top priority due to size of table data. Which one is best?

Does anyone have comparison table between these SQL utilities?

Question by:crazywolf2010
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
LVL 22

Accepted Solution

PedroCGD earned 1336 total points
ID: 37781659
If the source files ate in CSV I suggest you to use BULK INSERT
If not using OLE DB Destination with FAST LOAD option you get very good resuts also.

Author Comment

ID: 37781667
Hi Pedro,
What is OLE DB Destination with FAST LOAD option? Do you have an example?

Assisted Solution

waltersnowslinarnold earned 664 total points
ID: 37781686
I guess @Pedro is refering SSIS package with Fast Load option for OLEDB Destination. As @Pedro suggusts, SSIS package with Fast load would yeild good result as you said, you have a text file.
LVL 22

Assisted Solution

PedroCGD earned 1336 total points
ID: 37781957
OLE DB Destination is a destination component under the data flow task!
Otherwords, you can add a data flow task to your control flow and add a source and a destination like OLEDB Destination!

Featured Post

Get free NFR key for Veeam Availability Suite 9.5

Veeam is happy to provide a free NFR license (1 year, 2 sockets) to all certified IT Pros. The license allows for the non-production use of Veeam Availability Suite v9.5 in your home lab, without any feature limitations. It works for both VMware and Hyper-V environments

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

There have been several questions about Large Transaction Log Files in SQL Server 2008, and how to get rid of them when disk space has become critical. This article will explain how to disable full recovery and implement simple recovery that carries…
Naughty Me. While I was changing the database name from DB1 to DB_PROD1 (yep it's not real database name ^v^), I changed the database name and notified my application fellows that I did it. They turn on the application, and everything is working. A …
Video by: ITPro.TV
In this episode Don builds upon the troubleshooting techniques by demonstrating how to properly monitor a vSphere deployment to detect problems before they occur. He begins the show using tools found within the vSphere suite as ends the show demonst…
Want to learn how to record your desktop screen without having to use an outside camera. Click on this video and learn how to use the cool google extension called "Screencastify"! Step 1: Open a new google tab Step 2: Go to the left hand upper corn…

636 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question