Solved

SSIS ,BCP or Bulk Insert for 100 million X N tables

Posted on 2012-03-29
4
1,341 Views
Last Modified: 2012-04-10
Hi,
I have number of de-normalised 20 column DW tables. I am receiving files in text format and wish to load them at SQL server.

Speed and accuracy is my top priority due to size of table data. Which one is best?

Does anyone have comparison table between these SQL utilities?

Thanks
0
Comment
Question by:crazywolf2010
  • 2
4 Comments
 
LVL 22

Accepted Solution

by:
PedroCGD earned 334 total points
ID: 37781659
If the source files ate in CSV I suggest you to use BULK INSERT
If not using OLE DB Destination with FAST LOAD option you get very good resuts also.
Regards,
Pedro
0
 

Author Comment

by:crazywolf2010
ID: 37781667
Hi Pedro,
What is OLE DB Destination with FAST LOAD option? Do you have an example?
0
 
LVL 7

Assisted Solution

by:waltersnowslinarnold
waltersnowslinarnold earned 166 total points
ID: 37781686
I guess @Pedro is refering SSIS package with Fast Load option for OLEDB Destination. As @Pedro suggusts, SSIS package with Fast load would yeild good result as you said, you have a text file.
0
 
LVL 22

Assisted Solution

by:PedroCGD
PedroCGD earned 334 total points
ID: 37781957
HI!
OLE DB Destination is a destination component under the data flow task!
Otherwords, you can add a data flow task to your control flow and add a source and a destination like OLEDB Destination!
Regards
Pedro
0

Featured Post

Microsoft Certification Exam 74-409

Veeam® is happy to provide the Microsoft community with a study guide prepared by MVP and MCT, Orin Thomas. This guide will take you through each of the exam objectives, helping you to prepare for and pass the examination.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Long way back, we had to take help from third party tools in order to encrypt and decrypt data.  Gradually Microsoft understood the need for this feature and started to implement it by building functionality into SQL Server. Finally, with SQL 2008, …
If you have heard of RFC822 date formats, they can be quite a challenge in SQL Server. RFC822 is an Internet standard format for email message headers, including all dates within those headers. The RFC822 protocols are available in detail at:   ht…
In a recent question (https://www.experts-exchange.com/questions/28997919/Pagination-in-Adobe-Acrobat.html) here at Experts Exchange, a member asked how to add page numbers to a PDF file using Adobe Acrobat XI Pro. This short video Micro Tutorial sh…
A short tutorial showing how to set up an email signature in Outlook on the Web (previously known as OWA). For free email signatures designs, visit https://www.mail-signatures.com/articles/signature-templates/?sts=6651 If you want to manage em…

770 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question