Solved

SSIS ,BCP or Bulk Insert for 100 million X N tables

Posted on 2012-03-29
4
1,338 Views
Last Modified: 2012-04-10
Hi,
I have number of de-normalised 20 column DW tables. I am receiving files in text format and wish to load them at SQL server.

Speed and accuracy is my top priority due to size of table data. Which one is best?

Does anyone have comparison table between these SQL utilities?

Thanks
0
Comment
Question by:crazywolf2010
  • 2
4 Comments
 
LVL 22

Accepted Solution

by:
PedroCGD earned 334 total points
ID: 37781659
If the source files ate in CSV I suggest you to use BULK INSERT
If not using OLE DB Destination with FAST LOAD option you get very good resuts also.
Regards,
Pedro
0
 

Author Comment

by:crazywolf2010
ID: 37781667
Hi Pedro,
What is OLE DB Destination with FAST LOAD option? Do you have an example?
0
 
LVL 7

Assisted Solution

by:waltersnowslinarnold
waltersnowslinarnold earned 166 total points
ID: 37781686
I guess @Pedro is refering SSIS package with Fast Load option for OLEDB Destination. As @Pedro suggusts, SSIS package with Fast load would yeild good result as you said, you have a text file.
0
 
LVL 22

Assisted Solution

by:PedroCGD
PedroCGD earned 334 total points
ID: 37781957
HI!
OLE DB Destination is a destination component under the data flow task!
Otherwords, you can add a data flow task to your control flow and add a source and a destination like OLEDB Destination!
Regards
Pedro
0

Featured Post

Zoho SalesIQ

Hassle-free live chat software re-imagined for business growth. 2 users, always free.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

In this article I will describe the Copy Database Wizard method as one possible migration process and I will add the extra tasks needed for an upgrade when and where is applied so it will cover all.
Use this article to create a batch file to backup a Microsoft SQL Server database to a Windows folder.  The folder can be on the local hard drive or on a network share.  This batch file will query the SQL server to get the current date & time and wi…
This tutorial gives a high-level tour of the interface of Marketo (a marketing automation tool to help businesses track and engage prospective customers and drive them to purchase). You will see the main areas including Marketing Activities, Design …
With the power of JIRA, there's an unlimited number of ways you can customize it, use it and benefit from it. With that in mind, there's bound to be things that I wasn't able to cover in this course. With this summary we'll look at some places to go…

911 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

18 Experts available now in Live!

Get 1:1 Help Now