Solved

SSIS ,BCP or Bulk Insert for 100 million X N tables

Posted on 2012-03-29
4
1,345 Views
Last Modified: 2012-04-10
Hi,
I have number of de-normalised 20 column DW tables. I am receiving files in text format and wish to load them at SQL server.

Speed and accuracy is my top priority due to size of table data. Which one is best?

Does anyone have comparison table between these SQL utilities?

Thanks
0
Comment
Question by:crazywolf2010
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
4 Comments
 
LVL 22

Accepted Solution

by:
PedroCGD earned 334 total points
ID: 37781659
If the source files ate in CSV I suggest you to use BULK INSERT
If not using OLE DB Destination with FAST LOAD option you get very good resuts also.
Regards,
Pedro
0
 

Author Comment

by:crazywolf2010
ID: 37781667
Hi Pedro,
What is OLE DB Destination with FAST LOAD option? Do you have an example?
0
 
LVL 7

Assisted Solution

by:waltersnowslinarnold
waltersnowslinarnold earned 166 total points
ID: 37781686
I guess @Pedro is refering SSIS package with Fast Load option for OLEDB Destination. As @Pedro suggusts, SSIS package with Fast load would yeild good result as you said, you have a text file.
0
 
LVL 22

Assisted Solution

by:PedroCGD
PedroCGD earned 334 total points
ID: 37781957
HI!
OLE DB Destination is a destination component under the data flow task!
Otherwords, you can add a data flow task to your control flow and add a source and a destination like OLEDB Destination!
Regards
Pedro
0

Featured Post

Free eBook: Backup on AWS

Everything you need to know about backup and disaster recovery with AWS, for FREE!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Occasionally there is a need to clean table columns, especially if you have inherited legacy data. There are obviously many ways to accomplish that, including elaborate UPDATE queries with anywhere from one to numerous REPLACE functions (even within…
Ever needed a SQL 2008 Database replicated/mirrored/log shipped on another server but you can't take the downtime inflicted by initial snapshot or disconnect while T-logs are restored or mirror applied? You can use SQL Server Initialize from Backup…
Monitoring a network: why having a policy is the best policy? Michael Kulchisky, MCSE, MCSA, MCP, VTSP, VSP, CCSP outlines the enormous benefits of having a policy-based approach when monitoring medium and large networks. Software utilized in this v…
Add bar graphs to Access queries using Unicode block characters. Graphs appear on every record in the color you want. Give life to numbers. Hopes this gives you ideas on visualizing your data in new ways ~ Create a calculated field in a query: …

707 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question