troubleshooting Question

Quickest way to Import very large text (csv) file - 50,000,000 records into SQL server table

Avatar of WSIT
WSIT asked on
Microsoft SQL Server
3 Comments1 Solution385 ViewsLast Modified:
We have a very large csv file containing approximately 50,000,000 records with 10 fields per record which we need to import into a table in an SQL server database.  The import wizard keeps falling over as a very small proportion of the records contain invalid data (overlong fields or wierd characters).  We can use VB or the like to process the input table sequentially and output the records to the SQL table but this will take approximately 5 days.  Is there a better way to do this which will take less time.
Join the community to see this answer!
Join our exclusive community to see this answer & millions of others.
Unlock 1 Answer and 3 Comments.
Join the Community
Learn from the best

Network and collaborate with thousands of CTOs, CISOs, and IT Pros rooting for you and your success.

Andrew Hancock - VMware vExpert
See if this solution works for you by signing up for a 7 day free trial.
Unlock 1 Answer and 3 Comments.
Try for 7 days

”The time we save is the biggest benefit of E-E to our team. What could take multiple guys 2 hours or more each to find is accessed in around 15 minutes on Experts Exchange.

-Mike Kapnisakis, Warner Bros