Load flat Files in Database

hi

can you please suggest me what are the fastest ways to load flat files to Database, If files size is over 1 GB.
best methods i know are
1. BCP
2. SSIS Load

do you have any more suggestions to this , which is faster and simpler.
BeyondBGCMAsked:
Who is Participating?
 
Jim HornMicrosoft SQL Server Developer, Architect, and AuthorCommented:
>I have 150 different files .. I have to load them one by one , each mapped to one unique table in database.
You'll have to use an ETL tool such as SSIS, as pulling this off requires 150 different source to target mappings.
0
 
BeyondBGCMAuthor Commented:
i have 200 pipe delimited files which i have to load in database in different tables(one to one mapping,which means one file is mapped to one database table.) , so i need a simpler and fastest solution . please suggest
0
 
Jim HornMicrosoft SQL Server Developer, Architect, and AuthorCommented:
I'm only familiar with SSIS (I have a hammer, everything looks like a nail), so I'll only speak to that.

Couple of possibilities:
1  Use a Raw File Source, which does not parse or translate the data, to optimize for speed.
2  Does this file represent a file you've loaded before, with a small subset of changes compared to the overall set?  If so, consider asking the source to send you a change-only file.
0
 
BeyondBGCMAuthor Commented:
1. I have 150 different files
2. I have to load them one by one , each mapped to one unique table in database.
3. I can use SSIS no issues.
0
 
BeyondBGCMAuthor Commented:
I havent received answer to this question yet .....
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.