Need to split one huge CSV file into 5 files

Please help with the SSIS package, thanks
sqlcuriousAsked:
Who is Participating?
 
Saurabh BhadauriaCommented:
yes you can do it SSIS..
you have to use single  Flat file source and multiple  flat file destinations

if you want to split data based on row values then use Conditional Split ..
check  below link....
http://henkvandervalk.com/speeding-up-ssis-bulk-inserts-into-sql-server


If you want to Split data base on colums... then use multicast..
check below link..
http://stackoverflow.com/questions/6213847/using-multi-cast-transformation-for-destinations-with-different-columns 

Thanks,
Saurabh
0
 
thelugCommented:
CSV Splitter.  Someone I knew in a previous "life" used it all the time.  Free utility.  Get it here:

http://erdconcepts.com/dbtoolbox.html
0
 
sqlcuriousAuthor Commented:
Thelug, Thanks for the answer but I needto do it via SSIS, please suggest.
I know we could do using multicast or conditional split but not sure about the exact process
0
Ultimate Tool Kit for Technology Solution Provider

Broken down into practical pointers and step-by-step instructions, the IT Service Excellence Tool Kit delivers expert advice for technology solution providers. Get your free copy now.

 
aikimarkCommented:
1. Are you splitting an input file or an output file?
2. Are you splitting based on row/records or by columns?
3. What kind of logic are you using to do the split?
4. When you say "huge", just how big is the file?

============
have you looked at Powershell?
http://www.codeproject.com/Articles/70319/Splitting-CSV-file-based-on-content-in-one-line-us
http://gallery.technet.microsoft.com/scriptcenter/PowerShell-Split-large-log-6f2c4da0
http://michielw.blogspot.com/2012/05/powershell-split-text-file-in-multiple.html

============
free CSV splitter to use while you are working on a complete solution
http://www.mydigitallife.info/download-free-csv-splitter-to-split-csv-files-easily/
0
 
sqlcuriousAuthor Commented:
Thanks a lot Saurabh I will give it a try
0
 
sqlcuriousAuthor Commented:
thanks
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.