Processing cubes directly from .csv files (bypassing SQL Server overheads)

Posted on 2003-03-19
Medium Priority
Last Modified: 2008-02-07

I am considering the possibility of using the .csv file of data I currently have to process cubes, without transferring the data first into SQL Server DBs (with DTS). I am wondering if this is possible or I should accept the overheads associated with dealing with the data in the database (I'm looking for the most efficient way to create cubes). I got the idea for this from noticing the Microsoft Text Driver in the ODBC connections on my machine; does this connection allow me to bypass the database? If not, what is the MS Text Driver for?

Thank-you very much for any help!
Question by:jonathancox
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
LVL 13

Accepted Solution

ispaleny earned 200 total points
ID: 8173577
1. Use semicolon-delimited file c:\test.csv
2. create view viTest as
select *
from OpenRowset('MSDASQL', 'Driver={Microsoft Text Driver (*.txt; *.csv)};DefaultDir=c:\;','select * from test.csv')
3. Use this view

Good luck!

Expert Comment

ID: 9275717
This old question needs to be finalized -- accept an answer, split points, or get a refund.  For information on your options, please click here-> http:/help/closing.jsp#1 
Post your closing recommendations!  No comment means you don't care.
LVL 12

Expert Comment

ID: 11183515
No comment has been added to this question in more than 268 days, so it is now classified as abandoned.

I will leave the following recommendation for this question in the Cleanup topic area:
   Accept: ispaleny http:#8173577

Any objections should be posted here in the next 4 days. After that time, the question will be closed.

EE Cleanup Volunteer

Featured Post

Technology Partners: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

For both online and offline retail, the cross-channel business is the most recent pattern in the B2C trade space.
I have a large data set and a SSIS package. How can I load this file in multi threading?
Via a live example, show how to backup a database, simulate a failure backup the tail of the database transaction log and perform the restore.
Via a live example, show how to shrink a transaction log file down to a reasonable size.

762 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question