Solved

using an OR mapper for a data warehouse

Posted on 2011-03-25
1
330 Views
Last Modified: 2012-05-11
Hello

Are there any problems with using OR mappers for creating code to insert/update data in a data warehouse?

The data warehouse I am considering has a reverse star schema whereby the dimension tables have foreign keys to the main table.

thanks
0
Comment
Question by:andieje
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
1 Comment
 
LVL 22

Accepted Solution

by:
dportas earned 500 total points
ID: 35226731
I suspect scalability might be an issue. OR mappers sometimes struggle to cope with large, complex data sets whereas loading a DW typically involves joins to retrieve surrogate keys, determine whether an update or insert is needed, etc. OR/Ms are generally optimised for lots of small updates whereas DW tends to require fewer, larger data loads.

O/R mappers probably won't provide the kind of out-of-the-box logging and process orchestration that you would usually expect from a more conventional ETL tool.

Also most people working in the DW/BI space are probably more familiar with the standard ETL tools and perhaps less likely to be programmers in the languages supported by the OR mapper.

Is there some reason why you are considering an OR mapper for this rather than a data integration / ETL tool? I can't think of many advantages for a DW application, although I expect it could work in some circumstances.

0

Featured Post

Percona Live Europe 2017 | Sep 25 - 27, 2017

The Percona Live Open Source Database Conference Europe 2017 is the premier event for the diverse and active European open source database community, as well as businesses that develop and use open source database software.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In this series, we will discuss common questions received as a database Solutions Engineer at Percona. In this role, we speak with a wide array of MySQL and MongoDB users responsible for both extremely large and complex environments to smaller singl…
This post looks at MongoDB and MySQL, and covers high-level MongoDB strengths, weaknesses, features, and uses from the perspective of an SQL user.
Video by: Steve
Using examples as well as descriptions, step through each of the common simple join types, explaining differences in syntax, differences in expected outputs and showing how the queries run along with the actual outputs based upon a simple set of dem…
This is a high-level webinar that covers the history of enterprise open source database use. It addresses both the advantages companies see in using open source database technologies, as well as the fears and reservations they might have. In this…

617 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question