Solved

flexible database schema patterns

Posted on 2011-02-21
3
644 Views
Last Modified: 2012-05-11
Hi

I have a lot of data for a specific 'thing' from lots of disparate data sources and I'd like to integrate them. I dont want to have to deal with how each source models the domain in question as it is a very complex domain. To have a traditional 3NF denormalised database would require having to remodel the schema every time i wanted to incorporate a new data source and that isn't feasible. I'm thinking of having some sort of data warehouse approach and a reverse star schema with the 'thing' at the middle as the fact and the data from each different source as a dimension so they can keep their own idiosyncracies regarding the domain. It would be a reverse star in the sense that the thing in the middle would have a primary key and the dimensions would have foreign keys which link to the relevant row in the central 'fact' table.

I was wondering if any you esteemed database experts had any comments and/or were aware of any database 'design patterns' or approaches for managing this sort of scenario

regards
0
Comment
Question by:andieje
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
3 Comments
 
LVL 1

Accepted Solution

by:
BarryWilliams earned 500 total points
ID: 34950219
If we describe what you want to do as simply throw all your data into a huge box, and add to it from time to time,without regard to structure or relationships, then we could do that with a regular Data Warehouse.

This would put us in the Bill Inmon school of thought.

Then if we look ahead you are going to want to take data out of this huge box.

Probably a lot of it will not be related to anything so that puts us into the Ralph Kimball approach, which is to have dedicated Data Marts for specific areas.

So if we combine the two, then we have the answer to your problem.

I have drafted a 'Father of all Data Warehouses' on this page of my Database Answers Web Site :-
http://www.databaseanswers.org/data_models/father_of_all_data_warehouses/index.htm

Maybe I will change it because Bill Inmon is often referred to as 'The Father of Data Warehouses'.;-0)

On a practical level, you could start with a Generic Data Warehouse in line with my design and then  add a couple Data Marts for specific Enquires or categories of data in the Data Warehouse.

I would be very interested in knowing how you get on.

HTH

Barry Williams
0
 

Author Comment

by:andieje
ID: 35072804
Thanks Barry. I will look into this. How can i let you know how i a getting on. Shall i leave this post open?
0
 
LVL 1

Expert Comment

by:BarryWilliams
ID: 35075716
Hi andieje

You can email me at barryw@databaseanswers.org,

Barry

0

Featured Post

 Database Backup and Recovery Best Practices

Join Percona’s, Architect, Manjot Singh as he presents Database Backup and Recovery Best Practices (with a Focus on MySQL) on Thursday, July 27, 2017 at 11:00 am PDT / 2:00 pm EDT (UTC-7). In the case of a failure, do you know how long it will take to restore your database?

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article shows the steps required to install WordPress on Azure. Web Apps, Mobile Apps, API Apps, or Functions, in Azure all these run in an App Service plan. WordPress is no exception and requires an App Service Plan and Database to install
Microsoft Access is a place to store data within tables and represent this stored data using multiple database objects such as in form of macros, forms, reports, etc. After a MS Access database is created there is need to improve the performance and…
Video by: Steve
Using examples as well as descriptions, step through each of the common simple join types, explaining differences in syntax, differences in expected outputs and showing how the queries run along with the actual outputs based upon a simple set of dem…
This is a high-level webinar that covers the history of enterprise open source database use. It addresses both the advantages companies see in using open source database technologies, as well as the fears and reservations they might have. In this…

636 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question