Solved

flexible database schema patterns

Posted on 2011-02-21
3
618 Views
Last Modified: 2012-05-11
Hi

I have a lot of data for a specific 'thing' from lots of disparate data sources and I'd like to integrate them. I dont want to have to deal with how each source models the domain in question as it is a very complex domain. To have a traditional 3NF denormalised database would require having to remodel the schema every time i wanted to incorporate a new data source and that isn't feasible. I'm thinking of having some sort of data warehouse approach and a reverse star schema with the 'thing' at the middle as the fact and the data from each different source as a dimension so they can keep their own idiosyncracies regarding the domain. It would be a reverse star in the sense that the thing in the middle would have a primary key and the dimensions would have foreign keys which link to the relevant row in the central 'fact' table.

I was wondering if any you esteemed database experts had any comments and/or were aware of any database 'design patterns' or approaches for managing this sort of scenario

regards
0
Comment
Question by:andieje
  • 2
3 Comments
 
LVL 1

Accepted Solution

by:
BarryWilliams earned 500 total points
ID: 34950219
If we describe what you want to do as simply throw all your data into a huge box, and add to it from time to time,without regard to structure or relationships, then we could do that with a regular Data Warehouse.

This would put us in the Bill Inmon school of thought.

Then if we look ahead you are going to want to take data out of this huge box.

Probably a lot of it will not be related to anything so that puts us into the Ralph Kimball approach, which is to have dedicated Data Marts for specific areas.

So if we combine the two, then we have the answer to your problem.

I have drafted a 'Father of all Data Warehouses' on this page of my Database Answers Web Site :-
http://www.databaseanswers.org/data_models/father_of_all_data_warehouses/index.htm

Maybe I will change it because Bill Inmon is often referred to as 'The Father of Data Warehouses'.;-0)

On a practical level, you could start with a Generic Data Warehouse in line with my design and then  add a couple Data Marts for specific Enquires or categories of data in the Data Warehouse.

I would be very interested in knowing how you get on.

HTH

Barry Williams
0
 

Author Comment

by:andieje
ID: 35072804
Thanks Barry. I will look into this. How can i let you know how i a getting on. Shall i leave this post open?
0
 
LVL 1

Expert Comment

by:BarryWilliams
ID: 35075716
Hi andieje

You can email me at barryw@databaseanswers.org,

Barry

0

Featured Post

6 Surprising Benefits of Threat Intelligence

All sorts of threat intelligence is available on the web. Intelligence you can learn from, and use to anticipate and prepare for future attacks.

Join & Write a Comment

I guess that all of us know that caching the data usually increase the performance, but I worried if all of us are aware about the risk that caching the data provides and how to minimize this.  That’s the reason why I decided to write this short art…
CCModeler offers a way to enter basic information like entities, attributes and relationships and export them as yEd or erviz diagram. It also can import existing Access or SQL Server tables with relationships.
Video by: Steve
Using examples as well as descriptions, step through each of the common simple join types, explaining differences in syntax, differences in expected outputs and showing how the queries run along with the actual outputs based upon a simple set of dem…
Polish reports in Access so they look terrific. Take yourself to another level. Equations, Back Color, Alternate Back Color. Write easy VBA Code. Tighten space to use less pages. Launch report from a menu, considering criteria only when it is filled…

706 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

19 Experts available now in Live!

Get 1:1 Help Now