Solved

Maintaining large views

Posted on 2008-11-03
5
191 Views
Last Modified: 2013-11-16
Hi,

I need to maintain 1 million rows that contain calculations (Data in TableA x Data in TableB) .  If it was a smaller amount of rows I would most probably just use a view so if the data in TableA changed the view would automatically be maintained.

As the amount of rows in the view would be around a million I would guess this is not the most efficient way of doing things?

Question is what is the best way to maintain this amount of calculations.  The data in TableA and/or TableB will change frequently and the view (or what ever someone proposes??) will need to be updated to reflect the changes to TableA & B.

Thanks

nutnut

Andrew
0
Comment
Question by:nutnut
  • 3
  • 2
5 Comments
 
LVL 22

Expert Comment

by:PedroCGD
ID: 22866609
Processing the OLAP Cube from a view could take more time but will automatizate more...
If you have too many rows and the process is taking to mutch time, create a temp table with all the calculation made on it...

Fo example you can create a SSIS package to create some calculations and increment the results into the temp table and process the cube based on this temp table. all done inside a SSIS package.

Helped?
regards!
Pedro

www.pedrocgd.blogspot.com
0
 

Author Comment

by:nutnut
ID: 22866647
Hi Pedro,

Is there a better way than using a view.  The view will have 1,000,000+ rows.  If one row calculation changes the whole view will need to be refreshed which doesn't seem very efficient to me?
0
 
LVL 22

Expert Comment

by:PedroCGD
ID: 22866669
The only problem is the process time of the cube, after that the performance is not affected... you take time to process data, but to visualize it is fast.. depend in your requirements.
On million rows for your view take mutch time?

In spite of creating a view you can do that using a SSIS package...
Regards
0
 

Author Comment

by:nutnut
ID: 22868662
What would I do in an SSIS package.   I understand SSIS but what would the steps be please
0
 
LVL 22

Accepted Solution

by:
PedroCGD earned 500 total points
ID: 22868847
depend on the calculations you do in your view... but the goal to minimize the calculations...
Try to use a temp table...
but with one million rows in the view are you having problems?!
regards
0

Featured Post

Master Your Team's Linux and Cloud Stack

Come see why top tech companies like Mailchimp and Media Temple use Linux Academy to build their employee training programs.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article describes how to use the timestamp of existing data in a database to allow Tableau to calculate the prior work day instead of relying on case statements or if statements to calculate the days of the week.
Never store passwords in plain text or just their hash: it seems a no-brainier, but there are still plenty of people doing that. I present the why and how on this subject, offering my own real life solution that you can implement right away, bringin…
Video by: Steve
Using examples as well as descriptions, step through each of the common simple join types, explaining differences in syntax, differences in expected outputs and showing how the queries run along with the actual outputs based upon a simple set of dem…
Polish reports in Access so they look terrific. Take yourself to another level. Equations, Back Color, Alternate Back Color. Write easy VBA Code. Tighten space to use less pages. Launch report from a menu, considering criteria only when it is filled…

860 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question