Solved

Let's talk about query performance

Posted on 2014-12-09
3
110 Views
Last Modified: 2014-12-24
I have a question about query performance: retrieving values in the query with a pivot or left join versus retrieving them on the row of an ItemDataBound in the grid:

To get my grid values, I can do a "select * from UserProfile where ..."

I have a several fields in a table with responses that I would use a PIVOT or left join to create other columns:
like:
UserName   Age    City    State   Zip Haircolor
These are all in a responses table (these are examples, there are numerous responses); but none of these are in the UserProfile table. Each has its own row in the responses table.

As I said, I could use a pivot to create the query, or I could instead, when binding the grid, on the itembound go look up the data for that one row's user and display it in the grid at that time.

I'm thinking this will be better performance, because my grid will display maybe 100-500 results to a page, whereas, if I put this in a pivot, it will do it for every single record in the select clause, which could be maybe 5000 or 50,000 or whatever it gets to.

Also, in doing this, I might want to add to my main query some filtering, like:
select * from userprofile where exists (select 1 from ResponseTable where userprofile.userprofileid = ResponseTable .userprofileId and ResponseTypeId = 32)

So I *AM* going to be adding some subqueries to the actual query for filtering, but I don't need to really do this for some of the displayed fields such as, in my example, city, hair color (they won't be in the search filter). So entirely leaving out all the desired display results from the query and only using the exists clause on the search filters, plus adding the display data to the grid on load by doing queries at that time, seems to me would be the better performance.

I will probably look up about 6-10 values for each row that is displayed to the screen on the ItemDataBound; as opposed to putting PIVOT subqueries or even left joins on each of these 6-10 values:

For example, here's an actual query with only 2 of these values using a left join:
select username,
qaCity.textanswer as MyCity,
lvRace.ListValueName as MyRace
 from userprofile 
 left join qaset on qaset.userprofileid = userprofile.userprofileid
left join qafield qaCity 
  on qaset.qasetid = qaCity.qasetid
  and qaCity.questionvalueid = 34

  left join qaList qaRace 
  on qaset.qasetid = qaRace.qasetid
  and qaRace.questionvalueid = 32
    left join ListValue lvRace 
  on lvRace.ListValueId = qaRace.ListValueId
  where username <> ''

Open in new window


What do you think? What's the best performance method? 100 rows in the grid, or all 5000 rows in the query?

thanks.
0
Comment
Question by:BobCSD
3 Comments
 
LVL 49

Accepted Solution

by:
Gustav Brock earned 167 total points
Comment Utility
I believe the latter but nothing is shure. So much depends, and no one knows your details.

This is one of the type of questions where I recommend: Why not just check out both methods? It cannot take many hours, and then you have firm knowledge.

/gustav
0
 
LVL 32

Assisted Solution

by:Stefan Hoffmann
Stefan Hoffmann earned 167 total points
Comment Utility
Please rephrase your question. What performance do you want to look at?

When it's about query performance, than it depends on your SQL Server instance. Especially cold buffers vs. hot buffers and proper indexing. Here it makes often no difference whether you generate the pivot here or return only the partial datasets. Often means: You need to test and measure it. There is no rule of thumb.

When it's about the overall performance, then calculating the pivot or an appropriate single resultset makes sense. Cause this reduces the round-trips from your application to the SQL Server. btw, your describtion does not sound like a pivot (changing rows to columns). It sounds like simply adding columns to the result set from different tables.

I don't understand your different cardinality estimates.

Can you give us a concise and complete example. Especially how does your data model looks like?
SELECT  username ,
        qaCity.textanswer AS MyCity ,
        lvRace.ListValueName AS MyRace
FROM    userprofile
        LEFT JOIN qaset ON qaset.userprofileid = userprofile.userprofileid
        LEFT JOIN qafield qaCity ON qaset.qasetid = qaCity.qasetid AND qaCity.questionvalueid = 34
        LEFT JOIN qaList qaRace ON qaset.qasetid = qaRace.qasetid AND qaRace.questionvalueid = 32
        LEFT JOIN ListValue lvRace ON lvRace.ListValueId = qaRace.ListValueId
WHERE   username <> ''

Open in new window

0
 
LVL 96

Assisted Solution

by:Bob Learned
Bob Learned earned 166 total points
Comment Utility
Query optimization is part art and part science, and you can't even begin to optimize until we know what you are working with.
0

Featured Post

Highfive Gives IT Their Time Back

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

Join & Write a Comment

Parsing a CSV file is a task that we are confronted with regularly, and although there are a vast number of means to do this, as a newbie, the field can be confusing and the tools can seem complex. A simple solution to parsing a customized CSV fi…
Wouldn’t it be nice if you could test whether an element is contained in an array by using a Contains method just like the one available on List objects? Wouldn’t it be good if you could write code like this? (CODE) In .NET 3.5, this is possible…
In this seventh video of the Xpdf series, we discuss and demonstrate the PDFfonts utility, which lists all the fonts used in a PDF file. It does this via a command line interface, making it suitable for use in programs, scripts, batch files — any pl…
This video gives you a great overview about bandwidth monitoring with SNMP and WMI with our network monitoring solution PRTG Network Monitor (https://www.paessler.com/prtg). If you're looking for how to monitor bandwidth using netflow or packet s…

728 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

15 Experts available now in Live!

Get 1:1 Help Now