• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 145
  • Last Modified:

Let's talk about query performance

I have a question about query performance: retrieving values in the query with a pivot or left join versus retrieving them on the row of an ItemDataBound in the grid:

To get my grid values, I can do a "select * from UserProfile where ..."

I have a several fields in a table with responses that I would use a PIVOT or left join to create other columns:
UserName   Age    City    State   Zip Haircolor
These are all in a responses table (these are examples, there are numerous responses); but none of these are in the UserProfile table. Each has its own row in the responses table.

As I said, I could use a pivot to create the query, or I could instead, when binding the grid, on the itembound go look up the data for that one row's user and display it in the grid at that time.

I'm thinking this will be better performance, because my grid will display maybe 100-500 results to a page, whereas, if I put this in a pivot, it will do it for every single record in the select clause, which could be maybe 5000 or 50,000 or whatever it gets to.

Also, in doing this, I might want to add to my main query some filtering, like:
select * from userprofile where exists (select 1 from ResponseTable where userprofile.userprofileid = ResponseTable .userprofileId and ResponseTypeId = 32)

So I *AM* going to be adding some subqueries to the actual query for filtering, but I don't need to really do this for some of the displayed fields such as, in my example, city, hair color (they won't be in the search filter). So entirely leaving out all the desired display results from the query and only using the exists clause on the search filters, plus adding the display data to the grid on load by doing queries at that time, seems to me would be the better performance.

I will probably look up about 6-10 values for each row that is displayed to the screen on the ItemDataBound; as opposed to putting PIVOT subqueries or even left joins on each of these 6-10 values:

For example, here's an actual query with only 2 of these values using a left join:
select username,
qaCity.textanswer as MyCity,
lvRace.ListValueName as MyRace
 from userprofile 
 left join qaset on qaset.userprofileid = userprofile.userprofileid
left join qafield qaCity 
  on qaset.qasetid = qaCity.qasetid
  and qaCity.questionvalueid = 34

  left join qaList qaRace 
  on qaset.qasetid = qaRace.qasetid
  and qaRace.questionvalueid = 32
    left join ListValue lvRace 
  on lvRace.ListValueId = qaRace.ListValueId
  where username <> ''

Open in new window

What do you think? What's the best performance method? 100 rows in the grid, or all 5000 rows in the query?

Starr Duskk
Starr Duskk
3 Solutions
Gustav BrockCIOCommented:
I believe the latter but nothing is shure. So much depends, and no one knows your details.

This is one of the type of questions where I recommend: Why not just check out both methods? It cannot take many hours, and then you have firm knowledge.

ste5anSenior DeveloperCommented:
Please rephrase your question. What performance do you want to look at?

When it's about query performance, than it depends on your SQL Server instance. Especially cold buffers vs. hot buffers and proper indexing. Here it makes often no difference whether you generate the pivot here or return only the partial datasets. Often means: You need to test and measure it. There is no rule of thumb.

When it's about the overall performance, then calculating the pivot or an appropriate single resultset makes sense. Cause this reduces the round-trips from your application to the SQL Server. btw, your describtion does not sound like a pivot (changing rows to columns). It sounds like simply adding columns to the result set from different tables.

I don't understand your different cardinality estimates.

Can you give us a concise and complete example. Especially how does your data model looks like?
SELECT  username ,
        qaCity.textanswer AS MyCity ,
        lvRace.ListValueName AS MyRace
FROM    userprofile
        LEFT JOIN qaset ON qaset.userprofileid = userprofile.userprofileid
        LEFT JOIN qafield qaCity ON qaset.qasetid = qaCity.qasetid AND qaCity.questionvalueid = 34
        LEFT JOIN qaList qaRace ON qaset.qasetid = qaRace.qasetid AND qaRace.questionvalueid = 32
        LEFT JOIN ListValue lvRace ON lvRace.ListValueId = qaRace.ListValueId
WHERE   username <> ''

Open in new window

Bob LearnedCommented:
Query optimization is part art and part science, and you can't even begin to optimize until we know what you are working with.
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

Join & Write a Comment

Featured Post

Free Tool: ZipGrep

ZipGrep is a utility that can list and search zip (.war, .ear, .jar, etc) archives for text patterns, without the need to extract the archive's contents.

One of a set of tools we're offering as a way to say thank you for being a part of the community.

Tackle projects and never again get stuck behind a technical roadblock.
Join Now