Solved

SQL DISTINCT shows 2 same results

Posted on 2009-07-07
9
235 Views
Last Modified: 2012-05-07
This SQL syntax shows 2 same results.
DISTINCT is not working.
What am I missing?

Thank you
SELECT DISTINCT C.CustomerID, C.FirstName, C.LastName,  C.Email, C.Password, C.Address, C.City, C.State, C.Country, C.Post, C.Phone, C.BestTimes, C.CreateDate, C.LastLogin, C.ContactPref, C.EstGiven, C.JobFini, C.Deposit, C.ActiveCust, C.CustNotes, B1.ImageID AS LatestImageID, B2.Comment AS LatestComment, B2.Poster, B2.PostDate AS Postdate FROM Customers AS C LEFT OUTER JOIN Employees AS E ON C.empID = E.empID LEFT OUTER JOIN (SELECT CustomerID, MAX(PostDate) AS MaxDate FROM blog WHERE (ImageID <> '') GROUP BY CustomerID) AS M1 ON M1.CustomerID = C.CustomerID LEFT OUTER JOIN blog AS B1 ON B1.CustomerID = M1.CustomerID AND B1.PostDate = M1.MaxDate LEFT OUTER JOIN (SELECT CustomerID, MAX(PostDate) AS MaxDate FROM blog AS blog_1 WHERE (Comment <> '') GROUP BY CustomerID) AS M2 ON M2.CustomerID = C.CustomerID LEFT OUTER JOIN blog AS B2 ON B2.CustomerID = M2.CustomerID AND B2.PostDate = M2.MaxDate WHERE (E.Username = @username) AND (C.ActiveCust = 1) ORDER BY C.LastLogin DESC

Open in new window

0
Comment
Question by:jtuttle99
  • 4
  • 4
9 Comments
 
LVL 59

Expert Comment

by:Kevin Cross
ID: 24799181
Are they exactly the same or is there one column that is different?

What is your SQL platform and version?
0
 
LVL 17

Expert Comment

by:pssandhu
ID: 24799184
When you say 2 same results, do you mean all the columns listed in the sql are repeating or most of them but there are couple that have different value.
When you do a select distinct like above that means all the values in all the columns have to same in order to be grouped into one distinct record.
P.
0
 
LVL 59

Expert Comment

by:Kevin Cross
ID: 24799208
In the interim, you can try it like this:
SELECT C.CustomerID, C.FirstName, C.LastName,  C.Email, C.Password

, C.Address, C.City, C.State, C.Country, C.Post

, C.Phone, C.BestTimes, C.CreateDate, C.LastLogin, C.ContactPref

, C.EstGiven, C.JobFini, C.Deposit, C.ActiveCust, C.CustNotes

, B1.ImageID AS LatestImageID, B2.Comment AS LatestComment, B2.Poster, B2.PostDate AS Postdate 

FROM Customers AS C 

LEFT OUTER JOIN Employees AS E ON C.empID = E.empID 

LEFT OUTER JOIN ((SELECT CustomerID, MAX(PostDate) AS MaxDate FROM blog WHERE (ImageID <> '') GROUP BY CustomerID) AS M1

	INNER JOIN blog AS B1 ON B1.CustomerID = M1.CustomerID AND B1.PostDate = M1.MaxDate) ON M1.CustomerID = C.CustomerID 

LEFT OUTER JOIN ((SELECT CustomerID, MAX(PostDate) AS MaxDate FROM blog AS blog_1 WHERE (Comment <> '') GROUP BY CustomerID) AS M2 

	INNER JOIN blog AS B2 ON B2.CustomerID = M2.CustomerID AND B2.PostDate = M2.MaxDate) ON M2.CustomerID = C.CustomerID 

WHERE (E.Username = @username) AND (C.ActiveCust = 1) 

ORDER BY C.LastLogin DESC

Open in new window

0
 

Author Comment

by:jtuttle99
ID: 24799506
pssandhu:
Yes, some has duplicate results and some doesn't.
The duplucate results are exactly same results.
so looks like this

john
john
mark
brad
james
james
bob



mwvisa1:
I tried your code, but I got exactly same results (some duplicate displays)

Thank you
0
Highfive Gives IT Their Time Back

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

 

Author Comment

by:jtuttle99
ID: 24799562
oh, I'm using SQL server 2008 express edition.
0
 
LVL 59

Expert Comment

by:Kevin Cross
ID: 24799589
Can you display the full row of two of the duplicate records, please.  That will help construct query to filter them out.  One thought with SQL Server 2008 is to use ROW_NUMBER() function with an OVER analytical statement; however, would have to know the exact columns that make the row unique/duplicate.
0
 

Author Comment

by:jtuttle99
ID: 24799639
Here is the screen shot. It's pretty long list, so I cut it half
screenshot.14.jpg
0
 
LVL 59

Accepted Solution

by:
Kevin Cross earned 500 total points
ID: 24799662
CustomerID 3873 is the duplicate record in your picture from what I can see and it has two different LastLogin values, so you can see if this gets what you want.  If it does, then you may need to group by all the columns except for the LastLogin on which you will need to use an aggregate function like MAX or MIN.

The other records all had different data in random columns despite all having first name Shiny.  If that is what you are referring to as duplicates, then you will have to decide which is the valid one to keep as DISTINCT won't work there.
SELECT C.CustomerID, C.FirstName, C.LastName,  C.Email, C.Password

, C.Address, C.City, C.State, C.Country, C.Post

, C.Phone, C.BestTimes, C.CreateDate, /*C.LastLogin,*/ C.ContactPref

, C.EstGiven, C.JobFini, C.Deposit, C.ActiveCust, C.CustNotes

, B1.ImageID AS LatestImageID, B2.Comment AS LatestComment, B2.Poster, B2.PostDate AS Postdate 

FROM Customers AS C 

LEFT OUTER JOIN Employees AS E ON C.empID = E.empID 

LEFT OUTER JOIN ((SELECT CustomerID, MAX(PostDate) AS MaxDate FROM blog WHERE (ImageID <> '') GROUP BY CustomerID) AS M1

        INNER JOIN blog AS B1 ON B1.CustomerID = M1.CustomerID AND B1.PostDate = M1.MaxDate) ON M1.CustomerID = C.CustomerID 

LEFT OUTER JOIN ((SELECT CustomerID, MAX(PostDate) AS MaxDate FROM blog AS blog_1 WHERE (Comment <> '') GROUP BY CustomerID) AS M2 

        INNER JOIN blog AS B2 ON B2.CustomerID = M2.CustomerID AND B2.PostDate = M2.MaxDate) ON M2.CustomerID = C.CustomerID 

WHERE (E.Username = @username) AND (C.ActiveCust = 1) 

ORDER BY C.LastLogin DESC

Open in new window

0
 

Author Comment

by:jtuttle99
ID: 24799855
Yes, it did work if I get rid of LastLogin.
Somehow, I got duplicate data in Customer table.
I have no idea when this happened, but I erased the table and imported again.

Thank you very much for your help!!!
0

Featured Post

IT, Stop Being Called Into Every Meeting

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

Join & Write a Comment

Suggested Solutions

Title # Comments Views Activity
What does this SQL mean? 7 41
SQL Select Help with xml tags in a text field 9 28
Oracle Subquery bad Join 11 46
SQL query 4 31
'Between' is such a common word we rarely think about it but in SQL it has a very specific definition we should be aware of. While most database vendors will have their own unique phrases to describe it (see references at end) the concept in common …
PL/SQL can be a very powerful tool for working directly with database tables. Being able to loop will allow you to perform more complex operations, but can be a little tricky to write correctly. This article will provide examples of basic loops alon…
This demo shows you how to set up the containerized NetScaler CPX with NetScaler Management and Analytics System in a non-routable Mesos/Marathon environment for use with Micro-Services applications.
This tutorial demonstrates a quick way of adding group price to multiple Magento products.

747 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

11 Experts available now in Live!

Get 1:1 Help Now