Solved

SQL DISTINCT shows 2 same results

Posted on 2009-07-07
9
244 Views
Last Modified: 2012-05-07
This SQL syntax shows 2 same results.
DISTINCT is not working.
What am I missing?

Thank you
SELECT DISTINCT C.CustomerID, C.FirstName, C.LastName,  C.Email, C.Password, C.Address, C.City, C.State, C.Country, C.Post, C.Phone, C.BestTimes, C.CreateDate, C.LastLogin, C.ContactPref, C.EstGiven, C.JobFini, C.Deposit, C.ActiveCust, C.CustNotes, B1.ImageID AS LatestImageID, B2.Comment AS LatestComment, B2.Poster, B2.PostDate AS Postdate FROM Customers AS C LEFT OUTER JOIN Employees AS E ON C.empID = E.empID LEFT OUTER JOIN (SELECT CustomerID, MAX(PostDate) AS MaxDate FROM blog WHERE (ImageID <> '') GROUP BY CustomerID) AS M1 ON M1.CustomerID = C.CustomerID LEFT OUTER JOIN blog AS B1 ON B1.CustomerID = M1.CustomerID AND B1.PostDate = M1.MaxDate LEFT OUTER JOIN (SELECT CustomerID, MAX(PostDate) AS MaxDate FROM blog AS blog_1 WHERE (Comment <> '') GROUP BY CustomerID) AS M2 ON M2.CustomerID = C.CustomerID LEFT OUTER JOIN blog AS B2 ON B2.CustomerID = M2.CustomerID AND B2.PostDate = M2.MaxDate WHERE (E.Username = @username) AND (C.ActiveCust = 1) ORDER BY C.LastLogin DESC

Open in new window

0
Comment
Question by:jtuttle99
  • 4
  • 4
9 Comments
 
LVL 59

Expert Comment

by:Kevin Cross
ID: 24799181
Are they exactly the same or is there one column that is different?

What is your SQL platform and version?
0
 
LVL 17

Expert Comment

by:pssandhu
ID: 24799184
When you say 2 same results, do you mean all the columns listed in the sql are repeating or most of them but there are couple that have different value.
When you do a select distinct like above that means all the values in all the columns have to same in order to be grouped into one distinct record.
P.
0
 
LVL 59

Expert Comment

by:Kevin Cross
ID: 24799208
In the interim, you can try it like this:
SELECT C.CustomerID, C.FirstName, C.LastName,  C.Email, C.Password
, C.Address, C.City, C.State, C.Country, C.Post
, C.Phone, C.BestTimes, C.CreateDate, C.LastLogin, C.ContactPref
, C.EstGiven, C.JobFini, C.Deposit, C.ActiveCust, C.CustNotes
, B1.ImageID AS LatestImageID, B2.Comment AS LatestComment, B2.Poster, B2.PostDate AS Postdate 
FROM Customers AS C 
LEFT OUTER JOIN Employees AS E ON C.empID = E.empID 
LEFT OUTER JOIN ((SELECT CustomerID, MAX(PostDate) AS MaxDate FROM blog WHERE (ImageID <> '') GROUP BY CustomerID) AS M1
	INNER JOIN blog AS B1 ON B1.CustomerID = M1.CustomerID AND B1.PostDate = M1.MaxDate) ON M1.CustomerID = C.CustomerID 
LEFT OUTER JOIN ((SELECT CustomerID, MAX(PostDate) AS MaxDate FROM blog AS blog_1 WHERE (Comment <> '') GROUP BY CustomerID) AS M2 
	INNER JOIN blog AS B2 ON B2.CustomerID = M2.CustomerID AND B2.PostDate = M2.MaxDate) ON M2.CustomerID = C.CustomerID 
WHERE (E.Username = @username) AND (C.ActiveCust = 1) 
ORDER BY C.LastLogin DESC

Open in new window

0
How our DevOps Teams Maximize Uptime

Our Dev teams are like yours. They’re continually cranking out code for new features/bugs fixes, testing, deploying, responding to production monitoring events and more. It’s complex. So, we thought you’d like to see what’s working for us. Read the use case whitepaper.

 

Author Comment

by:jtuttle99
ID: 24799506
pssandhu:
Yes, some has duplicate results and some doesn't.
The duplucate results are exactly same results.
so looks like this

john
john
mark
brad
james
james
bob



mwvisa1:
I tried your code, but I got exactly same results (some duplicate displays)

Thank you
0
 

Author Comment

by:jtuttle99
ID: 24799562
oh, I'm using SQL server 2008 express edition.
0
 
LVL 59

Expert Comment

by:Kevin Cross
ID: 24799589
Can you display the full row of two of the duplicate records, please.  That will help construct query to filter them out.  One thought with SQL Server 2008 is to use ROW_NUMBER() function with an OVER analytical statement; however, would have to know the exact columns that make the row unique/duplicate.
0
 

Author Comment

by:jtuttle99
ID: 24799639
Here is the screen shot. It's pretty long list, so I cut it half
screenshot.14.jpg
0
 
LVL 59

Accepted Solution

by:
Kevin Cross earned 500 total points
ID: 24799662
CustomerID 3873 is the duplicate record in your picture from what I can see and it has two different LastLogin values, so you can see if this gets what you want.  If it does, then you may need to group by all the columns except for the LastLogin on which you will need to use an aggregate function like MAX or MIN.

The other records all had different data in random columns despite all having first name Shiny.  If that is what you are referring to as duplicates, then you will have to decide which is the valid one to keep as DISTINCT won't work there.
SELECT C.CustomerID, C.FirstName, C.LastName,  C.Email, C.Password
, C.Address, C.City, C.State, C.Country, C.Post
, C.Phone, C.BestTimes, C.CreateDate, /*C.LastLogin,*/ C.ContactPref
, C.EstGiven, C.JobFini, C.Deposit, C.ActiveCust, C.CustNotes
, B1.ImageID AS LatestImageID, B2.Comment AS LatestComment, B2.Poster, B2.PostDate AS Postdate 
FROM Customers AS C 
LEFT OUTER JOIN Employees AS E ON C.empID = E.empID 
LEFT OUTER JOIN ((SELECT CustomerID, MAX(PostDate) AS MaxDate FROM blog WHERE (ImageID <> '') GROUP BY CustomerID) AS M1
        INNER JOIN blog AS B1 ON B1.CustomerID = M1.CustomerID AND B1.PostDate = M1.MaxDate) ON M1.CustomerID = C.CustomerID 
LEFT OUTER JOIN ((SELECT CustomerID, MAX(PostDate) AS MaxDate FROM blog AS blog_1 WHERE (Comment <> '') GROUP BY CustomerID) AS M2 
        INNER JOIN blog AS B2 ON B2.CustomerID = M2.CustomerID AND B2.PostDate = M2.MaxDate) ON M2.CustomerID = C.CustomerID 
WHERE (E.Username = @username) AND (C.ActiveCust = 1) 
ORDER BY C.LastLogin DESC

Open in new window

0
 

Author Comment

by:jtuttle99
ID: 24799855
Yes, it did work if I get rid of LastLogin.
Somehow, I got duplicate data in Customer table.
I have no idea when this happened, but I erased the table and imported again.

Thank you very much for your help!!!
0

Featured Post

Resolve Critical IT Incidents Fast

If your data, services or processes become compromised, your organization can suffer damage in just minutes and how fast you communicate during a major IT incident is everything. Learn how to immediately identify incidents & best practices to resolve them quickly and effectively.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Introduction Hopefully the following mnemonic and, ultimately, the acronym it represents is common place to all those reading: Please Excuse My Dear Aunt Sally (PEMDAS). Briefly, though, PEMDAS is used to signify the order of operations (http://en.…
Occasionally there is a need to clean table columns, especially if you have inherited legacy data. There are obviously many ways to accomplish that, including elaborate UPDATE queries with anywhere from one to numerous REPLACE functions (even within…
Microsoft Active Directory, the widely used IT infrastructure, is known for its high risk of credential theft. The best way to test your Active Directory’s vulnerabilities to pass-the-ticket, pass-the-hash, privilege escalation, and malware attacks …
This video shows how to quickly and easily add an email signature for all users on Exchange 2016. The resulting signature is applied on a server level by Exchange Online. The email signature template has been downloaded from: www.mail-signatures…

828 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question