July 6, 2008 09:14pm pdt

1. angelIII 583,340
2. ee_rlee 458,453
3. capricorn1 255,796
4. chapmandew 248,743
5. mark_wills 233,048
6. matthews... 180,346
7. jinesh_k... 167,181
8. aneeshat... 166,457
9. Thomasian 163,576
10. jimhorn 98,110
11. harfang 91,063
12. sdstuber 90,232
13. frankytee 85,844
14. DatabaseMX 83,167
15. TextReport 81,395

1. angelIII 1,328,673
2. capricorn1 589,908
3. matthews... 470,257
4. ee_rlee 458,453
5. aneeshat... 377,164
6. chapmandew 248,743
7. mark_wills 233,048
8. imitchie 215,310
9. harfang 201,843
10. dqmq 193,080
11. DatabaseMX 192,239
12. jinesh_k... 183,470
13. jimhorn 178,630
14. peter57r 178,484
15. GRayL 172,885

05.09.2008 at 05:40PM PDT, ID: 23391133

	[x] Attachment Details

[x]

The Solution Rating System

With so many solutions, how can you tell which solutions are most likely to help you and which ones are not? To provide you with a tool to use, we rate our solutions based on various elements that most accurately determine if a solution is a quality solution. To explain what factors affect the solution rating, here are the elements we take into consideration when formulating our solution rating.

The Grade of the Solution
The Zone Rank of the Expert Providing the Solution
The Number of Author and Expert Comments
The Number of Experts Contributing
The Feedback of the Community

Your Input Matters
Because of the way the system is set up, the most important variable in this equation is you. As a member of Experts Exchange, you are able to cast your vote on the quality of the solutions in regard to how complete, accurate, helpful and easy to understand each solution is. When you provide your feedback, each rating is adjusted accordingly. So, if you see a solution that has a poor rating that you think is a good solution, let us know by rating it. As you do, the rating will be adjusted and will become more accurate for other members of our site.

If you have any suggestions that you would like to make for our rating system, please ask a question in the Suggestions Zone of Community Support.

Thank you!

8.9

Query to find duplicate in one field AND non-duplicate in another

Zones: Access Coding/Macros, Databases Miscellaneous, SQL Query Syntax

Tags: Microsoft, Access, 2007

I have 4 fields to evaluate: Vendor ID, Invoice Number, Invoice Date and Invoice Amount.
I am trying to write a query that will return all rows where 3 of those 4 fields are identical, but 1 of the 4 is not. For example, where vendor ID, invoice number and invoice amount are the same, but the invoice date is not the same. Any assistance would be awesome. thanks!

Start your free trial to view this solution

Question Stats

Zone: Programming

Question Asked By: lanndo

Solution Provided By: Thomasian

Participating Experts: 3

Solution Grade: A

Translate:

Loading Advertisement...

Microsoft

Internet Protocols
Applications

Development
OS

Hardware
Windows Security

Apple

Operating Systems
Hardware

Programming
Networking

Software

Internet

Search Engines
File Sharing
WebTrends / Stats
Spy / Ad Blockers

Web Browsers
New Net Users
Web Development
Chat / IM

Anti Spam
Web Servers
Anti-Virus
Email Clients

Gamers

Tips
Online / MMORPG
Puzzle
Emulators

Action / Adventure
Role Playing
Consoles
Game Programming

Strategy
Sports
Misc
Computer Games

Digital Living

Hardware
New Net Users
New Users

Software
Digital Music
Gaming World

Home Security
Apple
Networking Hardware

Virus & Spyware

Vulnerabilities
IDS
Encryption
Anti-Virus

Operating Systems Security
Software Firewalls
WebApplications
Cell Phones

Operating Systems
Internet
Hardware Firewalls

Hardware

Handhelds / PDAs
Displays / Monitors
Components
Networking Hardware

Peripherals
Laptops/Notebooks
Storage
Servers

Desktops
New Users
Misc
Apple

Software

System Utilities
Industry Specific
Network Management
Photos / Graphics
Page Layout
VMWare
Misc
Web Development

OS
CYGWIN
Voice Recognition
Message Queue
Quality Assurance
Security
Firewalls
MultiMedia Applications

Development
Database
Office / Productivity
Business Management
OS/2 Apps
Server Software
Internet / Email

ITPro

OS
Storage
Encryption
Operating Systems Security
Apple Hardware
Laptops & Notebooks
Servers
Networking Hardware
Peripherals

Devices
Displays / Monitors
WebTrends / Stats
Search Engines
Firewalls
WebApplications
IDS
Vulnerabilities
Email Clients

File Sharing
Spy / Ad Blockers
Web Browsers
Web Servers
Networking
Anti-Virus
Chat / IM
Anti Spam

Developer

Web Servers
Web Browsers
Game Programming
Dev Tools
Industry Specific
Office / Productivity

Database
CYGWIN
Web Development
Search Engines
File Sharing
WebTrends / Stats

Programming
Content Management
Application Servers
Protocols

Storage

Removable Backup Media
Storage Technology
Servers

Grid
Remote Access
Backup / Restore

Misc
Hard Drives

Miscellaneous
Security
Development
Linux
VMWare

MainFrame OS
Unix
Apple
OS / 2
AS / 400

BeOS
Microsoft
VMS / OpenVMS

Database

Oracle
Miscellaneous
MySQL
Software
Sybase
Contact Management
PostgreSQL
Data Manipulation
Clarion
InterSystems Cache

Siebel
MUMPS
OLAP
SQLBase
SAS
GIS & GPS
4GL
Berkeley DB
DB2
Informix

Interbase / Firebird
FoxPro
Reporting
LDAP
Filemaker Pro
MS SQL Server
dBase
MS Access

Security

Misc
Web Browsers
Software Firewalls
Operating Systems Security
File Sharing

Spy / Ad Blockers
Vulnerabilities
WebApplications
IDS
Anti-Virus

Encryption
Anti Spam
Email Clients
VPN
Chat / IM

Programming

Editors IDEs
Installation
Handhelds / PDAs
Multimedia Programming
System / Kernel

Algorithms
Game
Signal Processing
Project Management
Open Source

Database
Misc
Languages
Processor Platforms
Theory

Web Development

Scripting
Blogs
Web Servers
Software
Search Engines
Web Graphics
Images

Internet Marketing
Images and Photos
Components
Document Imaging
Web Languages/Standards
Illustration
WebApplications

Fonts
WebTrends / Stats
Authoring
Digital Camera Software
Miscellaneous

Networking

Protocols
Apple Networking
Network Management
Message Queue
Application Servers
Content Management
File Servers
Email Servers
Misc
Java Editors & IDEs

Wireless
Networking Hardware
Backup / Restore
System Utilities
ISPs & Hosting
Web Servers
Storage Technology
Removable Backup Media
Servers
Broadband

Grid
OS / 2
Novell Netware
Unix Networking
Windows Networking
Security
Telecommunications
Operating Systems
Linux Networking

Other

Community Advisor
Lounge
Community Support
New Net Users

Philosophy / Religion
Math / Science
Miscellaneous
URLs

Expert Lounge
Politics
Puzzles / Riddles

Community Support

Suggestions
New to EE
New Topics
Community Advisor

CleanUp
Announcements
General

Feedback
Input
EE Bugs

05.09.2008 at 06:29PM PDT, ID: 21537495

YetiNZ:

                       
         
           
           
             SELECT	Table1.VendorId,
	Table1.InvoiceNumber,
	Table1.InvoiceAmount,
	Table1.InvoiceDate
FROM	Table1
	INNER JOIN (	SELECT	Table1.VendorId,
				Table1.InvoiceNumber,
				Table1.InvoiceAmount
			FROM	Table1
			GROUP BY	Table1.VendorId,
					Table1.InvoiceNumber,
					Table1.InvoiceAmount
			HAVING	Count(Table1.InvoiceDate)>1) t2
	ON	Table1.VendorId=t2.VendorId
	AND	Table1.InvoiceNumber=t2.InvoiceNumber
	AND	Table1.InvoiceAmount=t2.InvoiceAmount

           
         

Open in New Window

05.09.2008 at 07:09PM PDT, ID: 21537571

Rank: Wizard

harfang:

This is one weird query... Make sure to index all four fields before attempting that. I also have the feeling that [Invoice Number] should be unique in this table.

(°v°)

                       
         
           
             1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
20:
21:
22:
23:
24:
25:
26:
27:
28:
29:

           
           
             SELECT * FROM YourTable A
WHERE Exists (
    SELECT True FROM YourTable
    WHERE [Vendor ID]      = A.[Vendor ID]
      AND [Invoice Number] = A.[Invoice Number]
      AND [Invoice Date]   = A.[Invoice Date]
      AND [Invoice Amount]<> A.[Invoice Amount]
    )
   OR Exists (
    SELECT True FROM YourTable
    WHERE [Vendor ID]      = A.[Vendor ID]
      AND [Invoice Number] = A.[Invoice Number]
      AND [Invoice Date]  <> A.[Invoice Date]
      AND [Invoice Amount] = A.[Invoice Amount]
    )
   OR Exists (
    SELECT True FROM YourTable
    WHERE [Vendor ID]      = A.[Vendor ID]
      AND [Invoice Number]<> A.[Invoice Number]
      AND [Invoice Date]   = A.[Invoice Date]
      AND [Invoice Amount] = A.[Invoice Amount]
    )
   OR Exists (
    SELECT True FROM YourTable
    WHERE [Vendor ID]     <> A.[Vendor ID]
      AND [Invoice Number] = A.[Invoice Number]
      AND [Invoice Date]   = A.[Invoice Date]
      AND [Invoice Amount] = A.[Invoice Amount]
    )

           
         

Open in New Window

05.09.2008 at 09:00PM PDT, ID: 21537808

Rank: Guru

Thomasian:

hi lanndo,

Boolean expression will return -1 for true and 0 for false. You can just add the result of the 4 conditions and if the result is -3, then 3 out of 4 is true.

                       
             SELECT A.*
FROM
  Tablename A,  Tablename B 
WHERE
  (A.[Vendor ID]=B.[Vendor ID]) +
  (A.[Invoice Number]=B.[Invoice Number]) +
  (A.[Invoice Date]=B.[Invoice Date]) +
  (A.[Invoice Amount]=B.[Invoice Amount])=-3

Open in New Window

05.09.2008 at 09:05PM PDT, ID: 21537815

Rank: Wizard

harfang:

Tomasian, that was my first idea, too... then I though: Cartesian produce, expression in a WHERE clause, no way to use any index... and wrote the other one. -- (^v°)

05.09.2008 at 09:05PM PDT, ID: 21537816

Rank: Guru

Thomasian:

You would also need to add distinct otherwise you would see duplicate results.

SELECT DISTINCT A.*
.....

05.09.2008 at 09:55PM PDT, ID: 21537900

Rank: Guru

Thomasian:

>Cartesian produce, expression in a WHERE clause, no way to use any index
Interesting, I didn't know that.. When can't an index be used? Will it make a difference if it is changed to INNER JOIN...ON... syntax?

05.10.2008 at 07:36AM PDT, ID: 21539168

lanndo:

Thanks for the help, I think we are getting there! For this solution above:
SELECT * FROM YourTable A
WHERE Exists (
SELECT True FROM YourTable
WHERE [Vendor ID] = A.[Vendor ID]
AND [Invoice Number] = A.[Invoice Number]
AND [Invoice Date] = A.[Invoice Date]
AND [Invoice Amount]<> A.[Invoice Amount]
)
ect

Not sure what A. reference is, though the idea is what I am looking for (need four separate queries really, one to identify which of the 4 is not the same. This is for a fraud investigation, so while InvNum should not be duplicated, in this case that is what we are looking for.

On the boolean expression: Is there away to determine which of the 4 caused the difference,?

Thanks again for the help!

05.10.2008 at 09:57PM PDT, ID: 21541519

Rank: Guru

Thomasian:

You can have a query for each field that is different and union them. Note that using this method, a record will be returned twice if there are two records which have the same values on 3 fields but the field that they differ is not the same.

                       
         
           
             1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
20:
21:
22:
23:
24:
25:
26:
27:
28:
29:
30:
31:
32:
33:
34:
35:
36:
37:
38:
39:
40:
41:

           
           
             SELECT "Vendor ID" as DiffField, A.* FROM YourTable A
WHERE Exists (
    SELECT True FROM YourTable
    WHERE [Vendor ID]     <> A.[Vendor ID]
      AND [Invoice Number] = A.[Invoice Number]
      AND [Invoice Date]   = A.[Invoice Date]
      AND [Invoice Amount] = A.[Invoice Amount]
    )
 
UNION ALL
 
SELECT "Invoice Number" as DiffField, A.* FROM YourTable A
WHERE Exists (
    SELECT True FROM YourTable
    WHERE [Vendor ID]      = A.[Vendor ID]
      AND [Invoice Number]<> A.[Invoice Number]
      AND [Invoice Date]   = A.[Invoice Date]
      AND [Invoice Amount] = A.[Invoice Amount]
    )
 
UNION ALL
 
SELECT "Invoice Date" as DiffField, A.* FROM YourTable A
WHERE Exists (
    SELECT True FROM YourTable
    WHERE [Vendor ID]      = A.[Vendor ID]
      AND [Invoice Number] = A.[Invoice Number]
      AND [Invoice Date]  <> A.[Invoice Date]
      AND [Invoice Amount] = A.[Invoice Amount]
    )
 
UNION ALL
 
SELECT "Invoice Amount" as DiffField, A.* FROM YourTable A
WHERE Exists (
    SELECT True FROM YourTable
    WHERE [Vendor ID]      = A.[Vendor ID]
      AND [Invoice Number] = A.[Invoice Number]
      AND [Invoice Date]   = A.[Invoice Date]
      AND [Invoice Amount]<> A.[Invoice Amount]
    )

           
         

Open in New Window

Accepted Solution

05.12.2008 at 02:44PM PDT, ID: 21550768

Rank: Wizard

harfang:

I was away over the weekend.

> When can't an index be used?

Much effort has been put into optimizing queries. All modern SQL engines will entirely take apart the FROM, JOIN and WHERE clauses to create an efficient execution plan (this also means that synonymous SQL sentences should be treated the same way, e.g. switching between WHERE and JOIN). The more and the better indexes are used, the faster is the query. For this to happen, ever criterion (JOIN or WHERE) needs to have the form:

<field name> <operator> <constant / field name>

The special operators 'Between / And', 'In', 'Is', 'Any', 'All', 'Exists', and even 'Like' (provided the pattern does not start with a wildcard) can also be optimized this way. Several criteria can be combined using only AND and OR. If multi-field indexes exist, one of them may be better suited for a certain combination of criteria; in some cases, the engine might also decide to create temporary indexes. In this context, a constant means constant over the scope of the query: it can be calculated, but not calculated from another field.

In your query, if there are 10'000 records, the engine will have to perform 100'000'000 operations, and hold the result in memory.

> need four separate queries really

You can then use only one of the 'Exists' expressions. These would be the four queries between the UNION ALL lines in Thomasian's last post.

(°v°)

05.12.2008 at 11:42PM PDT, ID: 21552728

Rank: Guru

Thomasian:

I see.. Thanks!

05.19.2008 at 09:34AM PDT, ID: 21599287

lanndo:

Thank you for the responses, using the solution with UNIONs worked great, and I was able to detect the items matching those criteria. Rather than using a UNION to show all results at once, I used 4 separate queries. Thank you to all who helped with this!

20080236-EE-VQP-29 / EE_QW_2_20070628