Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people, just like you, are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
Solved

Identifying (similar) Names and Addresses

Posted on 2014-02-10
2
278 Views
Last Modified: 2014-02-10
Hi,

I have 50,000 names and addresses from multiple sources.

The wil be at least 30% duplication.

I.e. One specific name and address may be there more than once but many NOT be 100% identical.

E.g.
John Smith, 1 High Street, London
John Smith, 1 The High Street London

Can anyone guide me to a utility which would identify names/addresses that are not quite 100% matched.

Any thoughts out there?
0
Comment
Question by:Patrick O'Dea
2 Comments
 
LVL 84

Accepted Solution

by:
Scott McDaniel (Microsoft Access MVP - EE MVE ) earned 500 total points
ID: 39847423
That's going to be difficult to do.

You could use something like a Soundex algorithm to "rank" each one compared to the others. Essentially this would give you the greatest chance of duplicates for each entry, and you could then decide what to do with them.

Here's the wikipedia take on the Soundex stuff: http://en.wikipedia.org/wiki/Soundex

Essentially it involves replacing the characters in a string with numeric values, and then comparing the results. There are many different types of these algorithms, for various purposes. One example is this:

Consider the word "Cranston"

You keep the first letter ("C"), and then remove all other vowels, and any occurrence of letters y, h and w, so you're left with this:

Crnstn

You then assign values to the next 3 items. Using the wikipedia method, that would be:

C652

The letter "r" is = 6, the letter "n" is = 5 and the letter "s" = 2.

You'd do the same for all the strings (and you could go out further than 3 letters if you'd prefer), and store this value in a column in that table. You then sort by that column, and you can see immediately which strings are most closely related.

Allen browne has one here: http://allenbrowne.com/vba-Soundex.html. It uses a setup very much like what is described in the wikipedia link.
0
 

Author Closing Comment

by:Patrick O'Dea
ID: 39848501
Thanks, I will experiment.  (I heard about soundex years ago).
0

Featured Post

Enterprise Mobility and BYOD For Dummies

Like “For Dummies” books, you can read this in whatever order you choose and learn about mobility and BYOD; and how to put a competitive mobile infrastructure in place. Developed for SMBs and large enterprises alike, you will find helpful use cases, planning, and implementation.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

CCModeler offers a way to enter basic information like entities, attributes and relationships and export them as yEd or erviz diagram. It also can import existing Access or SQL Server tables with relationships.
Using SQL Scripts we can save all the SQL queries as files that we use very frequently on our database later point of time. This is one of the feature present under SQL Workshop in Oracle Application Express.
In Microsoft Access, learn different ways of passing a string value within a string argument. Also learn what a “Type Mis-match” error is about.
With Microsoft Access, learn how to specify relationships between tables and set various options on the relationship. Add the tables: Create the relationship: Decide if you’re going to set referential integrity: Decide if you want cascade upda…

791 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question