?
Solved

How to avoid duplicates when importing data into FileMakerPro 10

Posted on 2014-12-01
2
Medium Priority
?
678 Views
Last Modified: 2014-12-01
I want to import data into FileMaker Pro 10.
Some of the data may already have matching records.
Some may have partial matches (names but no addresses).
Some will have no match.
How do I get all of the data in without duplicating existing records.
Should I do 3 seperate imports using each of the radio buttons ?
  •  add new records from the source file
  •  update records with information from the source file
  •  update matching records with information from the source file  
Or will one of these buttons take care of all of the records?
0
Comment
Question by:maryj152
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
2 Comments
 
LVL 25

Accepted Solution

by:
Will Loving earned 2000 total points
ID: 40474197
You'll most likely want to use the first and third options but not the second which is rarely used and simply overwrites the existing set of records with whatever you're importing and without the benefit of matching.

In order to use the import matching records you have to specify the matching fields but the match only happens against records that are already in FileMaker. You can't do a single import and have it merge a duplicate record that came in during the same import. You can do a one import and then specific "Update Matching" specifying both First and Last name fields at matching and the incoming records will overwrite the existing one if a match exists. The problem with this is that 1) it overwrites, and 2) if you have multiple John Smiths (different individuals at different addresses) then they will be treated as one person because you're only matching first and last.

The way this is normally handled is to import ALL the records into FM and then use one or more self-Join relationships to find and remove the duplicate records. The self-join relationships mean that a table is joined to itself which allows you to identify duplicate records. You'd also need to determine which record you'd like to keep based whether certain data like an address exists. Depending on the number of records and the variation in the data the deletes may best be done manually or in bulks...it just depends on what you're working with.

When I do this, I create a Self-Join relationship based on a criteria likely to be unique such as email or phone number. After you deal with those duplicates you can edit the join to use criteria less likely to be unique such as address and then finally First + Last.
0
 

Author Closing Comment

by:maryj152
ID: 40474513
Thank you. I may have more questions when I begin to make the move.
0

Featured Post

Free Backup Tool for VMware and Hyper-V

Restore full virtual machine or individual guest files from 19 common file systems directly from the backup file. Schedule VM backups with PowerShell scripts. Set desired time, lean back and let the script to notify you via email upon completion.  

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

When it comes to protecting Oracle Database servers and systems, there are a ton of myths out there. Here are the most common.
A company’s centralized system that manages user data, security, and distributed resources is often a focus of criminal attention. Active Directory (AD) is no exception. In truth, it’s even more likely to be targeted due to the number of companies …
Video by: Steve
Using examples as well as descriptions, step through each of the common simple join types, explaining differences in syntax, differences in expected outputs and showing how the queries run along with the actual outputs based upon a simple set of dem…
In this video, Percona Director of Solution Engineering Jon Tobin discusses the function and features of Percona Server for MongoDB. How Percona can help Percona can help you determine if Percona Server for MongoDB is the right solution for …

777 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question