Solved

How to avoid duplicates when importing data into FileMakerPro 10

Posted on 2014-12-01
2
637 Views
Last Modified: 2014-12-01
I want to import data into FileMaker Pro 10.
Some of the data may already have matching records.
Some may have partial matches (names but no addresses).
Some will have no match.
How do I get all of the data in without duplicating existing records.
Should I do 3 seperate imports using each of the radio buttons ?
  •  add new records from the source file
  •  update records with information from the source file
  •  update matching records with information from the source file  
Or will one of these buttons take care of all of the records?
0
Comment
Question by:maryj152
2 Comments
 
LVL 25

Accepted Solution

by:
Will Loving earned 500 total points
ID: 40474197
You'll most likely want to use the first and third options but not the second which is rarely used and simply overwrites the existing set of records with whatever you're importing and without the benefit of matching.

In order to use the import matching records you have to specify the matching fields but the match only happens against records that are already in FileMaker. You can't do a single import and have it merge a duplicate record that came in during the same import. You can do a one import and then specific "Update Matching" specifying both First and Last name fields at matching and the incoming records will overwrite the existing one if a match exists. The problem with this is that 1) it overwrites, and 2) if you have multiple John Smiths (different individuals at different addresses) then they will be treated as one person because you're only matching first and last.

The way this is normally handled is to import ALL the records into FM and then use one or more self-Join relationships to find and remove the duplicate records. The self-join relationships mean that a table is joined to itself which allows you to identify duplicate records. You'd also need to determine which record you'd like to keep based whether certain data like an address exists. Depending on the number of records and the variation in the data the deletes may best be done manually or in bulks...it just depends on what you're working with.

When I do this, I create a Self-Join relationship based on a criteria likely to be unique such as email or phone number. After you deal with those duplicates you can edit the join to use criteria less likely to be unique such as address and then finally First + Last.
0
 

Author Closing Comment

by:maryj152
ID: 40474513
Thank you. I may have more questions when I begin to make the move.
0

Featured Post

What is SQL Server and how does it work?

The purpose of this paper is to provide you background on SQL Server. It’s your self-study guide for learning fundamentals. It includes both the history of SQL and its technical basics. Concepts and definitions will form the solid foundation of your future DBA expertise.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
SYbase 4 43
Exchange 2013 tmp files 3 59
Exchange 2016 CU5 HealthMailboxes growing and Your mailbox is almost full. 3 26
Append Query Access 2010 4 17
SQL Command Tool comes with APEX under SQL Workshop. It helps us to make changes on the database directly using a graphical user interface. This helps us writing any SQL/ PLSQL queries and execute it on the database and we can create any database ob…
This article explains all about SQL Server Piecemeal Restore with examples in step by step manner.
Video by: Steve
Using examples as well as descriptions, step through each of the common simple join types, explaining differences in syntax, differences in expected outputs and showing how the queries run along with the actual outputs based upon a simple set of dem…
Polish reports in Access so they look terrific. Take yourself to another level. Equations, Back Color, Alternate Back Color. Write easy VBA Code. Tighten space to use less pages. Launch report from a menu, considering criteria only when it is filled…

735 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question