Database Cleansing

Posted on 2011-04-19
Last Modified: 2013-11-15

We are looking to reduce our database size by removing all our duplicate records of which there are quite a few.

Im going to use mobile phone number to identify the duplicates so Im after a way of first identifying the duplicates and then either moving to a 2nd database or just simply removing them.

Is this something which can be done within Goldmine or will this be a backend process?

Question by:daiwhyte
    LVL 12

    Expert Comment

    Goldmine has a de-duplication process built in, you could create a filter to pick up all contacts with a mobile number then using the de-dupe process you can merge duplicates together.

    Alternativly you could find the duplicates another way (by hand or using SQL) - mark these records by putting something in a field. Then using a filter to find these you could move them to another database (you would need to create this Database first), you can then use the tools >  copy - move records.

    Author Comment

    Sounds interesting, how does the merge work, does it delete the orphaned record - will the process utlimately reduce the database size or just hide the duplicate entries?

    Im doing this process to improve the performance of our DB so Im guess the smaller the database the better it runs - hence the request to remove the duplicates.

    LVL 12

    Accepted Solution

    The merge does just that, it merges the records together

    History/pending/linked/detail records are linked to the new "surviving" record fields are merged based on how recent they changed then the old record is either marked for deletion tor actually deleted.

    I suggest you read the help file on dedupe/merge purge to better understand it.

    Author Comment

    Thanks GMG, I will read and get back to the thread this Thursday

    Author Comment

    Ive had a read of the help file and like what Im reading, Im going to perform the process after last day of the month (just in case!)

    Thanks GMG.;

    Author Closing Comment

    Thank you.

    Featured Post

    How to run any project with ease

    Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
    - Combine task lists, docs, spreadsheets, and chat in one
    - View and edit from mobile/offline
    - Cut down on emails

    Join & Write a Comment

    Oracle Apps Profiles option: A user profile is a set of shifting options that alter the way one runs an application. A value is set for each option under the user's profile when the Oracle application user logs on to any responsibility or changes…
    GoldMine CRM has a fairly open database architecture , however in this case the email distribution list is stored in a quirky way and does not allow easy access for external use. This article will give details of this and provide a method to extr…
    In this sixth video of the Xpdf series, we discuss and demonstrate the PDFtoPNG utility, which converts a multi-page PDF file to separate color, grayscale, or monochrome PNG files, creating one PNG file for each page in the PDF. It does this via a c…
    Internet Business Fax to Email Made Easy - With eFax Corporate (, you'll receive a dedicated online fax number, which is used the same way as a typical analog fax number. You'll receive secure faxes in your email, fr…

    734 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    26 Experts available now in Live!

    Get 1:1 Help Now