Im new to MySQL and Im looking for some advice.
Im creating a database of job advertisements from several different websites. The job advertisements are parsed from webpages using Coldfusion and then entered into a MySQ database.
All the jos have a Primary jodID (AUTO_INCREMENT) and a unique identifier that consists of websitename and jobref (the job ref is taken from the website).
Problem 1: The same job may be advertised at one or more websites, but with one or more different jobrefs. This means I can have duplicates in the database and Im not sure how to address the problem
I need to know if there is a method that will allow me to compare the similarity of the data I have parsed with the data already in the database.