My goal is to build a database that stores 3 lists of tags and corresponding data for each tag (each list about 10,000 tags with each tag having 30 fields of data). I have to constantly import these 3 lists every week or so and compare them. Each import will result in unchanged tags, new tags, lost tags, modified tags, and unchanged/new/lost/modifie
I plan to keep each of these lists in separate tables. Where I need a little help is whether or not I need a 4th table as a “Master List”. I could write a program to verify tags and write the results to the Master List table.
The end result will be a client application that I build that is used to browse the database. The reason I think I need the 4th table (Master List) is to store the results of comparison routines so that the client application doesn’t have to run these processes on the fly. Also, I’m unsure as to whether I should write duplicate tags to the Master List or to only write unique tags and flag them as having a duplicate in one of the Lists.
Attached are a few tables showing the examples of the data structure. Am I on the correct path? I want to make sure I start this project with a solid foundation...
P.S. I do not have great skills with databases. I can navigate and build queries but that’s about the extent of it. I am relatively proficient with programming.