We have an extremely large database that another company gives to us. Everyday they drop around 20 different CSV files with new records and updates. I'd like to use LOAD DATA INFILE because it's so much faster, is there a way to have it overwrite the records that already have ID's as well as add the ones that don't?
If I need to do this with php, is there a "universal" script I can write that will automate it without having to enter thousands of different fields? I wanted to use a full dump of each table every night but the company won't play nice so all I get are the updates to the table.
Enough rambling, what's the best way to get these "updates" into mysql without writing a script to tranverse 200k records every day, one field at a time?