CSV into MySQL
Posted on 2014-01-06
At this point I am just gathering requirements and brainstorming about how to handle this project. Is it something that should be done in code. Is there an application out there that already does what I want that someone thinks I should use, etc...
So I would like to pick your brains.
We have a manual process were someone goes through 2 CSV files and manually manipulates data. I want to put that data into a MySQL database and automate some of that manipulation for her.
The CSV files are uploaded to our server on a weekly basis by a 3rd party.
We have a Redhat Enterprise Linux 6 server with MySQL version 5.1.71, Webmin 1.660.
What would be the best process to create the MySQL database table and then create an automated process to import the data from the 2 CSV files (that have the same structure) into the database. And then repeat the import once a week (roughly 6am on Mondays).
Does this make sense?
Is this best handled in code?
If so can you point me at some examples for best practices?
Or is there some sort of GUI that I can put on my server to schedule this for me?
Thanks in advance for your expertise.