How would I decompress and parse 365 JSON files, each over a gig?
Posted on 2014-09-25
I've got the script I need to decompress and parse the files, but what I need now is something that can "look" into the directory and automatically grab each file, process it and then move on to the next.
I can't imagine how I could do that, unless I had the name of each file loaded in a database somewhere.
Perhaps some clever spin on fopen?
How could I do it so I could initiate the process as I'm headed out the door and the process continue automatically through the nite and be done in the morning?