I'm trying to
* read a file
* write some data into a folder
* start another process to process the data
* resume reading the file while the process works on the data
Is there a good way to go about doing this? Would it be better than starting a bunch of threads?
The reason I'm thinking about it this way, is that I don't really need the processes to communicate with each other, once started, the processes will be working on their own set of data; and I'm hoping Unix would manage running multiple scripts better than Python would manage threads.
Appreciate any advice on this!