Why my PHP file failed to complete batch process after 4 hours of data processing?
Posted on 2012-03-23
I have a PHP file that does some data processing work in the mysql database and I run in from a web browser each weekend.
The PHP file usually completes the job in 4 hours, but past 2 weekends, it failed to complete. Then, i need to reexecute the file.
Sometimes during the data processing, it seems like, when inserting rows into team table, there suppose to be 11 rows per team id, but some team id only have 7 rows. And this happen randomly. Each time we run the script, team id 4 can missed some rows, but second time we run, team 10 may missed some rows
This is the mem health of my db server.
total used free shared buffers cached
Mem: 6291456 6217556 73900 0 172192 5286472
-/+ buffers/cache: 758892 5532564
Swap: 2096440 64 2096376