I needed to write a script that would take a whole bunch of URL's and check if the HTTP status code for each of them. As I have a lot of URL's, I wanted to parallelise the operation, so naturally enough I thought I'd use the LWP::Parallel::UserAgent module. Unfortunately, this module doesn't work with newer versions of libwww and looks like it is a dead module.
That got me on the path at looking at other modules. Candidates were
Out of the above, only IO::Lambda seemed to be the most robust, although it is quite complex.
My needs are fairly simple as I'm just doing a simple HTTP HEAD request, but one important aspect is to be able to limit the number of simultaneous connections.
So, I'm asking if anyone has experience in using any of the above modules or any suggestions for other modules/code I could use?
Note that this needs to run with ActivePerl on Linux and Windows.