I have incorperated WGet into my application by simply calling it with ShellExecute.
It basically gets files from a list of URLs.
But many of those URL's have thumb nail images. I would like to know how to avoid having WGet download them.
Another point about this is I have used WGet but have the option to use Perl type arrangement to FTP files from the URL's.
Although I do not know if Perl provides something simular to WGet in that WGet recursivley scrapes to a level that you can set. So it parses the html files and then reparses continuing untill the level has been met.
On one hand I would not like to have to write a WGet clone. On the other I imagine Perl to have a module like this. If WGet has the capability to do this then that would be the simplist. But I have not found this in the WGet documentation. Although its a bit unorganized so I may have missed it.
Any comments apreciated.