I am using Perl WWW::Mechanize to access some websites. The goal is to access certain pages on a corporate network and scrape information.
I am running into a problem in that I can't get past the proxy server. I have setup the following
my $agent = WWW::Mechanize->new();
$agent->proxy(http => "http://xxx.proxy.xxx.com:8001/");
but when I run
my $response = $agent -> get('http://www.tmng.com/HomePage/homepage.htm/'
I get a 403 error.
Now from IE, to setup the browser to run on the network, under Tools/Internet Options, undr the connection tab, in the LAN settings, you have to click on the Use Auto Configuration script option and the location is "http://xxx.proxy.xxx.com:8001".
How do I get Perl to recognize the auto config setting on the proxy server?