jpschreibman
asked on
Please double-check my cURL script- why isn't this working?
Please see my function below:
I am attempting to connect to a page like this:
http://yellowpages.com.au//onlineSolution_moreInfo.do;jsessionid=1FB1ABFBFD3CD9BB5BF919A3AADDEEEC.12?iblId=3543593&iblName=Artizan+Cabinets&listingPosition=2&originatingPage=ListingPage&authToken=11cd37700be|d509da26cd3e1412d3070a9514558873&pageNumber=3&st=cs&z=100004
Page opens fine in any browser, but when I use my script, the same page comes up as "The page you requested has been static for too long and has run out of time."
I have already tried a few USERAGENTs, IE6, FF, and even Googlebot. I get the same with all of them.
$myurl = the page where I grab each entry url (used to spoof the referrer)
I have even enabled cookies.
Can you think of any reason this is happening? Any help you can offer is appreciated.
I am attempting to connect to a page like this:
http://yellowpages.com.au//onlineSolution_moreInfo.do;jsessionid=1FB1ABFBFD3CD9BB5BF919A3AADDEEEC.12?iblId=3543593&iblName=Artizan+Cabinets&listingPosition=2&originatingPage=ListingPage&authToken=11cd37700be|d509da26cd3e1412d3070a9514558873&pageNumber=3&st=cs&z=100004
Page opens fine in any browser, but when I use my script, the same page comes up as "The page you requested has been static for too long and has run out of time."
I have already tried a few USERAGENTs, IE6, FF, and even Googlebot. I get the same with all of them.
$myurl = the page where I grab each entry url (used to spoof the referrer)
I have even enabled cookies.
Can you think of any reason this is happening? Any help you can offer is appreciated.
function file_get_curl($url) {
global $myurl, $cookiefile;
$curl_handle=curl_init();
curl_setopt($curl_handle,CURLOPT_URL,$url);
curl_setopt($curl_handle,CURLOPT_CONNECTTIMEOUT,60);
curl_setopt($curl_handle,CURLOPT_RETURNTRANSFER,1);
curl_setopt($curl_handle,CURLOPT_AUTOREFERER, false);
curl_setopt($curl_handle,CURLOPT_REFERER, $myurl);
curl_setopt($curl_handle,CURLOPT_COOKIEFILE, $cookiefile);
curl_setopt($curl_handle,CURLOPT_COOKIEJAR, $cookiefile);
curl_setopt($curl_handle,CURLOPT_USERAGENT, "Googlebot/2.1 (+http://www.googlebot.com/bot.html)");
$data = curl_exec($curl_handle);
curl_close($curl_handle);
return $data;
}
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
iMacros Web Automation: http://www.iopus.com/
SWAT: http://swat.sourceforge.net/wikka.php?wakka=HomePage