Solved

CFHTTP can't get page from Amazon

Posted on 2011-09-14
3
604 Views
Last Modified: 2012-05-12
I am trying to retrieve the code below, but its either giving me a connection failure.

<cfhttp url= "http://www.amazon.com/gp/offer-listing/B004SGVEKM/ref=dp_olp_new?ie=UTF8&qid=1316049910&sr=1-1&condition=new" result= "res" resolveurl="yes">
<cfhttpparam type= "header" name= "Accept-Encoding" value= "deflate;q=0" />
<cfhttpparam type= "Header" name= "TE" value= "deflate;q=0" >
</cfhttp>

<cfdump var= "#res#" >



If i try the same code, but with a different item details page like:
http://www.amazon.com/Star-Wars-Episode-Blu-Ray-Commemorative/dp/B004SGVEKM/ref=sr_1_1?s=toys-and-games&ie=UTF8&qid=1316049910&sr=1-1

Then it works fine.

What is different between the pages or how can i get a return on the other page?
0
Comment
Question by:theideabulb
3 Comments
 
LVL 52

Accepted Solution

by:
_agx_ earned 400 total points
ID: 36540797
Add a user-agent value

<cfhttp useragent="Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/533.7 (KHTML, like Gecko) Chrome/5.0.391.0 Safari/533.7" ....>

0
 
LVL 11

Assisted Solution

by:Brijesh Chauhan
Brijesh Chauhan earned 100 total points
ID: 36540802
Amazon does not allow direct calls to that page, user USERAGENT attribute so that amazon things that request is comming form a Web Browser, I tested the below and it works..

<cfhttp url= "http://www.amazon.com/gp/offer-listing/B004SGVEKM/ref=dp_olp_new?ie=UTF8&qid=1316049910&sr=1-1&condition=new" result= "res" resolveurl="yes" useragent="Mozilla/5.0 (Windows NT 6.1; rv:7.0) Gecko/20100101 Firefox/7.0">
<cfhttpparam type= "header" name= "Accept-Encoding" value= "deflate;q=0" />
<cfhttpparam type= "Header" name= "TE" value= "deflate;q=0" >
</cfhttp>

<cfdump var="#res#">

Open in new window

0
 

Author Closing Comment

by:theideabulb
ID: 36542780
Nice and it makes perfect sense.  its great that CF allows you to do that.
0

Featured Post

Master Your Team's Linux and Cloud Stack!

The average business loses $13.5M per year to ineffective training (per 1,000 employees). Keep ahead of the competition and combine in-person quality with online cost and flexibility by training with Linux Academy.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article  is about submitting  form through  ColdFusion.Ajax.submitForm to the action page and send a response back in JSON format which later can be decoded using ColdFusion.JSON.decode. By this way you can avoid the usual page refresh for subm…
Hi, Even though I have created this Tutorial on My personal Blog, Some people might not able to find my website, So here i am posting it again Today, from the topic it is very clear that i will be showing you here the very basic usage of how we …
This Micro Tutorial hows how you can integrate  Mac OSX to a Windows Active Directory Domain. Apple has made it easy to allow users to bind their macs to a windows domain with relative ease. The following video show how to bind OSX Mavericks to …
This Micro Tutorial demonstrates using Microsoft Excel pivot tables, how to reverse engineer competitors' marketing strategies through backlinks.

776 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question