Go Premium for a chance to win a PS4. Enter to Win

x
?
Solved

crawling ajax/javascript content, need help id'ing url

Posted on 2015-01-11
2
Medium Priority
?
352 Views
Last Modified: 2015-01-11
I want to crawl the list of shows on this page: tvguide.com/social/

They are loaded via ajax and/or javascript, I'm not sure how it works... but I've been told I just need to identify the url or ajax call and I can use that to access the content.

I have not been able to id it though, can you help?

Thanks,

Chris
0
Comment
Question by:St_Aug_Beach_Bum
2 Comments
 
LVL 11

Accepted Solution

by:
Jeffrey Dake earned 2000 total points
ID: 40543605
Looks like here is your url.  http://www.tvguide.com/social/assets/handlers/trending.ashx?serviceid=80001&total=10

I found this by using firefox.  I inspected using firebug and looked at the net tab.  Looking at the responses from each request that was going out I was able to find this url for you you.  You may need to change the total parameter, but it looks like that is what you are looking for.
0
 

Author Closing Comment

by:St_Aug_Beach_Bum
ID: 40543614
Thank you very much, I spent way to much time this afternoon trying to figure that out!
0

Featured Post

Industry Leaders: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Password hashing is better than message digests or encryption, and you should be using it instead of message digests or encryption.  Find out why and how in this article, which supplements the original article on PHP Client Registration, Login, Logo…
In this blog, we’ll look at how improvements to Percona XtraDB Cluster improved IST performance.
The viewer will learn how to dynamically set the form action using jQuery.
The viewer will learn the basics of jQuery, including how to invoke it on a web page. Reference your jQuery libraries: (CODE) Include your new external js/jQuery file: (CODE) Write your first lines of code to setup your site for jQuery.: (CODE)
Suggested Courses

876 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question