Solved

crawling ajax/javascript content, need help id'ing url

Posted on 2015-01-11
2
264 Views
Last Modified: 2015-01-11
I want to crawl the list of shows on this page: tvguide.com/social/

They are loaded via ajax and/or javascript, I'm not sure how it works... but I've been told I just need to identify the url or ajax call and I can use that to access the content.

I have not been able to id it though, can you help?

Thanks,

Chris
0
Comment
Question by:St_Aug_Beach_Bum
2 Comments
 
LVL 10

Accepted Solution

by:
Jeffrey Dake earned 500 total points
Comment Utility
Looks like here is your url.  http://www.tvguide.com/social/assets/handlers/trending.ashx?serviceid=80001&total=10

I found this by using firefox.  I inspected using firebug and looked at the net tab.  Looking at the responses from each request that was going out I was able to find this url for you you.  You may need to change the total parameter, but it looks like that is what you are looking for.
0
 

Author Closing Comment

by:St_Aug_Beach_Bum
Comment Utility
Thank you very much, I spent way to much time this afternoon trying to figure that out!
0

Featured Post

Better Security Awareness With Threat Intelligence

See how one of the leading financial services organizations uses Recorded Future as part of a holistic threat intelligence program to promote security awareness and proactively and efficiently identify threats.

Join & Write a Comment

Part of the Global Positioning System A geocode (https://developers.google.com/maps/documentation/geocoding/) is the major subset of a GPS coordinate (http://en.wikipedia.org/wiki/Global_Positioning_System), the other parts being the altitude and t…
This article discusses four methods for overlaying images in a container on a web page
The viewer will learn the basics of jQuery, including how to invoke it on a web page. Reference your jQuery libraries: (CODE) Include your new external js/jQuery file: (CODE) Write your first lines of code to setup your site for jQuery.: (CODE)
The viewer will learn how to create a basic form using some HTML5 and PHP for later processing. Set up your basic HTML file. Open your form tag and set the method and action attributes.: (CODE) Set up your first few inputs one for the name and …

772 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now