[Webinar] Streamline your web hosting managementRegister Today

x
?
Solved

crawling ajax/javascript content, need help id'ing url

Posted on 2015-01-11
2
Medium Priority
?
355 Views
Last Modified: 2015-01-11
I want to crawl the list of shows on this page: tvguide.com/social/

They are loaded via ajax and/or javascript, I'm not sure how it works... but I've been told I just need to identify the url or ajax call and I can use that to access the content.

I have not been able to id it though, can you help?

Thanks,

Chris
0
Comment
Question by:St_Aug_Beach_Bum
2 Comments
 
LVL 11

Accepted Solution

by:
Jeffrey Dake earned 2000 total points
ID: 40543605
Looks like here is your url.  http://www.tvguide.com/social/assets/handlers/trending.ashx?serviceid=80001&total=10

I found this by using firefox.  I inspected using firebug and looked at the net tab.  Looking at the responses from each request that was going out I was able to find this url for you you.  You may need to change the total parameter, but it looks like that is what you are looking for.
0
 

Author Closing Comment

by:St_Aug_Beach_Bum
ID: 40543614
Thank you very much, I spent way to much time this afternoon trying to figure that out!
0

Featured Post

Never miss a deadline with monday.com

The revolutionary project management tool is here!   Plan visually with a single glance and make sure your projects get done.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Nothing in an HTTP request can be trusted, including HTTP headers and form data.  A form token is a tool that can be used to guard against request forgeries (CSRF).  This article shows an improved approach to form tokens, making it more difficult to…
There are times when I have encountered the need to decompress a response from a PHP request. This is how it's done, but you must have control of the request and you can set the Accept-Encoding header.
Learn how to match and substitute tagged data using PHP regular expressions. Demonstrated on Windows 7, but also applies to other operating systems. Demonstrated technique applies to PHP (all versions) and Firefox, but very similar techniques will w…
The viewer will learn the basics of jQuery, including how to invoke it on a web page. Reference your jQuery libraries: (CODE) Include your new external js/jQuery file: (CODE) Write your first lines of code to setup your site for jQuery.: (CODE)
Suggested Courses

612 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question