[Okta Webinar] Learn how to a build a cloud-first strategyRegister Now

x
?
Solved

Web Scrape Javascript Site

Posted on 2011-09-25
3
Medium Priority
?
436 Views
Last Modified: 2012-09-27
I have never done web scraping before, but have a situation where it would help a ton.  I go to a site that runs a javascript to display data.  I use Chrome and right click the page, and view page source and completely understand the page and can see the data that I want to grab.  I want to do 2 things; play a sound or some notification when a certain number is reached and store data for analysis.  I have done research and found many tools like greasemonkey for firefox, AJAX,  irobotsoft, etc.  I am looking for guidance as to what would be the best way to do this.  I have no problem leaving the site open and logged in while the scraping would be done.
0
Comment
Question by:etechit
3 Comments
 
LVL 1

Author Comment

by:etechit
ID: 36602475
Thank you, but the site I am looking at is javascript and these articles don't refer to that at all
0
 
LVL 17

Accepted Solution

by:
selvol earned 1500 total points
ID: 38357259
Im going to make it short but hopefully meaningful.....

The 1 thing I do not Understand is the site runs a "JAVASCRIPT" to display.......
That can be a couple of things...


I use and have used Metaproducts Offline Explorer for scraping for 10+ Years,
It can Login, scrape Parts of the page, ajax and many other features.
It is developed by One of the Best developers Code wise and Support wise I've seen.


Please don't think I am just tossing some cheap, lame down loader at you because I used it once.
I am not sure of your exact needs. But from what I read it looks like OE can assist.

Give it a try. If you have any doubts or questions ask me here.

Or go to the Metaproducts forum page.  And ask the actual developer. He usually responds fast.

Selvol



0

Featured Post

Free Tool: ZipGrep

ZipGrep is a utility that can list and search zip (.war, .ear, .jar, etc) archives for text patterns, without the need to extract the archive's contents.

One of a set of tools we're offering as a way to say thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article was originally published on Monitis Blog, you can check it here . Today it’s fairly well known that high-performing websites and applications bring in more visitors, higher SEO, and ultimately more sales. By the same token, downtime…
Q&A with Course Creator, Mark Lassoff, on the importance of HTML5 in the career of a modern-day developer.
This tutorial demonstrates how to identify and create boundary or building outlines in Google Maps. In this example, I outline the boundaries of an enclosed skatepark within a community park.  Login to your Google Account, then  Google for "Google M…
This tutorial walks through the best practices in adding a local business to Google Maps including how to properly search for duplicates, marker placement, and inputing business details. Login to your Google Account, then search for "Google Mapmaker…
Suggested Courses
Course of the Month19 days, 9 hours left to enroll

872 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question