Link to home
Start Free TrialLog in
Avatar of CAE5942
CAE5942

asked on

Programatically extract date from website

Hi everyone,

On a certain website, there is a search form where you can enter a region and an area of practice and it brings up a set of search results. The search results show a list of names but you have to click on each name to go to a separate page in order to find the contact information. I wondered if it's possible to programatically speed this process up by displaying or downloading all the contact information at once instead of having to click on each result?

I'm not sure how this would be done but I just thought I'd ask the question in case anyone has any idea.

Would really appreciate any advice.
Avatar of Ray Paseur
Ray Paseur
Flag of United States of America image

It's feasible, assuming that the terms of service of the site do not prohibit automated access.  You can use cURL and a variety of PHP scripts to address the issue.  What is the URL of the site you want to scrape?
Avatar of CAE5942
CAE5942

ASKER

Thanks for the reply, the url is:

http://tinyurl.com/jyvz3vw

Are you able to provide more information on how to do this?
Sure, give me a bit of time to look at the URL.
How do you enter the region and area of practice?  Is this something you put into a form?  Please give us a little more detail, thanks.
Avatar of CAE5942

ASKER

The following url is where you put in the criteria:

http://tinyurl.com/hzymvb3

The area of practice is actually called "Accredited Specialist"

Thanks
ASKER CERTIFIED SOLUTION
Avatar of Ray Paseur
Ray Paseur
Flag of United States of America image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of CAE5942

ASKER

Ok great - thanks so much for the information.
Avatar of Julian Hansen
https://www.lawsociety.com.au/Terms/index.htm

Terms of use appear to prohibit screen scraping - I am guessing the request here is in violation of the TOU