CAE5942
asked on
Programatically extract date from website
Hi everyone,
On a certain website, there is a search form where you can enter a region and an area of practice and it brings up a set of search results. The search results show a list of names but you have to click on each name to go to a separate page in order to find the contact information. I wondered if it's possible to programatically speed this process up by displaying or downloading all the contact information at once instead of having to click on each result?
I'm not sure how this would be done but I just thought I'd ask the question in case anyone has any idea.
Would really appreciate any advice.
On a certain website, there is a search form where you can enter a region and an area of practice and it brings up a set of search results. The search results show a list of names but you have to click on each name to go to a separate page in order to find the contact information. I wondered if it's possible to programatically speed this process up by displaying or downloading all the contact information at once instead of having to click on each result?
I'm not sure how this would be done but I just thought I'd ask the question in case anyone has any idea.
Would really appreciate any advice.
It's feasible, assuming that the terms of service of the site do not prohibit automated access. You can use cURL and a variety of PHP scripts to address the issue. What is the URL of the site you want to scrape?
ASKER
Thanks for the reply, the url is:
http://tinyurl.com/jyvz3vw
Are you able to provide more information on how to do this?
http://tinyurl.com/jyvz3vw
Are you able to provide more information on how to do this?
Sure, give me a bit of time to look at the URL.
How do you enter the region and area of practice? Is this something you put into a form? Please give us a little more detail, thanks.
ASKER
The following url is where you put in the criteria:
http://tinyurl.com/hzymvb3
The area of practice is actually called "Accredited Specialist"
Thanks
http://tinyurl.com/hzymvb3
The area of practice is actually called "Accredited Specialist"
Thanks
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
Ok great - thanks so much for the information.
https://www.lawsociety.com.au/Terms/index.htm
Terms of use appear to prohibit screen scraping - I am guessing the request here is in violation of the TOU
Terms of use appear to prohibit screen scraping - I am guessing the request here is in violation of the TOU