This is definitely a lot easier and faster to do with shell script using curl and grep.
something like curl http://www.cnn.com then grep for "hrefs"
Main Topics
Browse All TopicsI am looking to create a program that will visit a website, copy a list of links on that website, and then visit each of those links.
Once it visits those links, it needs to copy and parse the information it finds...
How would i go about doing this?
This question is in progress.
Our experts are working on an answer right now.
Sign up for immediate access to the solution once it becomes available.
Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.
If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.
Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.
Access the answers to your technology questions today.
30-day free trial. Register in 60 seconds.
Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Try it out and discover for yourself.
30-day free trial. Register in 60 seconds.
Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.
This is definitely a lot easier and faster to do with shell script using curl and grep.
something like curl http://www.cnn.com then grep for "hrefs"
Business Accounts
Answer for Membership
by: DarkMeldPosted on 2009-03-22 at 19:14:33ID: 23954421
Try taking a look at Automator. Its built into mac os and a lot more user friendly than coding.