?
Solved

Powerful web crawler/spider application

Posted on 2006-03-26
3
Medium Priority
?
849 Views
Last Modified: 2008-01-09
I am looking for the most powerful web crawler program I can find at any cost. I would like to spider a list of websites from a mysql database and return, metas, text, etc, back to the database. I would also like it be able to handle as many different types of docs as possible. Has anyone had good experiences with any of them? I have used a number of freeware versions, but they are far too unstable... many returning only 75% of sites back. If it helps, I don't need to go beyond one page with the crawler either.

Thanks for the input,
 cbonnock
0
Comment
Question by:cbonnock
  • 2
3 Comments
 
LVL 4

Accepted Solution

by:
nep1 earned 1500 total points
ID: 16293608
Here's a couple>>

$99.99 - WA Site Import 2.0
http://www.webassist.com/

$39.95 - SurfOffline 1.4.
30-day Trial period
http://www.surfoffline.com/
0
 
LVL 4

Expert Comment

by:nep1
ID: 16293662
"If it helps, I don't need to go beyond one page with the crawler either." Try this>>>

$19.90 - iPageSaver 1.0
Free to Try
http://www.spidersoft.com/
0
 

Author Comment

by:cbonnock
ID: 16320146
These are not quite what I am looking for...
0

Featured Post

Technology Partners: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Want to know how to use Exchange Server Eseutil command? Go through this article as it gives you the know-how.
Here in this article, you will get a step by step guidance on how to restore an Exchange database to a recovery database. Get a brief on Recovery Database and how it can be used to restore Exchange database in this section!
This video demonstrates how to use each tool, their shortcuts, where and when to use them, and how to use the keyboard to improve workflow.
Video by: Tony
This video teaches viewers how to export a project from Adobe Premiere Pro and the various file types involved.

850 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question