Link to home
Start Free TrialLog in
Avatar of odonovanpm
odonovanpm

asked on

ASP.NET Spider/Crawler

We are looking at the possibility of developing a crawler/spider that will be used in conjunction with our own search engine. I know very little about this subject, can anyone help me? I need to research this in great detail but any help would be amazing. Thanks.
SOLUTION
Avatar of wattkey
wattkey

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of odonovanpm
odonovanpm

ASKER

That's great, thanks. But what if I want it to crawl external sites continuously?
ASKER CERTIFIED SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial