Solved

spider

Posted on 1998-10-05
2
302 Views
Last Modified: 2013-12-25
what is spider? how do it works?
Can you teach me to write spider programmes?
0
Comment
Question by:a_flying
2 Comments
 

Author Comment

by:a_flying
ID: 1855492
Edited text of question
0
 
LVL 10

Accepted Solution

by:
MasseyM earned 20 total points
ID: 1855493
A spider is a piece of software that will "weave" its was across the World Wide web in search of specfic items... It is a very difficult thing to write, but basically, it goes like this:

you have a list of sites... you search the pages on those site for "keywords" and you then log that info... Obviously the ones with the higher occurances of the keywords, the better the page... (some disagree... this is especially true if it is a sex site...)  
A lot of spiders get their sites from a proxy server or by random guessing... A lot of search engines use "spider" technology... ie.. WWW.METACRAWLER.COM and WWW.HOTBOT.COM .

0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Read about why website design really matters in today's demanding market.
Developer portfolios can be a bit of an enigma—how do you present yourself to employers without burying them in lines of code?  A modern portfolio is more than just work samples, it’s also a statement of how you work.
The viewer will learn how to dynamically set the form action using jQuery.
The viewer will learn how to create and use a small PHP class to apply a watermark to an image. This video shows the viewer the setup for the PHP watermark as well as important coding language. Continue to Part 2 to learn the core code used in creat…

911 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

21 Experts available now in Live!

Get 1:1 Help Now