Solved

spider

Posted on 1998-10-05
2
308 Views
Last Modified: 2013-12-25
what is spider? how do it works?
Can you teach me to write spider programmes?
0
Comment
Question by:a_flying
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
2 Comments
 

Author Comment

by:a_flying
ID: 1855492
Edited text of question
0
 
LVL 10

Accepted Solution

by:
MasseyM earned 20 total points
ID: 1855493
A spider is a piece of software that will "weave" its was across the World Wide web in search of specfic items... It is a very difficult thing to write, but basically, it goes like this:

you have a list of sites... you search the pages on those site for "keywords" and you then log that info... Obviously the ones with the higher occurances of the keywords, the better the page... (some disagree... this is especially true if it is a sex site...)  
A lot of spiders get their sites from a proxy server or by random guessing... A lot of search engines use "spider" technology... ie.. WWW.METACRAWLER.COM and WWW.HOTBOT.COM .

0

Featured Post

VIDEO: THE CONCERTO CLOUD FOR HEALTHCARE

Modern healthcare requires a modern cloud. View this brief video to understand how the Concerto Cloud for Healthcare can help your organization.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

FAQ pages provide a simple way for you to supply and for customers to find answers to the most common questions about your company. Here are six reasons why your company website should have a FAQ page
Q&A with Course Creator, Mark Lassoff, on the importance of HTML5 in the career of a modern-day developer.
The viewer will learn how to dynamically set the form action using jQuery.
The viewer will get a basic understanding of what section 508 compliance can entail, learn about skip navigation links, alt text, transcripts, and font size controls.

617 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question