Solved

spider

Posted on 1998-10-05
2
306 Views
Last Modified: 2013-12-25
what is spider? how do it works?
Can you teach me to write spider programmes?
0
Comment
Question by:a_flying
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
2 Comments
 

Author Comment

by:a_flying
ID: 1855492
Edited text of question
0
 
LVL 10

Accepted Solution

by:
MasseyM earned 20 total points
ID: 1855493
A spider is a piece of software that will "weave" its was across the World Wide web in search of specfic items... It is a very difficult thing to write, but basically, it goes like this:

you have a list of sites... you search the pages on those site for "keywords" and you then log that info... Obviously the ones with the higher occurances of the keywords, the better the page... (some disagree... this is especially true if it is a sex site...)  
A lot of spiders get their sites from a proxy server or by random guessing... A lot of search engines use "spider" technology... ie.. WWW.METACRAWLER.COM and WWW.HOTBOT.COM .

0

Featured Post

MS Dynamics Made Instantly Simpler

Make Your Microsoft Dynamics Investment Count  & Drastically Decrease Training Time by Providing Intuitive Step-By-Step WalkThru Tutorials.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
hbo knew my windows software 4 86
asp Google Map 2 89
original content 7 116
CSS - Centering an image 2 45
FAQ pages provide a simple way for you to supply and for customers to find answers to the most common questions about your company. Here are six reasons why your company website should have a FAQ page
CTAs encourage people to do something specific to show interest in your company, product or service. Keep reading to learn why CTAs should always be thought of as extremely important, albeit small, sections of websites.
The viewer will learn how to dynamically set the form action using jQuery.
This tutorial will teach you the core code needed to finalize the addition of a watermark to your image. The viewer will use a small PHP class to learn and create a watermark.

738 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question