Still celebrating National IT Professionals Day with 3 months of free Premium Membership. Use Code ITDAY17

x
?
Solved

spider

Posted on 1998-10-05
2
Medium Priority
?
309 Views
Last Modified: 2013-12-25
what is spider? how do it works?
Can you teach me to write spider programmes?
0
Comment
Question by:a_flying
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
2 Comments
 

Author Comment

by:a_flying
ID: 1855492
Edited text of question
0
 
LVL 10

Accepted Solution

by:
MasseyM earned 40 total points
ID: 1855493
A spider is a piece of software that will "weave" its was across the World Wide web in search of specfic items... It is a very difficult thing to write, but basically, it goes like this:

you have a list of sites... you search the pages on those site for "keywords" and you then log that info... Obviously the ones with the higher occurances of the keywords, the better the page... (some disagree... this is especially true if it is a sex site...)  
A lot of spiders get their sites from a proxy server or by random guessing... A lot of search engines use "spider" technology... ie.. WWW.METACRAWLER.COM and WWW.HOTBOT.COM .

0

Featured Post

Enroll in September's Course of the Month

This month’s featured course covers 16 hours of training in installation, management, and deployment of VMware vSphere virtualization environments. It's free for Premium Members, Team Accounts, and Qualified Experts!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

When it comes to write a Context Sensitive Help (an online help that is obtained from a specific point in state of software to provide help with that state) ,  first we need to make the file that contains all topics, which are given exclusive IDs. …
When it comes to security, close monitoring is a must. According to WhiteHat Security annual report, a substantial number of all web applications are vulnerable always. Monitis offers a new product - fully-featured Website security monitoring and pr…
Viewers will get an overview of the benefits and risks of using Bitcoin to accept payments. What Bitcoin is: Legality: Risks: Benefits: Which businesses are best suited?: Other things you should know: How to get started:
Explain concepts important to validation of email addresses with regular expressions. Applies to most languages/tools that uses regular expressions. Consider email address RFCs: Look at HTML5 form input element (with type=email) regex pattern: T…
Suggested Courses

722 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question