Solved

what do the spiders ignore?

Posted on 2011-09-28
6
175 Views
Last Modified: 2013-11-19
Am I correct in thinking that the spider ignore  the following in domain names
a
and
the
 so
abestname   would be seen and treated by the spiders as a best name
best and name would be treated by the spiders as best name

0
Comment
Question by:digisel
  • 2
  • 2
  • 2
6 Comments
 
LVL 33

Expert Comment

by:paulmacd
ID: 36718584
I don't think so, but there are many spiders, and I'm sure their back-end processes deal with these things each in their own way.
0
 
LVL 82

Expert Comment

by:Dave Baldwin
ID: 36718760
No, that's not how it works.  The spiders collect everything.  Those words are ignored as search parameters on Google when they are separate words but when you run them all together without spaces, they form a new word and are not ignored.
0
 

Author Comment

by:digisel
ID: 36718821
thanks.  so

a-best-name   would be seen and treated by the spiders as a "best name"
best-and-name would be treated by the spiders as "best name"
0
Threat Intelligence Starter Resources

Integrating threat intelligence can be challenging, and not all companies are ready. These resources can help you build awareness and prepare for defense.

 
LVL 82

Accepted Solution

by:
Dave Baldwin earned 250 total points
ID: 36718929
No.  '-' are not spaces.  Besides, spaces are not allowed in domain names.  If you type 'a best name' in Google, it will match 'a-best-name'.  However, the 'a' will be ignored as a search parameter but 'best' and 'name' will match in that name.  If you type 'a-best-name' in Google, it should be an exact match.

Like I said above, the spiders (which are the programs that scan web sites) collect everything.  Then the search engines take your requests and use a variety of methods to try to find the best match.  The reason for ignoring the simple words like "a, and, the, so" is because they are so common that they are meaningless matches.
0
 
LVL 33

Assisted Solution

by:paulmacd
paulmacd earned 250 total points
ID: 36718953
As both [DaveBaldwin] and I point out, the spiders themselves are just collectors.  How the information they collect is treated depends on the backend (typcially a search engine).  I can't think of any reason why a domain name of a-best-name would be seen as "best name", but might come up as a result in a search anyway, depending on the search engine and other factors.
0
 

Author Closing Comment

by:digisel
ID: 36922661
thanks for your input
apologies about the delay in closing this - i have been away and forgot that the question was still open.
0

Featured Post

Free Trending Threat Insights Every Day

Enhance your security with threat intelligence from the web. Get trending threat insights on hackers, exploits, and suspicious IP addresses delivered to your inbox with our free Cyber Daily.

Join & Write a Comment

Citrix XenApp, Internet Explorer 11 set to Enterprise Mode and using central hosted sites.xml file.
Today, still in the boom of Apple, PC's and products, nearly 50% of the computer users use Windows as graphical operating systems. If you are among those users who love windows, but are grappling to keep the system's hard drive optimized, then you s…
The viewer will get a basic understanding of what section 508 compliance can entail, learn about skip navigation links, alt text, transcripts, and font size controls.
Shows how to create a shortcut to site-search Experts Exchange using Google in the Chrome browser. This eliminates the need to type out site:experts-exchange.com whenever you want to search the site. Launch the Search Engine Menu: In chrome, via you…

708 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now