[Webinar] Streamline your web hosting managementRegister Today

x
  • Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 176
  • Last Modified:

should web bots / crawlers (like baidu) be blocked?

Hello Web experts,

Should web bots / crawlers (like baidu) be blocked?

Thanks for your help.
0
epifanio67
Asked:
epifanio67
  • 2
1 Solution
 
_Commented:
Depends on whether you want your content Public, how easily you want it found, or if you want it Private.
Do you have a specific scenario in mind?

This has a blurb about the top 10  good bots, and you can decide if you want them on or not:
http://www.incapsula.com/blog/know-your-top-10-bots.html
0
 
epifanio67Author Commented:
Thank you coral47....

good article.... it helps...

Regards
0
 
_Commented:
Thank you much.    : )
0

Featured Post

The new generation of project management tools

With monday.com’s project management tool, you can see what everyone on your team is working in a single glance. Its intuitive dashboards are customizable, so you can create systems that work for you.

  • 2
Tackle projects and never again get stuck behind a technical roadblock.
Join Now