should web bots / crawlers (like baidu) be blocked?

Hello Web experts,

Should web bots / crawlers (like baidu) be blocked?

Thanks for your help.
epifanio67Asked:
Who is Participating?
 
_Commented:
Depends on whether you want your content Public, how easily you want it found, or if you want it Private.
Do you have a specific scenario in mind?

This has a blurb about the top 10  good bots, and you can decide if you want them on or not:
http://www.incapsula.com/blog/know-your-top-10-bots.html
0
 
epifanio67Author Commented:
Thank you coral47....

good article.... it helps...

Regards
0
 
_Commented:
Thank you much.    : )
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.