Meta robots or robots.txt

How should you communicate with robots?

Also with access control don't worry about it right guys?
Who is Participating?
Dave BaldwinConnect With a Mentor Fixer of ProblemsCommented:
If it requires a login to see the page, then it doesn't matter... but only for that page.  Meta robots applies also to only the page it is on.   robots.txt applies to the whole site.   But you should always remember that these things are Only suggestions that 'good' robots sometimes follow.  They are no kind of protection at all.
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.