Prevent serchengine from indexing a website

website.com
and
secure.website.com

google indexes website.com
but i want to tell it NOT to index secure.website.com
i believe it's through robots.txt
but what should i write and where do i but robots.txt
LVL 1
CMDAIAsked:
Who is Participating?
 
dineeshConnect With a Mentor Commented:


hi,

put this in secure.website.com/robots.txt

User-agent: *
Disallow: /

regards
Dinesh


0
 
otto_leholtCommented:
Hi - I use this simple META tag
<meta name="robots" content="noindex,nofollow,noarchive" />
and it works fine
- Otto
0
 
CMDAIAuthor Commented:
hmm,
thanks for sugestion
but i have alot of pages, how can i do it with robots.txt ?
0
 
dineeshCommented:
User-agent: *User-agent: *
Disallow: /



hi,

put this in secure.website.com/robots.txt

regards
Dinesh

Open in new window

0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.