<div>
Here is a link to a tutorial explaining all of the features of robots.txt in detail:<br />
<br />
<a href="http://www.searchengineworld.com/robots/robots_tutorial.htm" rel="ugc">http://www.searchengineworld.com/robots/robots_tutorial.htm</a>
</div>


Here is a link to a tutorial explaining all of the features of robots.txt in detail:

http://www.searchengineworld.com/robots/robots_tutorial.htm [http://www.searchengineworld.com/robots/robots_tutorial.htm]

<div>
&gt; create a robots.txt file in your root directory with the following line:<br />
<br />
This should read 'lines'.. so two separate lines - one for 'User-agent: *' and one for 'Disallow: /'<br />

</div>


> create a robots.txt file in your root directory with the following line:

This should read 'lines'.. so two separate lines - one for 'User-agent: *' and one for 'Disallow: /'


<div>
<div class="content wysiwyg-content">
Hi,<br />
I'm building a few sites in which I do not want search bots to catalog the site Or put another way I would like them to ignore the site. How do I do this?<br />

</div>
</div>


Hi,
I'm building a few sites in which I do not want search bots to catalog the site Or put another way I would like them to ignore the site. How do I do this?


Stop search bots from cataloging site

Web development software is used to create websites for both the Internet and intranets. Software can be either locally installed or operated through a cloud interface, and ranges in complexity from simple text editors to full-fledged integrated development environments (IDEs) that include graphics, video, audio, scripting and database support.