Solved

Keeping a page away from Google

Posted on 2011-03-06
4
266 Views
Last Modified: 2012-05-11
I like to put up a page I'm working on with a client so they can see the progress and we can have something to talk about.  I usually build the site initially in some obscure subfolder that no one is likely to stumble onto it by chance by entering www.mysite/theobscuresitefoldername and see it. But I know search engines crawl over everything on the web so it's possible, it seems, that the site in progress could still be found by Google and get indexed.  Is there something I can put on the site that Google, and othe rsearch engines will respect, and leave the site alone?  I know about nofollow but I t hink that's just something you can put on a link to keep Google from following it.  I need something that keeps Google out of the whole page.

Thanks.  
0
Comment
Question by:steva
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
4 Comments
 
LVL 4

Accepted Solution

by:
florjan earned 167 total points
ID: 35047308
www.mysite place a file robots.txt and put in
User-agent: *
Disallow: /theobscuresitefoldername

Open in new window

0
 
LVL 11

Assisted Solution

by:MajorBigDeal
MajorBigDeal earned 167 total points
ID: 35047672
Even if you tell search engines not to include something, they might still make a copy of it.  Also, there are search engines that provide the "feature" of allowing searches on things that are specially marked as disallow.   So when I want to keep something out of of a web page, I  use  a server side script that will not serve the page unless the user has provided a correct password.  
0
 
LVL 2

Assisted Solution

by:jaxbrian
jaxbrian earned 166 total points
ID: 35047677
you could also do this in the head of your page that you do not want to be indexed.
<meta name="robots" content="noindex">

if it is a folder you are trying to block with robots.txt then you need to have a
User-agent: *
Disallow: /theobscuresitefoldername/       //// the trailing slash is important to have
0
 

Author Closing Comment

by:steva
ID: 35048452
You guys all gave great information.  i split the points.

Thanks.
0

Featured Post

Free Tool: Subnet Calculator

The subnet calculator helps you design networks by taking an IP address and network mask and returning information such as network, broadcast address, and host range.

One of a set of tools we're offering as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Bootstrap 3 - Style a dropdown 1 25
Non-Resizable Pharagraph 2 17
How to escape unsafe HTML tags 4 36
Ajax on ASP 2 35
Things That Drive Us Nuts Have you noticed the use of the reCaptcha feature at EE and other web sites?  It wants you to read and retype something that looks like this.Insanity!  It's not EE's fault - that's just the way reCaptcha works.  But it is …
SASS allows you to treat your CSS code in a more OOP way. Let's have a look on how you can structure your code in order for it to be easily maintained and reused.
In this tutorial viewers will learn how to style a corner ribbon overlay for an image using CSS Create a new class by typing ".Ribbon":  Define the class' "display:" as "inline-block": Define its "position:" as "relative": Define its "overflow:" as …
The viewer will receive an overview of the basics of CSS showing inline styles. In the head tags set up your style tags: (CODE) Reference the nav tag and set your properties.: (CODE) Set the reference for the UL element and styles for it to ensu…

763 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question