google only: the use of the word allow in robots.txt

robots.txt

I see keywords
'user-agent'
'allow'
'disallow'

is 'allow' used by google


I am only looking for a google answer

My client is upset that many pages are visible in google but does not care about other search engines at this moment

I could explain to client about rogue webcrawlers that gather personal information, but all they care about now is google


So could you answer question
yes google follows the word 'allow'
no google does not follow the word 'allow'

and provide the reasons.


Client wants to block many pages and future pages from google.
LVL 1
rgb192Asked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

QuinnDexCommented:
google follows everything unless you use disallow

you can use meta tags to stop google aswell

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
0
aboo_sCommented:
yes it would still appwear:
to stop this use in head section:
<meta name="robots" content="no index, no follow" />
0
GaryCommented:
Allow is recognised by Google.
But what is in the index already will not be affected by the robots.txt - the robots will just prevent further indexing.
You can request a url removal in Google Webmaster Tools - may take a while for it to be removed.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
The Ultimate Tool Kit for Technolgy Solution Provi

Broken down into practical pointers and step-by-step instructions, the IT Service Excellence Tool Kit delivers expert advice for technology solution providers. Get your free copy for valuable how-to assets including sample agreements, checklists, flowcharts, and more!

QuinnDexCommented:
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

will make google drop the index of a page in time...

you can stop google from showing pages much sooner by going to google webmaster tools and telling google what pages not to show
0
Loganathan NatarajanLAMP DeveloperCommented:
As I have said in your another question, please try to request to Google to remove the indexed pages, the steps given here, https://support.google.com/webmasters/answer/1663419
0
rgb192Author Commented:
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
and removal with webmaster tools

thanks
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Search Engine Optimization (SEO)

From novice to tech pro — start learning today.