How to allow google to bypass a required page

I have a site that requires the user to enter an email address before they can access it. I want Google to still find the pages though. Is there a way to allow google to bypass the page? and index the other pages?
anotherdotcommerAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Randy DownsOWNERCommented:
If Google can bypass the page then so can your users. If nothing else they could Google it and click.

Usually protected pages don't get indexed for the above reason.

Your best bet for SEO purposes is to have some of the information you want indexed on non-secured pages so Google can rank them. Just link your secured pages from the indexed pages.
0
StingRaYCommented:
You mean you want to allow google bot to bypass entering the email address?

Actually, you can capture the user agent from the request. The google bot user agents are listed here:

Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Googlebot/2.1 (+http://www.googlebot.com/bot.html)
Googlebot/2.1 (+http://www.google.com/bot.html)
(From http://www.useragentstring.com/pages/Googlebot/)

If the user agent matches one of them, just bypass.
0
xtermCommented:
You could put something like this in the pages at the top to allow google bots to get past your security.
if(ereg(gethostbyaddr($_SERVER["REMOTE_ADDR"]),".google.com$")) {
        //POPULATE EMAIL VARIABLE TO ALLOW GOOGLE TO CONTINUE
        $email_address="example@gmail.com";
}

Open in new window

0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
gr8gonzoConsultantCommented:
There are two ways you could identify Google - either by its IP address or by its "User Agent" (which is the browser, like Internet Explorer - Google has its own proprietary one).

User Agent - anyone can change their user agent and do it easily, so anyone could change this and pretend to be Google and get past your required page.

IP address - Google has a list of IP addresses that you can find from SEO forums, and you can code your pages so that it looks at the IP address and lets Google through when it comes from a specific IP address. However, this could be interpreted by Google as a very bad thing called "cloaking"

Cloaking used to be a way that SEO people would optimize pages for specific search engines - they would create a normal page for everyone, but Google (and other search engine robots) would see an entirely different page that was optimized specifically for them. This technique got overused by people who wanted to cheat the system, so Google and other search engines will now penalize your page (or ban it permanently from their search results) if they think you're doing any cloaking.

So bottom line - Google should ALWAYS see exactly what the user sees. If a user sees a required login page, then so should Google. If you try to get around this, Google might think you're trying to scam them and could permanently ban your domain, which would ruin your end goal anyway.

I would go with what Number-1 says in his last paragraph. If you want SEO, then make sure that there are non-protected pages with your optimized content that Google and all other users can see. (Then work on building reverse/inbound links!)
0
anotherdotcommerAuthor Commented:
Thanks!
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Internet Marketing

From novice to tech pro — start learning today.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.