Solved

robots.txt and mobile pages

Posted on 2014-01-07
2
233 Views
Last Modified: 2014-01-07
I have a website where mobile devices are redirected to mobile pages.

Should I exclude these pages from crawlers in my robots.txt file?
0
Comment
Question by:burnedfaceless
2 Comments
 
LVL 58

Accepted Solution

by:
Gary earned 500 total points
ID: 39762904
No, Google et al like mobile versions of your site (either responsive or mobile specific versions)
Having an indexed version of your mobile site will ensure you turn up in search's on mobile platforms
But remember to have a canonical tag on the mobile versions so you do not get duplicate content penalties

https://developers.google.com/webmasters/smartphone-sites/details
See under Separate mobile URLs
0
 

Author Closing Comment

by:burnedfaceless
ID: 39763347
Thank you
0

Featured Post

Active Directory Webinar

We all know we need to protect and secure our privileges, but where to start? Join Experts Exchange and ManageEngine on Tuesday, April 11, 2017 10:00 AM PDT to learn how to track and secure privileged users in Active Directory.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

This article will inform Clients about common and important expectations from the freelancers (Experts) who are looking at your Gig.
FAQ pages provide a simple way for you to supply and for customers to find answers to the most common questions about your company. Here are six reasons why your company website should have a FAQ page
Viewers will get an overview of the benefits and risks of using Bitcoin to accept payments. What Bitcoin is: Legality: Risks: Benefits: Which businesses are best suited?: Other things you should know: How to get started:
Any person in technology especially those working for big companies should at least know about the basics of web accessibility. Believe it or not there are even laws in place that require businesses to provide such means for the disabled and aging p…

828 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question