Solved

robots.txt and mobile pages

Posted on 2014-01-07
2
231 Views
Last Modified: 2014-01-07
I have a website where mobile devices are redirected to mobile pages.

Should I exclude these pages from crawlers in my robots.txt file?
0
Comment
Question by:burnedfaceless
2 Comments
 
LVL 58

Accepted Solution

by:
Gary earned 500 total points
ID: 39762904
No, Google et al like mobile versions of your site (either responsive or mobile specific versions)
Having an indexed version of your mobile site will ensure you turn up in search's on mobile platforms
But remember to have a canonical tag on the mobile versions so you do not get duplicate content penalties

https://developers.google.com/webmasters/smartphone-sites/details
See under Separate mobile URLs
0
 

Author Closing Comment

by:burnedfaceless
ID: 39763347
Thank you
0

Featured Post

Master Your Team's Linux and Cloud Stack!

The average business loses $13.5M per year to ineffective training (per 1,000 employees). Keep ahead of the competition and combine in-person quality with online cost and flexibility by training with Linux Academy.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Any business that wants to seriously grow needs to keep the needs and desires of an international audience of their websites in mind. Making a website friendly to international users isn’t prohibitively expensive and can provide an incredible return…
Online promotion is consistently becoming more important for all types of businesses. From Facebook ads to search engines to YouTube videos, there are all sorts of channels that can effectively be used to promote a business or product. But how shoul…
The viewer will learn how to count occurrences of each item in an array.
The viewer will get a basic understanding of what section 508 compliance can entail, learn about skip navigation links, alt text, transcripts, and font size controls.

832 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question