Improve company productivity with a Business Account.Sign Up

x
?
Solved

robots.txt and mobile pages

Posted on 2014-01-07
2
Medium Priority
?
246 Views
Last Modified: 2014-01-07
I have a website where mobile devices are redirected to mobile pages.

Should I exclude these pages from crawlers in my robots.txt file?
0
Comment
Question by:burnedfaceless
2 Comments
 
LVL 58

Accepted Solution

by:
Gary earned 2000 total points
ID: 39762904
No, Google et al like mobile versions of your site (either responsive or mobile specific versions)
Having an indexed version of your mobile site will ensure you turn up in search's on mobile platforms
But remember to have a canonical tag on the mobile versions so you do not get duplicate content penalties

https://developers.google.com/webmasters/smartphone-sites/details
See under Separate mobile URLs
0
 

Author Closing Comment

by:burnedfaceless
ID: 39763347
Thank you
0

Featured Post

Get 10% Off Your First Squarespace Website

Ready to showcase your work, publish content or promote your business online? With Squarespace’s award-winning templates and 24/7 customer service, getting started is simple. Head to Squarespace.com and use offer code ‘EXPERTS’ to get 10% off your first purchase.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

Join & Write a Comment

These seven tips can help you create an extraordinary website, one that captivates audiences and has them wanting to return regularly for more. Keep reading to find out what your site is missing and what you need to add!
Tips to improve your website rankings without needing to change content...
Any person in technology especially those working for big companies should at least know about the basics of web accessibility. Believe it or not there are even laws in place that require businesses to provide such means for the disabled and aging p…
Video by: Mark
This lesson goes over how to construct ordered and unordered lists and how to create hyperlinks.

585 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question