?
Solved

A description for this result is not available because of this site's robots.txt

Posted on 2016-09-26
13
Medium Priority
?
175 Views
Last Modified: 2016-09-29
Hi, When I search Google with a new site I put up, rockypointfishingservices.com, I get this message: A description for this result is not available because of this site's robots.txt

But on Friday I added a robots.txt file to the root. http://rockypointfishingservices.com/robots.txt

What can I do? Is it just that Google hasn't re-browsed me? Thanks for any advice.
0
Comment
Question by:mel200
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 8
  • 3
13 Comments
 
LVL 35

Assisted Solution

by:Terry Woods
Terry Woods earned 2000 total points
ID: 41817028
Your robots.txt file currently contains:
User-Agent: *
Disallow: /wp-content/plugins/
Disallow: /readme.html

Open in new window


You don't want to block your plugins folder from robots. Details explained here:
https://yoast.com/wordpress-robots-txt-example/

It might be easiest just to install the Yoast plugin; the author has clearly put some thought into it, and it's free.
1
 

Author Comment

by:mel200
ID: 41817111
Thanks!
0
 

Author Comment

by:mel200
ID: 41817114
I've already got an SEO plugin, I really don't want to add plugins if I can avoid it. I've made the robots.txt file simple:

User-agent: *
Disallow:

If anyone else can chime in, I'd appreciate another point of view as well. Thanks!
0
VIDEO: THE CONCERTO CLOUD FOR HEALTHCARE

Modern healthcare requires a modern cloud. View this brief video to understand how the Concerto Cloud for Healthcare can help your organization.

 
LVL 35

Expert Comment

by:Terry Woods
ID: 41822414
In the Google Webmasters tools, there's a "robots.txt Tester" tool and also a tool for asking Google to load the site as a robot "Fetch as Google". Both these are under the Crawl section of the tools.

Have a play with those, in case Google needs to be told that the robots.txt has changed, or in case it gives any other clues as to what's happening.
1
 

Author Comment

by:mel200
ID: 41822445
Thanks, will try that!!
0
 

Author Comment

by:mel200
ID: 41822458
OK, that says this, does it mean that message will go away soon?

capture
0
 
LVL 35

Accepted Solution

by:
Terry Woods earned 2000 total points
ID: 41822491
Maybe. You might try using "Fetch as Google" to fetch the site too, as once fetched I think you get an option Submit to Index, which may help.
1
 

Author Comment

by:mel200
ID: 41822568
Interesting. At first I got this "redirected" announcement, then I submitted and got this. The domain is registered and hosted at Bluehost.  It's a wordpress installation. What might I have done wrong, any idea?

screenshot v2
0
 

Author Comment

by:mel200
ID: 41822574
Um... never mind that last. It's because I selected http://www.... as my preferred domain.
0
 

Author Comment

by:mel200
ID: 41822592
I did it again on the www. version. It said Status: partial.

I read this, which seems to indicate again a problem with the robots.txt file.
https://productforums.google.com/forum/#!topic/webmasters/3X0X8c3c39U
0
 

Author Closing Comment

by:mel200
ID: 41822852
Finally got it, thanks for your help!
0

Featured Post

On Demand Webinar: Networking for the Cloud Era

Did you know SD-WANs can improve network connectivity? Check out this webinar to learn how an SD-WAN simplified, one-click tool can help you migrate and manage data in the cloud.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

There’s a good reason for why it’s called a homepage – it closely resembles that of a physical house and the only real difference is that it’s online. Your website’s homepage is where people come to visit you. It’s the family room of your website wh…
When crafting your “Why Us” page, there are a plethora of pitfalls to avoid. Follow these five tips, and you’ll be well on your way to creating an effective page.
This tutorial will teach you the core code needed to finalize the addition of a watermark to your image. The viewer will use a small PHP class to learn and create a watermark.
Any person in technology especially those working for big companies should at least know about the basics of web accessibility. Believe it or not there are even laws in place that require businesses to provide such means for the disabled and aging p…
Suggested Courses

762 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question