a description for this result is not available because of this site's robots.txt

Melody Scott
Melody Scott used Ask the Experts™
Hi- If you search tech gardens, you'll see this in place of the meta description. I had the same issue before: https://www.experts-exchange.com/questions/28972532/A-description-for-this-result-is-not-available-because-of-this-site's-robots-txt.html

This time, the robots.txt file reads:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

I've gone to Google and asked it to fetch as Google, but I'm not sure that's all I need to do. Could you advise me, please and thanks?

Site is techgardens.com, wordpress latest release, Divi theme.
Watch Question

Do more with

Expert Office
EXPERT OFFICE® is a registered trademark of EXPERTS EXCHANGE®


I went to Google's robots.txt tester, and it says both the home page and other pages are allowed. But I've made no changes to the robots.txt file.
Your script should block the backend pages (admin area) not the home page frontend which is make sense.
I'm not sure what is the problem.

I use to have an issue once with the meta, the content description displayed was not the one I provided (maybe this is the problem you have) noodp and noydir fixed the problem

I'm using this meta robots for the frontend: noarchive to prevent site archive,  noodp prevent other description than the one I provide (from dmoz) and noydir (from yahoo).

<meta name="robots" content="index, follow, noarchive, noodp, noydir">

Open in new window


ok- I'll try that, thanks! I use plugin Insert Headers and Footers, so it will be added to all pages, that should be ok, right? Thanks.


That worked, thanks!

Do more with

Expert Office
Submit tech questions to Ask the Experts™ at any time to receive solutions, advice, and new ideas from leading industry professionals.

Start 7-Day Free Trial