rgb192
asked on
How to resubmit robots.txt. I know how to resubmit sitemap.xml to google webmaster tools but do not want to wait 24 hour.
How to resubmit robots.txt. I know how to resubmit sitemap.xml to google webmaster tools but do not want to wait 24 hour.
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
You can test here
http://tools.seobook.com/robots-txt/analyzer/
Enter your rules and on the next screen some sample urls.
http://tools.seobook.com/robots-txt/analyzer/
Enter your rules and on the next screen some sample urls.
ASKER
http://tools.seobook.com/robots-txt/analyzer/
Robots allowed: All robots
does not analyze
allow
dissallow
Robots allowed: All robots
does not analyze
allow
dissallow
B-) just remember that allow does not work, is not part of the standard
Maybe not part of the standard but Bing and Google do observe it (supposedly)
rgb - try with the second example of the robots I gave you.
rgb - try with the second example of the robots I gave you.
ASKER
So I have to wait
and thanks for the additional information about download size and pointers to sitemap
and thanks for the additional information about download size and pointers to sitemap
ASKER
GaryC123 is giving me advice how to test
disallow
allow
but every test would take over a day
is there a sandbox for testing of my website