Pedro Chagas
asked on
My robots.txt file is well written
Hi E's, I just want to known if my file robots.txt is well written.
The objective is allow all my pages, but disallow 12 url's, for all agents:
========================== =========
User-agent: *
Disallow: /comprar-zara
Disallow: /politica-de-privacidade
Disallow: /comprar-zara-lisboa
Disallow: /melhores-saldos-2018-lisb oa
Disallow: /temas/viagem
Disallow: /temas/compras
Disallow: /temas/compras-saldos
Disallow: /temas/viagem-portugal
Disallow: /melhores-saldos-2018
Disallow: /cremes-para-quase-tudo
Disallow: /temas/saude-cremes-de-bel eza
Disallow: /temas/moda-compras-e-sald os
Allow: /
========================== ========
The big question is, the "Allow: /" should be at the top or bottom?
Regards, JC
The objective is allow all my pages, but disallow 12 url's, for all agents:
==========================
User-agent: *
Disallow: /comprar-zara
Disallow: /politica-de-privacidade
Disallow: /comprar-zara-lisboa
Disallow: /melhores-saldos-2018-lisb
Disallow: /temas/viagem
Disallow: /temas/compras
Disallow: /temas/compras-saldos
Disallow: /temas/viagem-portugal
Disallow: /melhores-saldos-2018
Disallow: /cremes-para-quase-tudo
Disallow: /temas/saude-cremes-de-bel
Disallow: /temas/moda-compras-e-sald
Allow: /
==========================
The big question is, the "Allow: /" should be at the top or bottom?
Regards, JC
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Happy to help, Pedro. Thanks for the points.
ASKER