We help IT Professionals succeed at work.

What does this two lines mean in robots.txt

jay28lee
jay28lee asked
on
Medium Priority
360 Views
Last Modified: 2012-03-14
Can my site be properly indexed with these two lines in placed?

User-agent:*
disallow:

Open in new window

Comment
Watch Question

With that Robots.txt you allow all robots access to the entire site (same as removing robots.txt). For more information see: http://www.robotstxt.org/robotstxt.html
Elmar KoschkaSenior System Engineer
CERTIFIED EXPERT

Commented:
yes, you don`t disallow anything for anyone.

Explore More ContentExplore courses, solutions, and other research materials related to this topic.