Solved

What does this two lines mean in robots.txt

Posted on 2012-03-14
2
318 Views
Last Modified: 2012-03-14
Can my site be properly indexed with these two lines in placed?

User-agent:*
disallow:

Open in new window

0
Comment
Question by:jay28lee
2 Comments
 
LVL 7

Accepted Solution

by:
Ironhoofs earned 500 total points
ID: 37719628
With that Robots.txt you allow all robots access to the entire site (same as removing robots.txt). For more information see: http://www.robotstxt.org/robotstxt.html
0
 
LVL 8

Expert Comment

by:Elmar-H
ID: 37719645
yes, you don`t disallow anything for anyone.
0

Featured Post

Networking for the Cloud Era

Join Microsoft and Riverbed for a discussion and demonstration of enhancements to SteelConnect:
-One-click orchestration and cloud connectivity in Azure environments
-Tight integration of SD-WAN and WAN optimization capabilities
-Scalability and resiliency equal to a data center

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
move widget title down 4 25
ebay seller html tags 2 33
What does GoogleTagMgr javascripts below do 5 26
Error in Angular 2 when showing in grid 4 21
Learn by example how to specify CSS selectors for Selenium WebDriver test automation software.
Because your company can’t afford for you to make SEO mistakes, you’ll want to ensure you’re taking the right steps each and every time you post a new piece of content. This list of optimization do’s and don’ts can help you become an SEO wizard.
Video by: Mark
This lesson goes over how to construct ordered and unordered lists and how to create hyperlinks.
The is a quite short video tutorial. In this video, I'm going to show you how to create self-host WordPress blog with free hosting service.

789 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question