troubleshooting Question

Robots.txt file is it needed

Avatar of nsitedesigns
nsitedesignsFlag for United States of America asked on
Web DevelopmentHTMLWeb Browsers
7 Comments3 Solutions442 ViewsLast Modified:
I submitted a site to a search engine and got a warning that this site does NOT have a robots.txt file.  It is my understanding that this file tells robots NOT to visit certain pages of your site.  Since there aren't any pages we are "hiding" why would I need this document?
ASKER CERTIFIED SOLUTION
Join our community to see this answer!
Unlock 3 Answers and 7 Comments.
Start Free Trial
Learn from the best

Network and collaborate with thousands of CTOs, CISOs, and IT Pros rooting for you and your success.

Andrew Hancock - VMware vExpert
See if this solution works for you by signing up for a 7 day free trial.
Unlock 3 Answers and 7 Comments.
Try for 7 days

”The time we save is the biggest benefit of E-E to our team. What could take multiple guys 2 hours or more each to find is accessed in around 15 minutes on Experts Exchange.

-Mike Kapnisakis, Warner Bros