• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 118
  • Last Modified:

Problem with robots.txt

Hi,
I create one

robots.txt

file, within
C:\inetpub\wwwroot

within the current Win 2008 server, but when I'm to acccess this

http://my-friend.co/robots.txt

I get this error

SITE"


Internet Information Services 7.5



Error Summary 
HTTP Error 403.4 - Forbidden

The page you are trying to access is secured with Secure Sockets Layer (SSL).


Detailed Error Information 


Module
IIS Web Core 

Notification
BeginRequest 

Handler
StaticFile 

Error Code
0x80070005 



Requested URL
http://my-friend.co:80/​robots.txt 

Physical Path
C:\inetpub\wwwroot\​robots.txt 

Logon Method
Not yet determined 

Logon User
Not yet determined 



Most likely causes: •Secure Sockets Layer (SSL) is enabled for the URL requested.
•The page request was made over HTTP, but the server requires the request from a secure channel that uses HTTPS

Open in new window

0
HuaMinChen
Asked:
HuaMinChen
  • 3
  • 2
1 Solution
 
Dave BaldwinFixer of ProblemsCommented:
If you can access it at https://my-friend.co/robots.txt, then you have the whole site set up as an HTTPS site.  Your self-signed certificate will be a problem to outsiders.
0
 
HuaMinChenBusiness AnalystAuthor Commented:
Thanks.
But the search engine does expect to access this

http://my-friend.co/robots.txt

instead of accessing "https", doesn't it?
0
 
Dave BaldwinFixer of ProblemsCommented:
I don't think it cares.  It will access thru the same protocol as it used to access the main site.
0
 
HuaMinChenBusiness AnalystAuthor Commented:
Thanks a lot. Is this

<a href="http://my-friend.co/somepage">Some Page</a>

Open in new window


the line I should ensure it is existing within robots.txt?
0
 
HuaMinChenBusiness AnalystAuthor Commented:
Sorry, please disregard my current reply.
0

Featured Post

Hire Technology Freelancers with Gigs

Work with freelancers specializing in everything from database administration to programming, who have proven themselves as experts in their field. Hire the best, collaborate easily, pay securely, and get projects done right.

  • 3
  • 2
Tackle projects and never again get stuck behind a technical roadblock.
Join Now