Solved

Problem with robots.txt

Posted on 2015-01-28
5
87 Views
Last Modified: 2015-09-09
Hi,
I create one

robots.txt

file, within
C:\inetpub\wwwroot

within the current Win 2008 server, but when I'm to acccess this

http://my-friend.co/robots.txt

I get this error

SITE"


Internet Information Services 7.5



Error Summary 
HTTP Error 403.4 - Forbidden

The page you are trying to access is secured with Secure Sockets Layer (SSL).


Detailed Error Information 


Module
IIS Web Core 

Notification
BeginRequest 

Handler
StaticFile 

Error Code
0x80070005 



Requested URL
http://my-friend.co:80/​robots.txt 

Physical Path
C:\inetpub\wwwroot\​robots.txt 

Logon Method
Not yet determined 

Logon User
Not yet determined 



Most likely causes: •Secure Sockets Layer (SSL) is enabled for the URL requested.
•The page request was made over HTTP, but the server requires the request from a secure channel that uses HTTPS

Open in new window

0
Comment
Question by:HuaMinChen
  • 3
  • 2
5 Comments
 
LVL 82

Expert Comment

by:Dave Baldwin
ID: 40574697
If you can access it at https://my-friend.co/robots.txt, then you have the whole site set up as an HTTPS site.  Your self-signed certificate will be a problem to outsiders.
0
 
LVL 10

Author Comment

by:HuaMinChen
ID: 40582331
Thanks.
But the search engine does expect to access this

http://my-friend.co/robots.txt

instead of accessing "https", doesn't it?
0
 
LVL 82

Accepted Solution

by:
Dave Baldwin earned 500 total points
ID: 40582740
I don't think it cares.  It will access thru the same protocol as it used to access the main site.
0
 
LVL 10

Author Comment

by:HuaMinChen
ID: 40588139
Thanks a lot. Is this

<a href="http://my-friend.co/somepage">Some Page</a>

Open in new window


the line I should ensure it is existing within robots.txt?
0
 
LVL 10

Author Comment

by:HuaMinChen
ID: 40588146
Sorry, please disregard my current reply.
0

Featured Post

Highfive Gives IT Their Time Back

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

Join & Write a Comment

Foreword (May 2015) This web page has appeared at Google.  It's definitely worth considering! https://www.google.com/about/careers/students/guide-to-technical-development.html How to Know You are Making a Difference at EE In August, 2013, one …
Foolproof security solutions has become one of the key necessities of every e-commerce or Internet banking website. If you too own an online shopping site then its vital for you to equip your web portal with customer security features that can allow…
Use Wufoo, an online form creation tool, to make powerful forms. Learn how to selectively show certain fields based on user input using rules to gather relevant information and data from your forms. The rules feature provides you with an opportunity…
Learn how to set-up custom confirmation messages to users who complete your Wufoo form. Include inputs from fields in your form, webpage redirects, and more with Wufoo’s confirmation options.

759 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

20 Experts available now in Live!

Get 1:1 Help Now