Solved

Problem with robots.txt

Posted on 2015-01-28
5
105 Views
Last Modified: 2015-09-09
Hi,
I create one

robots.txt

file, within
C:\inetpub\wwwroot

within the current Win 2008 server, but when I'm to acccess this

http://my-friend.co/robots.txt

I get this error

SITE"


Internet Information Services 7.5



Error Summary 
HTTP Error 403.4 - Forbidden

The page you are trying to access is secured with Secure Sockets Layer (SSL).


Detailed Error Information 


Module
IIS Web Core 

Notification
BeginRequest 

Handler
StaticFile 

Error Code
0x80070005 



Requested URL
http://my-friend.co:80/​robots.txt 

Physical Path
C:\inetpub\wwwroot\​robots.txt 

Logon Method
Not yet determined 

Logon User
Not yet determined 



Most likely causes: •Secure Sockets Layer (SSL) is enabled for the URL requested.
•The page request was made over HTTP, but the server requires the request from a secure channel that uses HTTPS

Open in new window

0
Comment
Question by:HuaMinChen
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
  • 2
5 Comments
 
LVL 83

Expert Comment

by:Dave Baldwin
ID: 40574697
If you can access it at https://my-friend.co/robots.txt, then you have the whole site set up as an HTTPS site.  Your self-signed certificate will be a problem to outsiders.
0
 
LVL 11

Author Comment

by:HuaMinChen
ID: 40582331
Thanks.
But the search engine does expect to access this

http://my-friend.co/robots.txt

instead of accessing "https", doesn't it?
0
 
LVL 83

Accepted Solution

by:
Dave Baldwin earned 500 total points
ID: 40582740
I don't think it cares.  It will access thru the same protocol as it used to access the main site.
0
 
LVL 11

Author Comment

by:HuaMinChen
ID: 40588139
Thanks a lot. Is this

<a href="http://my-friend.co/somepage">Some Page</a>

Open in new window


the line I should ensure it is existing within robots.txt?
0
 
LVL 11

Author Comment

by:HuaMinChen
ID: 40588146
Sorry, please disregard my current reply.
0

Featured Post

What Is Transaction Monitoring and who needs it?

Synthetic Transaction Monitoring that you need for the day to day, which ensures your business website keeps running optimally, and that there is no downtime to impact your customer experience.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Before we dive into the marketing strategies involved with creating an effective homepage, it’s crucial that EE members know what a homepage is. In essence, a homepage is the introductory, or default page, of a website that typically highlights the …
Real-time is more about the business, not the technology. In day-to-day life, to make real-time decisions like buying or investing, business needs the latest information(e.g. Gold Rate/Stock Rate). Unlike traditional days, you need not wait for a fe…
This video teaches viewers how to create their own website using cPanel and Wordpress. Tutorial walks users through how to set up their own domain name from tools like Domain Registrar, Hosting Account, and Wordpress. More specifically, the order in…
This video teaches users how to migrate an existing Wordpress website to a new domain.

690 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question