Celebrate National IT Professionals Day with 3 months of free Premium Membership. Use Code ITDAY17

x
?
Solved

GoogleBot looking for a 'function.require' file or directory

Posted on 2008-06-21
5
Medium Priority
?
351 Views
Last Modified: 2013-12-08
Hi,

I have a custom 404 page that send me emails (using PHP mail function) when there is a file not found on my server. Today I received this :

Sat Jun 21 2008 1:35:20 pm CDT
66.249.65.99 // crawl-66-249-65-99.googlebot.com tried to load http://www.mydomain.com/function.require
User Agent /Browser = Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

GoogleBot seems to be looking for a file called "function.require" on my website. Can anybody explain what is going on?

I have 2 such errors, second one was with "function.main" instead of "function.require"
0
Comment
Question by:codeQuantum
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
  • 2
5 Comments
 
LVL 5

Author Comment

by:codeQuantum
ID: 21840365
This morning, I got error reports showing that MSN bot is doing the same thing as GoogleBot :

65.55.212.240 // livebot-65-55-212-240.search.live.com tried to load http://www.louisst-jean.com/function.require
User Agent /Browser = msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)

And :

65.55.212.240 // livebot-65-55-212-240.search.live.com tried to load http://www.louisst-jean.com/function.main
User Agent /Browser = msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)

I am starting to think there is some code on my site that induce the spiders in error and make them think there are such links as function.main and function.require. I made a search on my code (using dreamweaver "site wide" code search) for "function.main", and this text appears nowhere on my code...

How do I fix this?
0
 
LVL 75

Assisted Solution

by:Michel Plungjan
Michel Plungjan earned 1500 total points
ID: 21840486
sounds like php require
0
 
LVL 5

Author Comment

by:codeQuantum
ID: 21840525
I have my doubts about that theory.

1) I don't have any PHP require in my code. I only use the require_once() function. (I verified a minute ago, so I am sure of that.)
2) I am aware that PHP can return an error code with function.require. But why would the spiders apply that as a URL?

There are require functions in javascript too. By the way, I am using Google Analytics, Scriptalicious, Prototype, and Lightbox on my site.
0
 
LVL 75

Accepted Solution

by:
Michel Plungjan earned 1500 total points
ID: 21840704
0
 
LVL 5

Author Comment

by:codeQuantum
ID: 21860794
Wow. So the spider is visiting a page... where it is getting a mysql error... and it indexed the function.require link and is now trying to read it...

Mystery solved, thanks.
0

Featured Post

[Webinar] Lessons on Recovering from Petya

Skyport is working hard to help customers recover from recent attacks, like the Petya worm. This work has brought to light some important lessons. New malware attacks like this can take down your entire environment. Learn from others mistakes on how to prevent Petya like worms.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Read this article and get to know some best tips for outsourcing client PPC work to a white label PPC agency.
Whoever said that “a picture is worth one thousand words” observed a fact that can dramatically affect your marketing success. Most people tend to learn visually, so many publishers commonly acknowledge the effectiveness of visual learning by using…
Viewers will get an overview of the benefits and risks of using Bitcoin to accept payments. What Bitcoin is: Legality: Risks: Benefits: Which businesses are best suited?: Other things you should know: How to get started:
An overview of how to create reports in Adobe Analytics (formerly Omniture Site Catalyst) using pageNames, events, eVars and props. This video will show you how to install the Omniture Debugger tool so can see (and test) what is being passed int…
Suggested Courses

730 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question