I recently added Application.cfm to my site with error handling that will email me when an error occurs. My ErrorHandler.cfm
An error occurred: http://#cgi.server_name##cgi.script_name#?#cgi.query_string#
Time: #dateFormat(now(), "short")# #timeFormat(now(), "short")#<br />
<cfdump var="#error#" label="Error">
<cfdump var="#form#" label="Form">
<cfdump var="#url#" label="URL">
<!--- finally email yourself the error details --->
<cfmail to="firstname.lastname@example.org" from="email@example.com" subject="Error: #error.message#" type="html">
I got hammered by bots which were hitting bad links ... in many occasions they seemed to be adding varibles to my url and others were hitting oldd outfdated urls. Using some ingenuity, I managed to code most of those error hits away.
Recently, I just made some major changes to a section of the site whcih included changing some urls. Immediatley I began to get bot hits on my old urls ...! grrrr I am tired of waking up to 200+ emails ...
My question: How do bots work? Will they keep trying urls that fails forever or do they learn and eventually stop trying? Do they actually ADD variables to an url? If so, why do they do that ... is it an attack?