asked on
web crawlers shutting down my site
I have a tomcat site running on a server2008r2 machine.
My site is no longer responsive.
a netstat -a command yields the results in the attached file
how do I block all those things from jamming my port 80?
thanks
netstata2.txt
My site is no longer responsive.
a netstat -a command yields the results in the attached file
how do I block all those things from jamming my port 80?
thanks
netstata2.txt
Apache Web Server
Last Comment
Guy Lidbetter
SOLUTION
THIS SOLUTION ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
ASKER CERTIFIED SOLUTION
THIS SOLUTION ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
SOLUTION
THIS SOLUTION ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
ASKER
where do I put a robots.txt file? I don't have one right now.
It goes in the root folder of your web site.
hi gateguard,
The wiki page in my very first post explains everything about the robots file.
Regards
Guy
The wiki page in my very first post explains everything about the robots file.
Regards
Guy
I do have a question regarding the wikipedia article, something I don't understand.
The article talks about keeping crawlers out of the site or out of specific folders, but what I don't understand is why are the crawlers establishing all those port 80 connections, which is effectively shutting down the site. Is that their intent?
Thanks again.