Solved

How to Monitor Multiple Websites

Posted on 2006-11-01
6
246 Views
Last Modified: 2012-03-15
I work for a website hosting company.  We currently host a couple thousand of websites.
What I am looking for is an application that will monitor all those websites on a scheduled basis and report when
a website is down, offline, or has been changed in any way.

Also, it would be good if I could upload all our domain names in mass rather than one at a time, if you know what I mean.

Is there an application or web service out there that does this?

Michael
0
Comment
Question by:Morya1
6 Comments
 
LVL 1

Accepted Solution

by:
ukwebguy earned 250 total points
ID: 17850213
There are a lot of applications that will allow you to monitor websites, I put "monitor websites" in google and came up with a few.
Ive never used any myself so I cannot comment on indavidual programs. I suspect that many will require payment to use for an extended amount of time, they will all provide a different amount of reporting too. Some allow you to look for a specific word on a page for example, others just look for "a page" some look for a specific page...

Another option is to make one yourself. for very basic functionality ( using vb.net or similar ) connect to the website, http://your.website.here on port 80 and look for a response code in the header of the reply. This way you can tell if you get a successful page or an error or nothing at all.

As a hosting company, I would suggest looking for the codes 200 - success, 404 - page not found, 500 - internal server error and 403 - access denied or waiting for a timeout of say 15 sec.

I personally would recomend the build it yourself, with a little knowledge of HTTP protocol you can at least work out if the website is there or not.

Hope this helps,

Regards
0
 
LVL 6

Assisted Solution

by:Basilisci
Basilisci earned 250 total points
ID: 17850240
monit ( http://www.tildeslash.com/monit/ ) has worked for me, although I only have a ten or so different websites to monitor. Its a simple linux daemon that can monitor various services, and can be configured to do many things when a failure is detected, like emailing a user or restarting the web servers. It's quite easy to use too.

One possible configuration would look like this (file: /etc/monit/monitrc)

# set monitor interval to 3 minutes
set daemon  180

# send alert emails to this adress
set alert webmaster@hostingcompany.com

# this should be self-explanatory
check host mydomain.com with address mydomain.com
    if failed port 80 protocol http request "/"
       with timeout 10 seconds then alert

check host somedomain.com with address somedomain.com
    if failed port 80 protocol http request "/"
       with timeout 10 seconds then alert

0
 

Author Comment

by:Morya1
ID: 18006149
I agree, There was no really acceptable or practical answer for this question.
0

Featured Post

What Should I Do With This Threat Intelligence?

Are you wondering if you actually need threat intelligence? The answer is yes. We explain the basics for creating useful threat intelligence.

Join & Write a Comment

Introduction HTML checkboxes provide the perfect way for a web developer to receive client input when the client's options might be none, one or many.  But the PHP code for processing the checkboxes can be confusing at first.  What if a checkbox is…
Both Easy and Powerful How easy is PHP? http://lmgtfy.com?q=how+easy+is+php (http://lmgtfy.com?q=how+easy+is+php)  Very easy.  It has been described as "a programming language even my grandmother can use." How powerful is PHP?  http://en.wikiped…
Explain concepts important to validation of email addresses with regular expressions. Applies to most languages/tools that uses regular expressions. Consider email address RFCs: Look at HTML5 form input element (with type=email) regex pattern: T…
This tutorial demonstrates how to identify and create boundary or building outlines in Google Maps. In this example, I outline the boundaries of an enclosed skatepark within a community park.  Login to your Google Account, then  Google for "Google M…

759 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

18 Experts available now in Live!

Get 1:1 Help Now