how to find unique requests in apache logs

Posted on 2012-08-14
Medium Priority
Last Modified: 2012-09-18

i need to find unique requests per day and total page views per day for websites running on apache 2.2 (redhat linux)

I googled and found few solutions but problems are:
1) this web-server belongs to a firm and is accessible from internet and intranet.From intranet all requests goes through
proxy server.so if 2 different internal users are accessing this site,they would come from same IP.so cant find unique requests
based on unique IPs by running awk '{print 1}' on apache log
2)For 1 hit ,i see more than 1 line in apache log.
That is ,if i hit ts.testing.com , i see 17 lines in apache logs.That is counting rows of lines from unique IP(this imples
for external users) wont give the correct number.

I have attached few lines from aacess logs which were generated when i hit ts.testing.com/pages/test

Could you please advise how i can get the requirement done.

Thank you
Question by:jayatallen
1 Comment
LVL 26

Accepted Solution

arober11 earned 2000 total points
ID: 38292115

Without using a cookie based solution  e.g. Google Analytics you'll not be able to work around the proxy issues.

If your limited to the access logs I'd suggest you have a play with AWStats as it will happily exclude image, css and js file GET's for a start, which should improve your numbers slightly.

Featured Post

Concerto Cloud for Software Providers & ISVs

Can Concerto Cloud Services help you focus on evolving your application offerings, while delivering the best cloud experience to your customers? From DevOps to revenue models and customer support, the answer is yes!

Learn how Concerto can help you.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

I. Introduction There's an interesting discussion going on now in an Experts Exchange Group — Attachments with no extension (http://www.experts-exchange.com/discussions/210281/Attachments-with-no-extension.html). This reminded me of questions tha…
The title says it all. Writing any type of PHP Application or API code that provides high throughput, while under a heavy load, seems to be an arcane art form (Black Magic). This article aims to provide some general guidelines for producing this typ…
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.
How to Install VMware Tools in Red Hat Enterprise Linux 6.4 (RHEL 6.4) Step-by-Step Tutorial
Suggested Courses
Course of the Month15 days, 12 hours left to enroll

850 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question