how to find unique requests in apache logs

Posted on 2012-08-14
Last Modified: 2012-09-18

i need to find unique requests per day and total page views per day for websites running on apache 2.2 (redhat linux)

I googled and found few solutions but problems are:
1) this web-server belongs to a firm and is accessible from internet and intranet.From intranet all requests goes through
proxy if 2 different internal users are accessing this site,they would come from same cant find unique requests
based on unique IPs by running awk '{print 1}' on apache log
2)For 1 hit ,i see more than 1 line in apache log.
That is ,if i hit , i see 17 lines in apache logs.That is counting rows of lines from unique IP(this imples
for external users) wont give the correct number.

I have attached few lines from aacess logs which were generated when i hit

Could you please advise how i can get the requirement done.

Thank you
Question by:jayatallen
    1 Comment
    LVL 26

    Accepted Solution


    Without using a cookie based solution  e.g. Google Analytics you'll not be able to work around the proxy issues.

    If your limited to the access logs I'd suggest you have a play with AWStats as it will happily exclude image, css and js file GET's for a start, which should improve your numbers slightly.

    Write Comment

    Please enter a first name

    Please enter a last name

    We will never share this with anyone.

    Featured Post

    How to run any project with ease

    Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
    - Combine task lists, docs, spreadsheets, and chat in one
    - View and edit from mobile/offline
    - Cut down on emails

    If you are running a LAMP infrastructure, this little code snippet is very helpful if you are serving lots of HTML, JavaScript and CSS-related information. The mod_deflate module, which is part of the Apache 2.2 application, provides the DEFLATE…
    Using 'screen' for session sharing, The Simple Edition Step 1: user starts session with command: screen Step 2: other user (logged in with same user account) connects with command: screen -x Done. Both users are connected to the same CLI sessio…
    Learn how to get help with Linux/Unix bash shell commands. Use help to read help documents for built in bash shell commands.: Use man to interface with the online reference manuals for shell commands.: Use man to search man pages for unknown command…
    Connecting to an Amazon Linux EC2 Instance from Windows Using PuTTY.

    760 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    7 Experts available now in Live!

    Get 1:1 Help Now