log analysis requirements...

Posted on 2009-05-16
Last Modified: 2012-05-07
I have log analysis project...and I am planning to analyze a huge logs,,,can u help me with the best PCs or requirements that should be meet on the used devices for this issue.
my target is fast and huge hard disks..
Question by:besmile4ever
  • 3
  • 3

Author Comment

ID: 24405672
no response..
LVL 14

Expert Comment

ID: 24406210
Can you give more info about what you are doing , whats the O/S used, do you want H/W specs , or software tools, do you have a application that you are already using, do you want to run scripts...etc
LVL 32

Expert Comment

by:Kamran Arshad
ID: 24409000

I agree with small_student, until and unless you know the type of servers, then we can suggest you a product log analyzer.
Network it in WD Red

There's an industry-leading WD Red drive for every compatible NAS system to help fulfill your data storage needs. With drives up to 8TB, WD Red offers a wide array of solutions for customers looking to build the biggest, best-performing NAS storage solution.  


Author Comment

ID: 24409253
Good gents.
what i want is the recommended system or H/W specs that i can use to complete my is something like a research. i need to know how to design and implement the structure or environment. also if u have any helpful software it will be appreciated.

LVL 14

Expert Comment

ID: 24415900
A simple easy to use approach is to use logwatch on a linux server, on linux servers, all your services, web, mail, ftp, ssh , mysql db, disk usage, network usage and many more have extensive log files.

logwatch parses these big files and generates reports that are sent by mail to you or saved on files on the disk

webalizer is an analyzing tool for web and proxy servers. web interface and cool feautures.

The products I listed above are open source and free to use.


Author Comment

ID: 24418610
thanks small_student.
ok what about the hardware specs that i need to use to work easy in log analysis process.
LVL 14

Accepted Solution

small_student earned 500 total points
ID: 24420312
It depends on how many log files you will analyze, if it was for a single server , say with web , ftp and mail and file sharing , the same server will hold the log analysis job.

logwatch is bunch of perl scripts nothing special and webilizer run on apache and requires no special H/W.

Note: other apps and methods might require certain specs
Note: if you will analyze say 100 servers on one log server then a 2.0GHz full cache and 1G RAM is enough and like said this is if you were using logwatch

Best Regards

Featured Post

What Security Threats Are You Missing?

Enhance your security with threat intelligence from the web. Get trending threat insights on hackers, exploits, and suspicious IP addresses delivered to your inbox with our free Cyber Daily.

Join & Write a Comment

Suggested Solutions

Title # Comments Views Activity
Netapp and Vcenter report 9 61
People Counting Software 2 61
MSP multi use software 4 79
Vmware Vcenter vSphere startup 3 52
A high-level exploration of how our ever-increasing access to information has changed the way we do our jobs.
This article describes how to use the timestamp of existing data in a database to allow Tableau to calculate the prior work day instead of relying on case statements or if statements to calculate the days of the week.
This video demonstrates how to use each tool, their shortcuts, where and when to use them, and how to use the keyboard to improve workflow.
In this tutorial you'll learn about bandwidth monitoring with flows and packet sniffing with our network monitoring solution PRTG Network Monitor ( If you're interested in additional methods for monitoring bandwidt…

706 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

20 Experts available now in Live!

Get 1:1 Help Now