log analysis requirements...

Posted on 2009-05-16
Last Modified: 2012-05-07
I have log analysis project...and I am planning to analyze a huge logs,,,can u help me with the best PCs or requirements that should be meet on the used devices for this issue.
my target is fast and huge hard disks..
Question by:besmile4ever
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
  • 3

Author Comment

ID: 24405672
no response..
LVL 14

Expert Comment

by:Monis Monther
ID: 24406210
Can you give more info about what you are doing , whats the O/S used, do you want H/W specs , or software tools, do you have a application that you are already using, do you want to run scripts...etc
LVL 32

Expert Comment

by:Kamran Arshad
ID: 24409000

I agree with small_student, until and unless you know the type of servers, then we can suggest you a product log analyzer.
Optimizing Cloud Backup for Low Bandwidth

With cloud storage prices going down a growing number of SMBs start to use it for backup storage. Unfortunately, business data volume rarely fits the average Internet speed. This article provides an overview of main Internet speed challenges and reveals backup best practices.


Author Comment

ID: 24409253
Good gents.
what i want is the recommended system or H/W specs that i can use to complete my is something like a research. i need to know how to design and implement the structure or environment. also if u have any helpful software it will be appreciated.

LVL 14

Expert Comment

by:Monis Monther
ID: 24415900
A simple easy to use approach is to use logwatch on a linux server, on linux servers, all your services, web, mail, ftp, ssh , mysql db, disk usage, network usage and many more have extensive log files.

logwatch parses these big files and generates reports that are sent by mail to you or saved on files on the disk

webalizer is an analyzing tool for web and proxy servers. web interface and cool feautures.

The products I listed above are open source and free to use.


Author Comment

ID: 24418610
thanks small_student.
ok what about the hardware specs that i need to use to work easy in log analysis process.
LVL 14

Accepted Solution

Monis Monther earned 500 total points
ID: 24420312
It depends on how many log files you will analyze, if it was for a single server , say with web , ftp and mail and file sharing , the same server will hold the log analysis job.

logwatch is bunch of perl scripts nothing special and webilizer run on apache and requires no special H/W.

Note: other apps and methods might require certain specs
Note: if you will analyze say 100 servers on one log server then a 2.0GHz full cache and 1G RAM is enough and like said this is if you were using logwatch

Best Regards

Featured Post

On Demand Webinar - Networking for the Cloud Era

This webinar discusses:
-Common barriers companies experience when moving to the cloud
-How SD-WAN changes the way we look at networks
-Best practices customers should employ moving forward with cloud migration
-What happens behind the scenes of SteelConnect’s one-click button

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

The question appears often enough, how do I transfer my data from my old server to the new server while preserving file shares, share permissions, and NTFS permisions.  Here are my tips for handling such a transfer.
Is your phone running out of space to hold pictures?  This article will show you quick tips on how to solve this problem.
This video teaches viewers how to encrypt an external drive that requires a password to read and edit the drive. All tasks are done in Disk Utility. Plug in the external drive you wish to encrypt: Make sure all previous data on the drive has been …
This tutorial will walk an individual through the process of installing the necessary services and then configuring a Windows Server 2012 system as an iSCSI target. To install the necessary roles, go to Server Manager, and select Add Roles and Featu…

739 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question