Capacity Planning Tool(s)/Log Parsing

We are currently in the process of compiling reporting in order to make some projections with our cloud/storage environment.  However, we currently have no baseline(s) in place, with regards to monitoring software.  Does anyone have any recommendations/suggestions to gather/compile information based on event logs, etc. for predictive analytics (i.e. data transfer, SQL transactions, etc.)?  Looking for the most common/specific counters for IIS, FTP, and SQL traffic.
LVL 1
amazon4lifeAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

bbaoIT ConsultantCommented:
i think you need two approaches to cover your whole requirements on capacity planning and monitoring.

at first, the static approach, a set of tools for capacity planning based on official or unofficial best practices on given OS and application platforms. for Windows OS and MS application servers, see below the MSDN article giving an overall considerations for an enterprise environment. the article is a bit of outdated on the products but the principles are the same for today.

Tools for Capacity Planning
https://msdn.microsoft.com/en-us/library/ms978394.aspx

the second is a dynamic approach, to monitor the related servers against given counters as you mentioned. be aware that this commonly is not based on event logs as there is no significant performance information available in the logs. instead, you need to run Windows Performance Monitor to provide a visual display of built-in performance counters, either in real time or as a way to review historical data (which is the data source for your baselines).

Overview of Windows Performance Monitor
https://technet.microsoft.com/en-us/library/cc749154.aspx 

just hope it helps,
bbao
Shalom CarmelCTOCommented:
Check out Sumologic.com.

Once you get your IIS, OS and SQL logs, you have ready made dashboards and reports including metrics you may have not thought about. All dashboards can be modified and extended by you. And if you are on virtual datacenters like AWS, then there is a bunch of dashboards for that as well.

Parsing IIS logs:
https://service.us2.sumologic.com/help/Default.htm#Parsing_Microsoft_IIS_Logs.htm%3FTocPath%3DSearching%2520Data%7CSearch%2520Query%2520Language%7CParsing%7C_____11

Parsing Windows logs:
https://service.us2.sumologic.com/help/Default.htm#Parsing_Windows_Server_2008_Logs.htm%3FTocPath%3DSearching%2520Data%7CSearch%2520Query%2520Language%7CParsing%7C_____12

Ready IIS dashboards:
https://service.us2.sumologic.com/help/Default.htm#IIS_App.htm%3FTocPath%3DApps%7CSumo%2520Logic%2520App%2520for%2520IIS%7C_____0

Ready AWS CloudTrail dashboards:
https://service.us2.sumologic.com/help/Default.htm#CloudTrail_App.htm%3FTocPath%3DApps%7CSumo%2520Logic%2520App%2520for%2520AWS%2520CloudTrail%7C_____0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
NVITEnd-user supportCommented:
Also consider Microsoft Assessment and Planning Toolkit
The Microsoft Assessment and Planning Toolkit makes it easy to assess your current IT infrastructure for a variety of technology migration projects. This Solution Accelerator provides a powerful inventory, assessment, and reporting tool to simplify the migration planning process.
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Cloud Computing

From novice to tech pro — start learning today.