Help with Performance Monitor Data

I need help making sense of some performance monitor data I have recorded in .csv format. On two different Windows 2003 SQL Database Servers I have two sets of Performance Counters running, once counter is for hardware (free memory, disk read/write etc.) and the other counter is for monitor our SQL Database.

I have been recording the data to the longs the "Text File (Comma delimited) format taking data samples every 1 minute.  I have been running these counter for about 2 weeks and during teh 2 weeks we have made multiple changes to see how to improve performance on the server... the problem is now I'm having trouble putting together all of my gather counters in a way that shows performance trends.  

I can't graph that many different data samples in excel.  I could manually go through and get the highest number for every 60 minute period or all 30 or so counters but you can imagine how long that could take.

Does anyone have any idea's how I can put this captured data into a presentable format? I have attached a smaple file of these .csv files
Proddb01-Operating-System-000003.csv
LVL 3
AIC-AdminAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

aikimarkCommented:
It would be easier to use Access to do your statistical reduction and graphing.
0
aikimarkCommented:
Otherwise, you might use a pivot table that will use an hour-resolution datetime value as the row header.
0
AIC-AdminAuthor Commented:
@ aikimark
Do you happen to know of a website or any tutorials to help me with using Access to create those reductions / graphs?
0
Cloud Class® Course: Certified Penetration Testing

This CPTE Certified Penetration Testing Engineer course covers everything you need to know about becoming a Certified Penetration Testing Engineer. Career Path: Professional roles include Ethical Hackers, Security Consultants, System Administrators, and Chief Security Officers.

aikimarkCommented:
I/we can help you here.  Assuming that you have Access, import the data into a table.
File | Get External Data | Import

check the data for correctness.

Warning: some of your column headers are very long and may not import correctly.

Create a query with all the existing columns and a new column that is the hour-resolution timestamp.
Select Format([proddb01 time], "yyyymmddhh") As ResolutionTime, *
From ImportedTablename

Note: "[proddb01 time]" represents the name of the first column in your imported data.

Create a query to generate your statistics:
Select ResolutionTime, Avg([colname1]), Avg([colname2])
From MyNewQuery
Group By ResolutionTime

Note: If you click on the summation toolbar icon, it will help you create the statistical query.

Create a report, placing a chart object on it.  Use the statistical query as the chart control's source.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Jim P.Commented:
akimark has given good guidance.

You may also want to limit your hours depending on your business model.
0
AIC-AdminAuthor Commented:
I have come to the conclusion that I am recording to many different stats which is causing problems when trying to make sense of the data.  I need to create seperate Performance Logs for more specific tasks not just OS and SQL but like Hard Drive, Memory, CPU, SQL Connections, etc.

I may make use of MS Access but I have also been using LiveGraph(free) to look at some performance counters in a shorter time span of about 4 hours in graph format.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
System Utilities

From novice to tech pro — start learning today.