Help with Performance Monitor Data

I need help making sense of some performance monitor data I have recorded in .csv format. On two different Windows 2003 SQL Database Servers I have two sets of Performance Counters running, once counter is for hardware (free memory, disk read/write etc.) and the other counter is for monitor our SQL Database.

I have been recording the data to the longs the "Text File (Comma delimited) format taking data samples every 1 minute.  I have been running these counter for about 2 weeks and during teh 2 weeks we have made multiple changes to see how to improve performance on the server... the problem is now I'm having trouble putting together all of my gather counters in a way that shows performance trends.  

I can't graph that many different data samples in excel.  I could manually go through and get the highest number for every 60 minute period or all 30 or so counters but you can imagine how long that could take.

Does anyone have any idea's how I can put this captured data into a presentable format? I have attached a smaple file of these .csv files
Proddb01-Operating-System-000003.csv
LVL 3
AIC-AdminAsked:
Who is Participating?
 
aikimarkConnect With a Mentor Commented:
I/we can help you here.  Assuming that you have Access, import the data into a table.
File | Get External Data | Import

check the data for correctness.

Warning: some of your column headers are very long and may not import correctly.

Create a query with all the existing columns and a new column that is the hour-resolution timestamp.
Select Format([proddb01 time], "yyyymmddhh") As ResolutionTime, *
From ImportedTablename

Note: "[proddb01 time]" represents the name of the first column in your imported data.

Create a query to generate your statistics:
Select ResolutionTime, Avg([colname1]), Avg([colname2])
From MyNewQuery
Group By ResolutionTime

Note: If you click on the summation toolbar icon, it will help you create the statistical query.

Create a report, placing a chart object on it.  Use the statistical query as the chart control's source.
0
 
aikimarkCommented:
It would be easier to use Access to do your statistical reduction and graphing.
0
 
aikimarkCommented:
Otherwise, you might use a pivot table that will use an hour-resolution datetime value as the row header.
0
The new generation of project management tools

With monday.com’s project management tool, you can see what everyone on your team is working in a single glance. Its intuitive dashboards are customizable, so you can create systems that work for you.

 
AIC-AdminAuthor Commented:
@ aikimark
Do you happen to know of a website or any tutorials to help me with using Access to create those reductions / graphs?
0
 
Jim P.Connect With a Mentor Commented:
akimark has given good guidance.

You may also want to limit your hours depending on your business model.
0
 
AIC-AdminAuthor Commented:
I have come to the conclusion that I am recording to many different stats which is causing problems when trying to make sense of the data.  I need to create seperate Performance Logs for more specific tasks not just OS and SQL but like Hard Drive, Memory, CPU, SQL Connections, etc.

I may make use of MS Access but I have also been using LiveGraph(free) to look at some performance counters in a shorter time span of about 4 hours in graph format.
0
All Courses

From novice to tech pro — start learning today.