Exchange Server Vol that holds Trans Logs has an extermely high Avg. Disk Queue Length

Posted on 2014-11-19
Medium Priority
Last Modified: 2014-11-27
Users are experiencing extreme latencies within Outlook. This has been getting progressively worse.
I ran some Performance Monitoring on the server and found that the volume (D:\) has a very high Avg Disk Queue Length.
over a 1:40 minute duration
Low: 1.126
High: 296.741
Avg: 17.352
This server is setup as:
C:\ is the OS (RAID1)
D:\ Trans action and Exchange program directory (RAID1)
E:\ & F:\  Information stores RAID5  

I am not seeing high Avg Disk Queue's, Reads or Writes on the E: & F: drive.  

Would I be better off creating a new ARRAY RAID5 for the Trans Logs?
Question by:yo_bee
  • 6
  • 4

Accepted Solution

valmatic earned 1000 total points
ID: 40452479
I see the raid setup now. RAID 1 not going to gain you any performance on the trans logs. Raid 5 would be better if you had the disks. Are you backing it up where the logs are getting flushed every night? If not the logs can get huge, what size are you seeing on that disk for the logs.
LVL 25

Author Comment

ID: 40452957
Full backups once a week daily incremental (All logs are flushed).
I do have the disks to build a RAID5 for the Log Vol.
So you would recommend that I create this ARRAY and move the Trans Logs to the this location.
LVL 31

Expert Comment

by:Gareth Gudger
ID: 40454234
Those or some high spikes.

Do you have antivirus loaded onto the server? If so, have you excluded all the necessary file locations and Exchange processes?

This is Microsoft's document on what you should exclude from all antivirus scans (whether on demand, real time or scheduled). http://technet.microsoft.com/en-us/library/bb332342(v=exchg.150).aspx

My rule of thumb is to always exclude the Databases, Log Files and the Exchange Install Directory at a minimum. So in your case you may want to completely exclude all of D, E and F.

What about backup windows? Have you confirmed backups are not running over during these times of spikes and poor performance?

Shadow Copies are disabled on those volumes right?

I am assuming this is a physical server. But if virtual, any kind of volume snapping or virtual snap could be causes performance related issues.
Problems using Powershell and Active Directory?

Managing Active Directory does not always have to be complicated.  If you are spending more time trying instead of doing, then it's time to look at something else. For nearly 20 years, AD admins around the world have used one tool for day-to-day AD management: Hyena. Discover why

LVL 25

Author Comment

ID: 40454833
I am doing some more analysis on this server.  I am collecting Avg Disk Transfer/sec per vol, user Counts, Avg Disk Read/sec Avg Disk Write/sec, Avg Disk Queue Length

It is a physical one and old one as well.  I am still running Exchange 2003.

Anti-Virus has been removed for troubleshooting.  Still avg 30% CPU usage for Store.exe.

I am in the beginning stages of putting together the right setup for my 2010.

I need to make sure that I have it properly spec out.  
It will be Virtual.  I want to make sure my SAN is prepared for this addition.

I will post the results later.
LVL 31

Assisted Solution

by:Gareth Gudger
Gareth Gudger earned 1000 total points
ID: 40454920
Hey yo bee,

Glad you are getting off Exchange 2003. One of the biggest benefits of Exchange 2010 is that the database I/O is 90% less than Exchange 2003! Crazy huh?

If you are looking for a step-by-step guide on how to go from 2003 to 2010 then check out this series. Lots of screenshots! :)
LVL 25

Author Comment

ID: 40455402
Thanks Gareth.  I will look at these.

My biggest concern right now when migrating over is the SAN DISK configurations.  I will be reaching out to NETAPP to have one of their engineers to help explain some things.
LVL 31

Expert Comment

by:Gareth Gudger
ID: 40456376
What kind of concerns do you have? The I/O on 2010 DBs is 90% less than 2003. This is where Microsoft comes in and says you can put Exchange on JBOD or 7200k RPM SATA drives. :)
LVL 25

Author Comment

ID: 40457242
My concern is my current SAN configuration and if I add the new Exchange 2010 into the mix will things get worse?
Right now users are experiencing latency in multiple areas.  CIFS shares from the SAN, I see some slowness on Server (VM).  We have 5 SQL servers running in the VM infrastructure.  The SQL DB's are attached to the VM's as LUN stored on the 15K SAS disks.
We are using a NETAPP Data on Tap model.
We have two type of disks.  One Shelf with SAS 15K RPM and the other two shelfs SATA 7200 RPM.  
All of our VM hosted by VMware and the VMDK's are stored on the SAS 15K Aggregate.
LVL 31

Expert Comment

by:Gareth Gudger
ID: 40458451
Sounds like you need to talk to your SAN guys. Especially if you have significant I/O on there already.

Here is a great article on storage supportability for Exchange 2010. Make sure that you present SAN storage as block level and not file level storage. For example, iSCSI LUNs.
LVL 25

Author Comment

ID: 40458644
Thanks Gareth
LVL 25

Author Closing Comment

ID: 40469050
I divided the points between both of you.
I was able to add 4 more disks in a RAID 0 + 1 and moved the Trans Logs from the D:\Programs files\exch\ to g:\Program\files\exch\<IS Log> . This change seems to have a much better response between the clients and server. The latency seems to have dropped and users are not seeing the Waiting For Exchange Balloon.  I have not collected any matrix since the change, but I have to think it going to be much lower.

I am still see avg 30% CPU usage by Store.exe, but this server has 3 Info Stores, 15 DB's that comprise 1.78 TB worth of data.  This does not seem to be a concern that I had initially.

I have to started to research the recommended link as of yet, but I am confident that they have good information.

Featured Post

[Webinar On Demand] Database Backup and Recovery

Does your company store data on premises, off site, in the cloud, or a combination of these? If you answered “yes”, you need a data backup recovery plan that fits each and every platform. Watch now as as Percona teaches us how to build agile data backup recovery plan.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Today as you open your Outlook, you witness an error message: “Outlook is using an old copy of your Outlook Data File…”. Probably, Outlook is accessing an old OST file.
There are literally thousands of Exchange recovery applications out there. So how do you end up picking one that’s ideal for your business & purpose? By carefully scouting the product’s features, the benefits it offers you, & reading ample reviews f…
To add imagery to an HTML email signature, you have two options available to you. You can either add a logo/image by embedding it directly into the signature or hosting it externally and linking to it. The vast majority of email clients display l…
Is your OST file inaccessible, Need to transfer OST file from one computer to another? Want to convert OST file to PST? If the answer to any of the above question is yes, then look no further. With the help of Stellar OST to PST Converter, you can e…
Suggested Courses
Course of the Month9 days, 18 hours left to enroll

571 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question