High RPC latency on Exchange 2007 with LEMSS patch agent

Posted on 2011-10-31
Last Modified: 2015-08-30
We have an Exchange 2007 environment with approximately 2000 people per server on VMware with storage on an EMC SAN.  The servers are new, fast, and have plenty of CPU and Memory available.   Most of the time, they perform very well, however when nightly maintenance is running, the RPC latency shoots up between 100-500ms (and more) during the first couple hours of maintenance, and then settles down somewhat as defrag continues.  
We've also had a couple of instances during the day where RPC latency goes up in the 100-300 range which will cause issues with end-users, especially those delegates that don't use cached calendars.

We found when we uninstalled LEMSS patch agent from the servers, the RPC latency doesn't go up anymore, and there is literally no impact from nightly maintenance anymore... with daily RPC latency averaging 2ms.

We also had an issue on our hub transport servers (2 of them) where both of them stopped routing email at exactly the same time (2 hours after new patches were scheduled on the lumension console, for installation to happen the next evening).  When LEMSS was uninstalled from those servers, the routing instantly started again and the queues cleared quickly.

The versions that we are running are:

Please let me know if you've seen similar issues with LEMSS and whether you've had any luck with a later version of LEMSS.  (we're not willing to reinstall the newer version of LEMSS on the production servers until we know that the issue has been fixed... the vendor hasn't been any help so far)

See the attached image for what the RPC latency looked like before and after we uninstalled LEMSS from the mail servers.
Question by:TX_ITmgr
    LVL 6

    Expert Comment

    Do you have also have a storage latency problem?

    Author Comment

    No, not at all.  Storage is on an EMC SAN, and the entire architecture was sized/designed by EMC consulting services.  I've seen high RPC latency on other exchange servers that were having storage issues (SCSI Cache settings incorrect or cache disabled) so I know what an impact that can have on RPC latency and it was one of the first things I checked on these systems.

    Accepted Solution

    Performance has been fantastic and no issues at all on any of the Exchange servers since removing the LEMSS software a month and a half ago.
    LVL 20

    Expert Comment

    This question has been classified as abandoned and is closed as part of the Cleanup Program. See the recommendation for more details.

    Featured Post

    Do email signature updates give you a headache?

    Do you feel like you are constantly making changes to email signatures? Are the images not formatting how you want them to? Want high-quality HTML signatures on all devices, including on mobiles and Macs? Then, let Exclaimer solve all your email signature problems today.

    Join & Write a Comment

    Resolve Outlook connectivity issues after moving mailbox to new Exchange 2016 server
    ADCs have gained traction within the last decade, largely due to increased demand for legacy load balancing appliances to handle more advanced application delivery requirements and improve application performance.
    In this video we show how to create a User Mailbox in Exchange 2013. We show this process by using the Exchange Admin Center. Log into Exchange Admin Center.: First we need to log into the Exchange Admin Center. Navigate to the Recipients >> Mailb…
    To show how to create a transport rule in Exchange 2013. We show this process by using the Exchange Admin Center. Log into Exchange Admin Center.: First we need to log into the Exchange Admin Center. Navigate to the Mail Flow >> Rules tab.:  To cr…

    734 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    19 Experts available now in Live!

    Get 1:1 Help Now