Solved

SBS 2003 Server hangs every day with event ID 2019 - The server was unable to allocate from the system nonpaged pool because the pool was empty

Posted on 2010-08-13
11
1,552 Views
Last Modified: 2012-05-10
Hi.

This one has got me so im hoping someone can help.

I have a client with a SBS 2003 server, patched and up to date with MS updates, service packs and hardware drivers and firmware.

The server is a HP Proliant DL380 G5 using a smart array p400 disk controller, 2x HP NC373i multifinction gigabit server adapters, Intel Xeon E5335 quad core and 4gb HP ram.

The server perfoms the roles of AD, Echange, Sharepoint, file and print server, ISA 2004. It also has backup exec 12.5, Sage 50 Acconts 2008 and sophos SBS.

This problem is described as follwos:

Every day at seemingly random times an error occours that logs the following event:
Type: ERROR
User: N/A
Computer: ULURU
Source: Srv
Category: None
Event ID: 2019

Discription:
The server was unable to allocate from the system nonpaged pool because the pool was empty.

------------------------------------

This error is logged in the system event log every 61 seconds and during this time all other services on the server stop and attempt to restart but there is no available memory. Eventually even SBcore services fail and the server is rendered usless. Its not possible to log on to the console and the only step forward is to turn it off.  Once restarted it works perfectly until the error happens again.

This issue started a few months ago, it seems to suffer this problem for a few days then it will be fine for a few weeks to a month before it starts doing it again. once it starts it will do this every day, sometimes even twice daily.

Since the server never actually blue screens there are no memory dumps.

I have updated all the drivers and firmware for the NC 373i's network adapters and specified by HP. I have also disabled TCP offloading and Recieve side sending as these have been noted for causing similar issues.

I have also removed all software and applications not related to server roles ( adobe, vnc, silverlight etc)

any ideas will be appriciated. Thanks for looking.

Simon



0
Comment
Question by:evilsi
11 Comments
 
LVL 23

Expert Comment

by:ormerodrutter
ID: 33430712
A silly question - what is the capacity of the C:\ drive, and how much space left on it?
0
 
LVL 3

Expert Comment

by:comphil
ID: 33430714
I have seen similar problems with both Symantec Endpoint and AVG 9.0 caused by memory leaks which resulted in very similar issues.  My first port of call would be to either update (if applicable) or temporarily remove the Sophos client from the server and see if this makes a difference.  
0
 
LVL 4

Author Comment

by:evilsi
ID: 33431207
Hi,

A valid question.. both counts..  disk c:\ has 46.2 GB out of 68 GB remaining and i have already tried the server without the Sophos installation. (Done during an upgrade and the server happened to suffer the same fate when the Sophos application was not installed)

Has anyone had this or a similar event before and how did you resolve it?

Many thanks
Si.
0
NAS Cloud Backup Strategies

This article explains backup scenarios when using network storage. We review the so-called “3-2-1 strategy” and summarize the methods you can use to send NAS data to the cloud

 
LVL 51

Expert Comment

by:Keith Alabaster
ID: 33432018
Can you review the Task Manager and report back on the top couple of processes in respect to memory use?
Are you using a swap file on the drive(s)?

Have you tried stopping (out of hours) each core service in turn to see if one of these can be associated with the offending issue?
0
 
LVL 34

Expert Comment

by:Shreedhar Ette
ID: 33432909
Hi,

You need to use poolmon to get the non paged pool memroy usage details.

Refer this article:
http://support.microsoft.com/kb/177415

While event id 2019 occuring post the output of the poolmon.

Hope this helps,
Shree
0
 
LVL 3

Accepted Solution

by:
comphil earned 250 total points
ID: 33433827
This may be totally irrelevant and I'm sure someone will confirm if it is or not, but are you using the /3GB switch in the server's boot options?  This adjusts memory allocation and should be used on any server with more than 1GB RAM.  
0
 
LVL 7

Expert Comment

by:D_Vante
ID: 33437033
Something is eating up your memory.  Keith is on the right track.  Watch all the processes that are running  and see what is growing out of control.
0
 
LVL 10

Assisted Solution

by:LMiller7
LMiller7 earned 250 total points
ID: 33439074
The /3GB switch has nothing to do with physical memory size. While it increases the virtual address space for processes it restricts the system address space to 1GB. This severely restricts both the paged and non-paged pools. If you are having a problem with the non-paged pool you do not want to use this switch.
 
0
 
LVL 3

Expert Comment

by:comphil
ID: 33439861
Good point, for some reason I had the impression it caused the opposite effect but you are right.
0
 
LVL 4

Author Comment

by:evilsi
ID: 33440397
hi,

I had a look at the 3gb switch but after reading some technet documents it is not reccomended to apply this to a small business server.

Saying that, you put me onto investigating the Virtal memory system a little more closley and i have discovered a number of mis-configurations. For example the server has 4GB Ram but as its 32bit only 3.25GB is registered by the os. The page file was set to a custom size of 4093 with an initial size of 2056.  From the technet reccomendations i have reset this to 3492.

Also there is a registry entry for 'HeapDeCommitFreeBlockThreshold' which was at the default of 0 when it should be 0x0004000. The event log entries for the error this would normally produce multiple events at boot but for some reason the entries have been supressed. ( im picking up the pieces from their previous system admin).

I also discovered the Mailroot folder for the exchange server had been set to compressed. Again i dont know why anyone would do that but the exchange services appear to be runnning considerably faster now i have un-compressed them.

I am going to leave the server for a while now and see what the performace and stability is like. I will update this post in the next 48hrs and assign points for the assistance.

Thanks.
Simon.


0
 
LVL 4

Author Closing Comment

by:evilsi
ID: 33500232
Thanks for the input. This issue has been resolved by applying the changes i noted in my last post. I have allocated the points based on the information that pointed me in the right direction.
0

Featured Post

PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Usually shares are where we want them for our users and we tend to take them for granted. There are times, however, when those shares may disappear causing difficulty for your users. One of the first things to try is searching for files that shou…
A quick step-by-step overview of installing and configuring Carbonite Server Backup.
Windows 10 is mostly good. However the one thing that annoys me is how many clicks you have to do to dial a VPN connection. You have to go to settings from the start menu, (2 clicks), Network and Internet (1 click), Click VPN (another click) then fi…
Email security requires an ever evolving service that stays up to date with counter-evolving threats. The Email Laundry perform Research and Development to ensure their email security service evolves faster than cyber criminals. We apply our Threat…

770 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question