Link to home
Start Free TrialLog in
Avatar of nsfranklin
nsfranklinFlag for United Kingdom of Great Britain and Northern Ireland

asked on

Server 2012 r2 Service Issues and Network Errors

We have a server running SERVER 2012 R2 with 40GB RAM and lots of disc space. We use Yosemite Server Backup.

We recently replaced our QNAP NAS with more storage space. Previously on the older 12TB QNAP unit we backed up nightly via an iScsi connection to the NAS and this worked very well for a number of years.

With the new NAS I switched to using a UNC path (\\qnap\backup) for the nightly backup process, it works well and the throughput, at its highest, is around 3gb/min. I choose this method so that I didn't have a permanent connection to the NAS backup folder as a precaution against encryption viruses hitting the backup device.

However once the backup has finished, a number of services start to fail on the server and it becomes sluggish. When trying to restart the services results in Not Enough Storage available to complete the process. WSUS, DHCP, etc. Rebooting the server is the only option.

I have disabled tonights backup to see if this is what is causing the issue as it is the only thing I have changed in the last few weeks.

Does anyone else have knowledge of this. I have also not yet tweaked the irpstacksize registry value which doesn't exist on Server 2012 R2. I have read mixed messages as to whether this is necessary.

All network connections run at a 1000mbps. Server is domain controller and file server with Office 365 for Exchange email. The QNAP is connected to the domain.
Avatar of nsfranklin
nsfranklin
Flag of United Kingdom of Great Britain and Northern Ireland image

ASKER

Further to this, the problem re-occured without the backup running although it took a couple of days. The Backup just exacerbates the problem because of the network transfer of data to the NAS.

The server has been running fine for 2 years and suddenly we are getting this issue. The server is protected by ESET File Security and a further scan with Malware Bytes has shown the server to be clean.

After further investigation, the error in the Event Viewer is 4227 TCP/IP failed to establish an outgoing connection because the selected local endpoint was recently used to connect to the same remote endpoint. This error typically occurs when outgoing connections are opened and closed at a high rate, causing all available local ports to be used and forcing TCP/IP to reuse a local port for an outgoing connection. To minimize the risk of data corruption, the TCP/IP standard requires a minimum time period to elapse between successive connections from a given local endpoint to a given remote endpoint.

and

4231 A request to allocate an ephemeral port number from the global TCP port space has failed due to all such ports being in use.

Not sure why all of a sudden this has become an issue.
Avatar of Brian B
Since the error isn't specifically related to backup I changed the title of your question to bring it to the attention of the right Experts.

Meanwhile, one thing I always try when weird this like this happen is disabling antivirus. Give that a try and meanwhile we'll see if any other Experts can advise further.

Thanks,
Brian B
Topic Advisor
First of all it is helpful to determine what process consumes all the ports.

Download TCPView https://technet.microsoft.com/en-us/sysinternals/tcpview.aspx

Start it as soon as the issue happens.
It appears to be the Ephemeral ports issue which gets progressively worse over a few days. I have been investigating the cause and cannot find any particular services that might be causing the issue.

Forcing an increase in the available ports using nets int ipv4 set dynamic port tcp start=10000 num=55535 allowed some services to burst into life for example Teamviewer was unable to allocate and ID and Password until I did this.

This is only a temporary fix so need to look further in to the issue.
ASKER CERTIFIED SOLUTION
Avatar of nsfranklin
nsfranklin
Flag of United Kingdom of Great Britain and Northern Ireland image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Safe to say this was the cause. Server is now stable.
No other response suitable.