Remote Access Button Stops Working SBS 2011 Standard - Event ID 3 and 1309

A recent issue has just started in the last two weeks on a SBS 2011 server, every one to three days the ability to remote into a computer button stops working-

 1. End user authenticates ok via the portal and is presented with the "
 Remote Web Access: Remote Workspace...." page

2. End user attempts to click on "Connect" under "computers" and nothing happens

Everything else is working fine, a reboot resolves the issue for about 4 days and then it happens again - it's now happened 3 times in the past 2 weeks and the only thing that has recently changed in the environment is the server was patched on the with the December MS updates

Two things are being logged in the app log which appear related-

1) Event id 3

WebHost failed to process a request.
  Sender Information: System.ServiceModel.ServiceHostingEnvironment+HostingManager/6044116
  Exception: System.ServiceModel.ServiceActivationException: The service '/Remote/BuiltIns/HomePage/GadgetDnD/GadgetDnDService.svc' cannot be activated due to an exception during compilation.  The exception message is: Memory gates checking failed because the free memory (1112436736 bytes) is less than 5% of total memory.  As a result, the service will not be available for incoming requests.  To resolve this, either reduce the load on the machine or adjust the value of minFreeMemoryPercentageToActivateService on the serviceHostingEnvironment config element.. ---> System.InsufficientMemoryException: Memory gates checking failed because the free memory (1112436736 bytes) is less than 5% of total memory.  As a result, the service will not be available for incoming requests.  To resolve this, either reduce the load on the machine or adjust the value of minFreeMemoryPercentageToActivateService on the serviceHostingEnvironment config element.
    at System.ServiceModel.Activation.ServiceMemoryGates.Check(Int32 minFreeMemoryPercentage, Boolean throwOnLowMemory, UInt64& availableMemoryBytes)
    at System.ServiceModel.ServiceHostingEnvironment.HostingManager.CheckMemoryCloseIdleServices(EventTraceActivity eventTraceActivity)
    at System.ServiceModel.ServiceHostingEnvironment.HostingManager.EnsureServiceAvailable(String normalizedVirtualPath, EventTraceActivity eventTraceActivity)
    --- End of inner exception stack trace ---
    at System.ServiceModel.ServiceHostingEnvironment.HostingManager.EnsureServiceAvailable(String normalizedVirtualPath, EventTraceActivity eventTraceActivity)
    at System.ServiceModel.ServiceHostingEnvironment.EnsureServiceAvailableFast(String relativeVirtualPath, EventTraceActivity eventTraceActivity)
  Process Name: w3wp
  Process ID: 17308

2) Event ID 1309


 Event code: 3005
 Event message: An unhandled exception has occurred.
 Event ID: 216f13c02db8408791d38afb5cbd25f8
 Event sequence: 5
 Event occurrence: 1
 Event detail code: 0
 
 Application information:
     Application domain: /LM/W3SVC/1/ROOT/Remote-1-130312862474831281
     Trust level: Full
     Application Virtual Path: /Remote
     Application Path: C:\Program Files\Windows Small Business Server\Bin\WebApp\RemoteAccess\
     Machine name: SBSVSRV1
 
 Process information:
     Process ID: 17308
     Process name: w3wp.exe
     Account name: NT AUTHORITY\NETWORK SERVICE
 
 Exception information:
     Exception type: InsufficientMemoryException
     Exception message: Memory gates checking failed because the free memory (1112436736 bytes) is less than 5% of total memory.  As a result, the service will not be available for incoming requests.  To resolve this, either reduce the load on the machine or adjust the value of minFreeMemoryPercentageToActivateService on the serviceHostingEnvironment config element.
    at System.ServiceModel.Activation.ServiceMemoryGates.Check(Int32 minFreeMemoryPercentage, Boolean throwOnLowMemory, UInt64& availableMemoryBytes)
    at System.ServiceModel.ServiceHostingEnvironment.HostingManager.CheckMemoryCloseIdleServices(EventTraceActivity eventTraceActivity)
    at System.ServiceModel.ServiceHostingEnvironment.HostingManager.EnsureServiceAvailable(String normalizedVirtualPath, EventTraceActivity eventTraceActivity)

 
 
 Request information:
     Request URL: <domain name>:443/Remote/BuiltIns/HomePage/GadgetDnD/GadgetDnDService.svc/js
     Request path: /Remote/BuiltIns/HomePage/GadgetDnD/GadgetDnDService.svc/js
     User host address: <user ip address>
     User: <domain>\<user name>
     Is authenticated: True
     Authentication Type: Forms
     Thread account name: NT AUTHORITY\NETWORK SERVICE
 
 Thread information:
     Thread ID: 4
     Thread account name: NT AUTHORITY\NETWORK SERVICE
     Is impersonating: False
     Stack trace:    at System.ServiceModel.Activation.ServiceMemoryGates.Check(Int32 minFreeMemoryPercentage, Boolean throwOnLowMemory, UInt64& availableMemoryBytes)
    at System.ServiceModel.ServiceHostingEnvironment.HostingManager.CheckMemoryCloseIdleServices(EventTraceActivity eventTraceActivity)
    at System.ServiceModel.ServiceHostingEnvironment.HostingManager.EnsureServiceAvailable(String normalizedVirtualPath, EventTraceActivity eventTraceActivity)
 
 The server has never had an issue with remote access in the 2 years since I built it
SBS Server 2011 Standard (64 bit)

24Gb RAM and X3450 Xeon (Dell PowerEdge 410)

Rebooting helps for awhile but not practical during normal business hours. I can temporarily knock down the memory utilization down to 87% by bouncing the WWW Publishing service (which in turn bounces the RDG service) but that only lasts for 30 minutes and the memory utilization is back up.