Link to home
Start Free TrialLog in
Avatar of Jaspal Khanna
Jaspal Khanna

asked on

Connection Timeout - Max pool size reached on System Center 2016 - Blank page on login ( Randomly

System Center 2016 giving error SyncInvoke--------- Failed with system.invalidoperationexception: TImeout expired. The timeout period elapsed prior to obtaining a connection from the pool. this may have occurred because all pooled connection were in use and max pool size was reached.

This error is happening in many of the method which we didnt make any changes. approx 20-25 of the, may be more.

Normally we can login without issue after app pool reset, however once it gives the above error in the system center even the default page of the webserver shows blank page, then after sometime when we just refresh the default page would be displayed.

This code has been running for more than 2 years and we didnt have any problem , recently we did the deployment and the problem started. The website works for sometime but after say 20 minutes, it starts giving the above timeout issue and sometime even the default page does not show up and then later when we just refresh the default page will display.

Number of users that can cause this is even 15 users , earliernormal traffic is about 300 users at a time, the issue can happen even when 5 users are present.

DB SQL Server : There are around 150-250 sleeping connection most  of the time with the text "Text" only,  it reduces automatically.

The layout is as follows:

Client are redirected through load balancer on any of the following, web server are connected to app directly and APP is connected to SQLDB

External Server
____________________________________

Web server 1             Web server 2                                 Database : SQLDB
WebApp 1                   Web App 2


we have internal server as well and when we test on that with 15 users it does not have any problem whatsoever. we have placed 30 min app pool reset on both App 1 and 2.

Internal server
____________________________________

Web Internal server 1                            Database : SQLDB   ( Database is same as production on top )
WebApp Internal  1
ListofError.png
Avatar of lcohan
lcohan
Flag of Canada image

recently we did the deployment and the problem started.

Can someone with authority perform a compare between old and new code as most likely somewhere in the new version some connections are maybe not closed/discarded as they should? Or maybe check for some DataReaders that are not closed? But all this is in line whit the deployment as it is obviously from the description that this issue was introduced with that deployement - whatever that was.
Avatar of Jaspal Khanna
Jaspal Khanna

ASKER

We are sure that none of the new connection were made in the code, All code are from previous deployment, the changes for this deployment was adding new fields in the table and related control on the aspx page with JS changes.

Its with the deployment, I suppose but unable to understand whats the root cause and how to resolve it?
the changes for this deployment was adding new fields in the table and related control on the aspx page
Is it possible that some new DataReaders or functions returning DataReaders were introduced? Connection will never close outside the function that created them unless they are properly discarded/closed.
SCCM 2016 is a red herring here.   The problem has nothing to do with SCCM or SCOM they are simply informing you of errors in other programs/applications.

Somewhere in your code you are not closing connections and just keep opening more connections.  This article explains a bit.
https://blogs.msdn.microsoft.com/tolong/2006/11/20/max-pool-size-was-reached/  you can also in your web.config increase the # of connections.
Thanks Icohan, Code had been changed in such a way that it has utilized the method which we use as always and those method are the same method used in previous deployment. so connection are getting closed and seems this msg might be not the real cause and actual root cause might be different.
Thanks David, These are the same code for opening and closing connection what we had the last deployment, we have only added many new controls, some are linked to the database to fetch the data to populate the dropdown list / multiple checkbox but those methods are the same ones which we have used before in previous deployment.

I was thinking that it might be a misleading error could be network / connection related issues on the server.

I heard the TCP issues can also output similar connection error, Not sure about it.
This question needs an answer!
Become an EE member today
7 DAY FREE TRIAL
Members can start a 7-Day Free trial then enjoy unlimited access to the platform.
View membership options
or
Learn why we charge membership fees
We get it - no one likes a content blocker. Take one extra minute and find out why we block content.