cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

FNMS Webui Hang after IIS pool size reached to max pool size

Hi,

Frequently I got below error in WebUI log and then FNMS is stopped working. It only works after IIS reset.

I have already increased maxpool size to 1000 but still it gives same error. We have FNMS 2019 R2 on-prem.

Can somone help me on this to identify root cause?

======================================

[ERROR 2020-09-02 18:25:41,404 87933327ms GET /Suite/Assets/List/All UnhandledErrors ] An unexpected error occurred (6495e5b6-c8cb-4c1f-a0cf-1212328ce917)
System.InvalidOperationException: Timeout expired. The timeout period elapsed prior to obtaining a connection from the pool. This may have occurred because all pooled connections were in use and max pool size was reached.
at System.Data.ProviderBase.DbConnectionFactory.TryGetConnection(DbConnection owningConnection, TaskCompletionSource`1 retry, DbConnectionOptions userOptions, DbConnectionInternal oldConnection, DbConnectionInternal& connection)
at System.Data.ProviderBase.DbConnectionInternal.TryOpenConnectionInternal(DbConnection outerConnection, DbConnectionFactory connectionFactory, TaskCompletionSource`1 retry, DbConnectionOptions userOptions)
at System.Data.SqlClient.SqlConnection.TryOpenInner(TaskCompletionSource`1 retry)
at System.Data.SqlClient.SqlConnection.TryOpen(TaskCompletionSource`1 retry)
at System.Data.SqlClient.SqlConnection.Open()
at ManageSoft.Database.DatabaseConnection.Open()
at ManageSoft.Database.Impl.DatabaseLayerBaseSql.ConnectionOpen()
at ManageSoft.Database.Xpo.CustomMSSqlConnectionProvider.EnsureConnection(IDatabaseLayer p_DatabaseLayer)
at ManageSoft.Database.Xpo.CustomMSSqlConnectionProvider..ctor(IDatabaseLayer p_DatabaseLayer, AutoCreateOption p_AutoCreateOption)
at ManageSoft.Database.Xpo.LazyCustomMSSqlConnectionProvider.<>c__DisplayClass7.<.ctor>b__5()
at System.Lazy`1.CreateValue()
at System.Lazy`1.LazyInitValue()
at ManageSoft.Database.Xpo.LazyCustomMSSqlConnectionProvider.get_CustomSqlGenParameters()
at ManageSoft.Database.Xpo.XpoSession.XpoObjectLayer.InitializeCustomParameters(XPClassInfo p_ClassInfo)
at ManageSoft.Database.Xpo.XpoSession.XpoObjectLayer.DevExpress.Xpo.IObjectLayer.LoadObjects(Session p_Session, ObjectsQuery[] p_Queries)
at DevExpress.Xpo.Logger.LogManager.Log[T](String category, LogHandler`1 handler, MessageHandler`1 createMessageHandler)
at DevExpress.Xpo.Session.GetObjects(ObjectsQuery query)
at DevExpress.Xpo.Session.GetObjects(XPClassInfo classInfo, CriteriaOperator criteria, SortingCollection sorting, Int32 topSelectedRecords, Boolean selectDeleted, Boolean force)
at DevExpress.Xpo.Helpers.XPObjectTypesManager.GetAllTypes()
at DevExpress.Xpo.Session.GetObjectsInternal(ObjectsQuery[] queries)
at DevExpress.Xpo.Logger.LogManager.Log[T](String category, LogHandler`1 handler, MessageHandler`1 createMessageHandler)
at DevExpress.Xpo.Session.GetObjects(ObjectsQuery query)
at DevExpress.Xpo.XPQueryBase.GetSingleObject(CriteriaOperator val, Boolean allowDefault, SortAction sort, Boolean single)
at DevExpress.Xpo.XPQueryBase.ExecuteSingle(MethodCallExpression call, Boolean allowDefault, SortAction sort)
at DevExpress.Xpo.XPQueryBase.Execute(Expression expression)
at DevExpress.Xpo.XPQuery`1.System.Linq.IQueryProvider.Execute[S](Expression expression)
at Flexera.Web.Logic.Services.DataInputs.DataInputsService.GetReconcileHealth()
at Castle.Proxies.Invocations.IDataInputsService_GetReconcileHealth.InvokeMethodOnTarget()
at Castle.DynamicProxy.AbstractInvocation.Proceed()
at Flexera.Web.Core.Caching.CachingInterceptor.Intercept(IInvocation invocation)
at Castle.DynamicProxy.AbstractInvocation.Proceed()
at Castle.Proxies.IDisposableProxy_10.GetReconcileHealth()
at Flexera.Web.Presentation.ActionFilters.ReconcileStatusFilterAttribute.OnResultExecuting(ResultExecutingContext filterContext)
at System.Web.Mvc.ControllerActionInvoker.InvokeActionResultFilter(IResultFilter filter, ResultExecutingContext preContext, Func`1 continuation)
at System.Web.Mvc.ControllerActionInvoker.InvokeActionResultFilter(IResultFilter filter, ResultExecutingContext preContext, Func`1 continuation)
at System.Web.Mvc.Async.AsyncControllerActionInvoker.<>c__DisplayClass25.<BeginInvokeAction>b__22(IAsyncResult asyncResult)

(5) Replies
mfranz
By Level 17 Champion
Level 17 Champion

Hi,

Could you post your application pool settings? Can you see any resource (CPU, RAM, etc.) issues on that webserver?

Best regards,

Markward

Webserver overall performance is good. Nothing issue with other resources. But how can I get application pool settings details?

 

Hi,

You should find the IIS console on your FNMS webserver:

2020-09-03_14h14_21.png

Right click on "FlexNet Manager Platform", then "Advanced Settings".

Best regards,

Markward

 

Here are the details.

IIS Pool.JPG

IIS Pool-2.JPG

  

Hi,

Is maybe something else opening connections to your database server and not closing them correctly? Maybe you need to monitor connections at your SQL server.

Best regards,

Markward