Activiti Processes disappearing, requiring a server restart
We are using Activiti (5.21.0) connected to MySql (15.1). Activiti (web application ) is deployed on Tomcat (8.0.43). Within a gap of 5-7 days we get an issue. All the processes, except for the default Demo Process & Demo Reports , get un-deployed. That is we cannot see the processes in Deployments tab or under ‘Deployed process definitions’ tab. However if we check the ACT_RE_DEPLOYMENT table records are present for each of our BPMN processes. On restarting tomcat things return to normal.
This is generally happening at the time of Auto-restart of Tomcat for rolling over the logs. But seems that this restart causes memory issues. Please see the log below.
29-Jul-2017 14:42:59.065 INFO [main] org.apache.catalina.core.StandardServer.await A valid shutdown command was received via the shutdown port. Stopping the Server instance.
29-Jul-2017 14:42:59.066 INFO [main] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["http-nio-8080"]
29-Jul-2017 14:42:59.117 INFO [main] org.apache.catalina.core.StandardService.stopInternal Stopping service Catalina
02:42:59,121 [localhost-startStop-2] INFO org.springframework.web.context.support.AnnotationConfigWebApplicationContext - Closing WebApplicationContext for namespace 'dispatcher-servlet': startup date [Fri Jul 28 17:56:51 BST 2017]; parent: Root WebApplicationContext
02:42:59,141 [localhost-startStop-2] INFO org.activiti.rest.servlet.WebConfigurer - Destroying Web application
02:42:59,142 [localhost-startStop-2] INFO org.springframework.web.context.support.AnnotationConfigWebApplicationContext - Closing Root WebApplicationContext: startup date [Fri Jul 28 17:56:47 BST 2017]; root of context hierarchy
02:42:59,143 [localhost-startStop-2] INFO org.activiti.engine.impl.asyncexecutor.AbstractAsyncJobExecutor - Shutting down the default async job executor [org.activiti.engine.impl.asyncexecutor.DefaultAsyncJobExecutor].
02:42:59,145 [Thread-5] INFO org.activiti.engine.impl.asyncexecutor.AcquireAsyncJobsDueRunnable - stopped async job due acquisition
29-Jul-2017 14:42:59.160 WARNING [localhost-startStop-2] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [activiti-rest] appears to have started a thread named [Abandoned connection cleanup thread] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: