Application.log Filling up with "No compatible attachment provider is available" error

wwilliams · March 24, 2020, 6:06pm

OS: AWS Linux (4.14.171-105.231.amzn1.x86_64) 64bit
Java Version: 1.8.0_242 (Oracle Corporation) 64bit (java-1.8.0-openjdk-1.8.0.242.b08-0.50.amzn1.x86_64)
Tomcat Version: Apache Tomcat/8.5.23
Lucee Version: Lucee 5.3.4.80

We just recently patched our web servers from Java 1.8 222 to 242 and we are seeing a ton of Info and Errors within our Application.log file. Originally we were running Lucee 5.3.2.77 and pages were presenting errors. We updated Lucee to the latest stable release (5.3.4.80) and the errors went away.

This morning we checked the logs and saw the following filling up our Application.log (See below). NOTE: There appear to be a few Class Info messages about not being found, but the main thing that concerns us are the “No compatible attachment provider is available” Errors. Any help would be appreciated!

Thanks in advance

“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [sun.misc.Launcher$AppClassLoader@70dea4e]”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [java.net.URLClassLoader@7699a589]”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [lucee.commons.io.res.util.ResourceClassLoader@5c510c98]”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“looking for tools.jar”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“couldn’t find tools.jar at: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.242.b08-0.50.amzn1.x86_64/jre/lib/tools.jar”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“for IBM SDK couldn’t find /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.242.b08-0.50.amzn1.x86_64/lib/tools.jar”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“found /opt/lucee/tomcat/lucee-server/context/tools-linux-7u25.jar”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“tools.jar used:/opt/lucee/tomcat/lucee-server/context/tools-linux-7u25.jar”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“loaded VirtualMachine class:com.sun.tools.attach.VirtualMachine”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“try to load agent (path:/opt/lucee/tomcat/lucee-server/context/lucee-external-agent.jar)”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“pid:2611”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,"java.lang.ExceptionInInitializerError;java.lang.ExceptionInInitializerError;java.lang.ExceptionInInitializerError
at sun.tools.attach.LinuxAttachProvider.attachVirtualMachine(LinuxAttachProvider.java:63)
at com.sun.tools.attach.VirtualMachine.attach(VirtualMachine.java:213)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at lucee.runtime.instrumentation.InstrumentationFactory.loadAgent(InstrumentationFactory.java:328)
at lucee.runtime.instrumentation.InstrumentationFactory.access$400(InstrumentationFactory.java:58)
at lucee.runtime.instrumentation.InstrumentationFactory$1.run(InstrumentationFactory.java:109)
at java.security.AccessController.doPrivileged(Native Method)
at lucee.runtime.instrumentation.InstrumentationFactory.getInstrumentation(InstrumentationFactory.java:75)
at lucee.commons.lang.PhysicalClassLoader.loadClass(PhysicalClassLoader.java:192)
at lucee.runtime.MappingImpl.getPhysicalClass(MappingImpl.java:253)
at lucee.runtime.PageSourceImpl.loadPhysical(PageSourceImpl.java:336)
at lucee.runtime.PageSourceImpl.loadPageThrowTemplateException(PageSourceImpl.java:221)
at lucee.runtime.PageSourceImpl.loadPage(PageSourceImpl.java:986)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:905)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at template.main_cfm$cf$62.call(/template/main.cfm:45)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:913)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at account.template_cfm$cf$c6.call(/account/template.cfm:1)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:913)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at account.application_cfc$cf$c5.udfCall(/account/Application.cfc:91)
at lucee.runtime.type.UDFImpl.implementation(UDFImpl.java:106)
at lucee.runtime.type.UDFImpl._call(UDFImpl.java:342)
at lucee.runtime.type.UDFImpl.call(UDFImpl.java:215)
at lucee.runtime.ComponentImpl._call(ComponentImpl.java:646)
at lucee.runtime.ComponentImpl._call(ComponentImpl.java:568)
at lucee.runtime.ComponentImpl.call(ComponentImpl.java:1898)
at lucee.runtime.listener.ModernAppListener.call(ModernAppListener.java:436)
at lucee.runtime.listener.ModernAppListener._onRequest(ModernAppListener.java:215)
at lucee.runtime.listener.MixedAppListener.onRequest(MixedAppListener.java:42)
at lucee.runtime.PageContextImpl.execute(PageContextImpl.java:2415)
at lucee.runtime.PageContextImpl._execute(PageContextImpl.java:2405)
at lucee.runtime.PageContextImpl.executeCFML(PageContextImpl.java:2380)
at lucee.runtime.engine.Request.exe(Request.java:43)
at lucee.runtime.engine.CFMLEngineImpl._service(CFMLEngineImpl.java:1110)
at lucee.runtime.engine.CFMLEngineImpl.serviceCFML(CFMLEngineImpl.java:1056)
at lucee.loader.engine.CFMLEngineWrapper.serviceCFML(CFMLEngineWrapper.java:103)
at lucee.loader.servlet.CFMLServlet.service(CFMLServlet.java:62)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:478)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:342)
at org.apache.coyote.ajp.AjpProcessor.service(AjpProcessor.java:486)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:868)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1459)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1847)
at java.lang.Runtime.loadLibrary0(Runtime.java:871)
at java.lang.System.loadLibrary(System.java:1124)
at sun.tools.attach.LinuxVirtualMachine.(LinuxVirtualMachine.java:336)
… 67 more
"
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [sun.misc.Launcher$AppClassLoader@70dea4e]”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [java.net.URLClassLoader@7699a589]”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [lucee.commons.io.res.util.ResourceClassLoader@5c510c98]”
“ERROR”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“compilation”,"No compatible attachment provider is available;No compatible attachment provider is available;java.lang.IllegalStateException: No compatible attachment provider is available
at lucee.runtime.instrumentation.InstrumentationFactoryExternal.install(InstrumentationFactoryExternal.java:390)
at lucee.runtime.instrumentation.InstrumentationFactoryExternal.install(InstrumentationFactoryExternal.java:375)
at lucee.runtime.instrumentation.InstrumentationFactoryExternal.install(InstrumentationFactoryExternal.java:344)
at lucee.runtime.instrumentation.InstrumentationFactoryExternal.install(InstrumentationFactoryExternal.java:330)
at lucee.runtime.instrumentation.InstrumentationFactory.getInstrumentation(InstrumentationFactory.java:126)
at lucee.commons.lang.PhysicalClassLoader.loadClass(PhysicalClassLoader.java:192)
at lucee.runtime.MappingImpl.getPhysicalClass(MappingImpl.java:253)
at lucee.runtime.PageSourceImpl.loadPhysical(PageSourceImpl.java:336)
at lucee.runtime.PageSourceImpl.loadPageThrowTemplateException(PageSourceImpl.java:221)
at lucee.runtime.PageSourceImpl.loadPage(PageSourceImpl.java:986)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:905)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at template.main_cfm$cf$62.call(/template/main.cfm:45)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:913)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at account.template_cfm$cf$c6.call(/account/template.cfm:1)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:913)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at account.application_cfc$cf$c5.udfCall(/account/Application.cfc:91)
at lucee.runtime.type.UDFImpl.implementation(UDFImpl.java:106)
at lucee.runtime.type.UDFImpl._call(UDFImpl.java:342)
at lucee.runtime.type.UDFImpl.call(UDFImpl.java:215)
at lucee.runtime.ComponentImpl._call(ComponentImpl.java:646)
at lucee.runtime.ComponentImpl._call(ComponentImpl.java:568)
at lucee.runtime.ComponentImpl.call(ComponentImpl.java:1898)
at lucee.runtime.listener.ModernAppListener.call(ModernAppListener.java:436)
at lucee.runtime.listener.ModernAppListener._onRequest(ModernAppListener.java:215)
at lucee.runtime.listener.MixedAppListener.onRequest(MixedAppListener.java:42)
at lucee.runtime.PageContextImpl.execute(PageContextImpl.java:2415)
at lucee.runtime.PageContextImpl._execute(PageContextImpl.java:2405)
at lucee.runtime.PageContextImpl.executeCFML(PageContextImpl.java:2380)
at lucee.runtime.engine.Request.exe(Request.java:43)
at lucee.runtime.engine.CFMLEngineImpl._service(CFMLEngineImpl.java:1110)
at lucee.runtime.engine.CFMLEngineImpl.serviceCFML(CFMLEngineImpl.java:1056)
at lucee.loader.engine.CFMLEngineWrapper.serviceCFML(CFMLEngineWrapper.java:103)
at lucee.loader.servlet.CFMLServlet.service(CFMLServlet.java:62)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:478)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:342)
at org.apache.coyote.ajp.AjpProcessor.service(AjpProcessor.java:486)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:868)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1459)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
"
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [sun.misc.Launcher$AppClassLoader@70dea4e]”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [java.net.URLClassLoader@7699a589]”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [lucee.commons.io.res.util.ResourceClassLoader@5c510c98]”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“looking for tools.jar”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“couldn’t find tools.jar at: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.242.b08-0.50.amzn1.x86_64/jre/lib/tools.jar”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“for IBM SDK couldn’t find /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.242.b08-0.50.amzn1.x86_64/lib/tools.jar”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“found /opt/lucee/tomcat/lucee-server/context/tools-linux-7u25.jar”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“tools.jar used:/opt/lucee/tomcat/lucee-server/context/tools-linux-7u25.jar”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“loaded VirtualMachine class:com.sun.tools.attach.VirtualMachine”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“try to load agent (path:/opt/lucee/tomcat/lucee-server/context/lucee-external-agent.jar)”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“pid:2611”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,"java.lang.ExceptionInInitializerError;java.lang.ExceptionInInitializerError;java.lang.ExceptionInInitializerError
at sun.tools.attach.LinuxAttachProvider.attachVirtualMachine(LinuxAttachProvider.java:63)
at com.sun.tools.attach.VirtualMachine.attach(VirtualMachine.java:213)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at lucee.runtime.instrumentation.InstrumentationFactory.loadAgent(InstrumentationFactory.java:328)
at lucee.runtime.instrumentation.InstrumentationFactory.access$400(InstrumentationFactory.java:58)
at lucee.runtime.instrumentation.InstrumentationFactory$1.run(InstrumentationFactory.java:109)
at java.security.AccessController.doPrivileged(Native Method)
at lucee.runtime.instrumentation.InstrumentationFactory.getInstrumentation(InstrumentationFactory.java:75)
at lucee.commons.lang.PhysicalClassLoader.loadClass(PhysicalClassLoader.java:192)
at lucee.runtime.MappingImpl.getPhysicalClass(MappingImpl.java:253)
at lucee.runtime.PageSourceImpl.loadPhysical(PageSourceImpl.java:336)
at lucee.runtime.PageSourceImpl.loadPageThrowTemplateException(PageSourceImpl.java:221)
at lucee.runtime.PageSourceImpl.loadPage(PageSourceImpl.java:986)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:905)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at template.main_cfm$cf$62.call(/template/main.cfm:131)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:913)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at account.template_cfm$cf$c6.call(/account/template.cfm:1)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:913)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at account.application_cfc$cf$c5.udfCall(/account/Application.cfc:91)
at lucee.runtime.type.UDFImpl.implementation(UDFImpl.java:106)
at lucee.runtime.type.UDFImpl._call(UDFImpl.java:342)
at lucee.runtime.type.UDFImpl.call(UDFImpl.java:215)
at lucee.runtime.ComponentImpl._call(ComponentImpl.java:646)
at lucee.runtime.ComponentImpl._call(ComponentImpl.java:568)
at lucee.runtime.ComponentImpl.call(ComponentImpl.java:1898)
at lucee.runtime.listener.ModernAppListener.call(ModernAppListener.java:436)
at lucee.runtime.listener.ModernAppListener._onRequest(ModernAppListener.java:215)
at lucee.runtime.listener.MixedAppListener.onRequest(MixedAppListener.java:42)
at lucee.runtime.PageContextImpl.execute(PageContextImpl.java:2415)
at lucee.runtime.PageContextImpl._execute(PageContextImpl.java:2405)
at lucee.runtime.PageContextImpl.executeCFML(PageContextImpl.java:2380)
at lucee.runtime.engine.Request.exe(Request.java:43)
at lucee.runtime.engine.CFMLEngineImpl._service(CFMLEngineImpl.java:1110)
at lucee.runtime.engine.CFMLEngineImpl.serviceCFML(CFMLEngineImpl.java:1056)
at lucee.loader.engine.CFMLEngineWrapper.serviceCFML(CFMLEngineWrapper.java:103)
at lucee.loader.servlet.CFMLServlet.service(CFMLServlet.java:62)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:478)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:342)
at org.apache.coyote.ajp.AjpProcessor.service(AjpProcessor.java:486)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:868)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1459)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1847)
at java.lang.Runtime.loadLibrary0(Runtime.java:871)
at java.lang.System.loadLibrary(System.java:1124)
at sun.tools.attach.LinuxVirtualMachine.(LinuxVirtualMachine.java:336)
… 67 more
"
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [sun.misc.Launcher$AppClassLoader@70dea4e]”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [java.net.URLClassLoader@7699a589]”
“INFO”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [lucee.commons.io.res.util.ResourceClassLoader@5c510c98]”
“ERROR”,“ajp-nio-8009-exec-6”,“03/24/2020”,“17:07:44”,“compilation”,"No compatible attachment provider is available;No compatible attachment provider is available;java.lang.IllegalStateException: No compatible attachment provider is available
at lucee.runtime.instrumentation.InstrumentationFactoryExternal.install(InstrumentationFactoryExternal.java:390)
at lucee.runtime.instrumentation.InstrumentationFactoryExternal.install(InstrumentationFactoryExternal.java:375)
at lucee.runtime.instrumentation.InstrumentationFactoryExternal.install(InstrumentationFactoryExternal.java:344)
at lucee.runtime.instrumentation.InstrumentationFactoryExternal.install(InstrumentationFactoryExternal.java:330)
at lucee.runtime.instrumentation.InstrumentationFactory.getInstrumentation(InstrumentationFactory.java:126)
at lucee.commons.lang.PhysicalClassLoader.loadClass(PhysicalClassLoader.java:192)
at lucee.runtime.MappingImpl.getPhysicalClass(MappingImpl.java:253)
at lucee.runtime.PageSourceImpl.loadPhysical(PageSourceImpl.java:336)
at lucee.runtime.PageSourceImpl.loadPageThrowTemplateException(PageSourceImpl.java:221)
at lucee.runtime.PageSourceImpl.loadPage(PageSourceImpl.java:986)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:905)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at template.main_cfm$cf$62.call(/template/main.cfm:131)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:913)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at account.template_cfm$cf$c6.call(/account/template.cfm:1)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:913)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at account.application_cfc$cf$c5.udfCall(/account/Application.cfc:91)
at lucee.runtime.type.UDFImpl.implementation(UDFImpl.java:106)
at lucee.runtime.type.UDFImpl._call(UDFImpl.java:342)
at lucee.runtime.type.UDFImpl.call(UDFImpl.java:215)
at lucee.runtime.ComponentImpl._call(ComponentImpl.java:646)
at lucee.runtime.ComponentImpl._call(ComponentImpl.java:568)
at lucee.runtime.ComponentImpl.call(ComponentImpl.java:1898)
at lucee.runtime.listener.ModernAppListener.call(ModernAppListener.java:436)
at lucee.runtime.listener.ModernAppListener._onRequest(ModernAppListener.java:215)
at lucee.runtime.listener.MixedAppListener.onRequest(MixedAppListener.java:42)
at lucee.runtime.PageContextImpl.execute(PageContextImpl.java:2415)
at lucee.runtime.PageContextImpl._execute(PageContextImpl.java:2405)
at lucee.runtime.PageContextImpl.executeCFML(PageContextImpl.java:2380)
at lucee.runtime.engine.Request.exe(Request.java:43)
at lucee.runtime.engine.CFMLEngineImpl._service(CFMLEngineImpl.java:1110)
at lucee.runtime.engine.CFMLEngineImpl.serviceCFML(CFMLEngineImpl.java:1056)
at lucee.loader.engine.CFMLEngineWrapper.serviceCFML(CFMLEngineWrapper.java:103)
at lucee.loader.servlet.CFMLServlet.service(CFMLServlet.java:62)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:478)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:342)
at org.apache.coyote.ajp.AjpProcessor.service(AjpProcessor.java:486)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:868)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1459)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
"

kabutotx · March 24, 2020, 8:56pm

Did you update your Java using the jdk and not the jre?

wwilliams · March 24, 2020, 9:34pm

We updated to the following package using YUM UPDATE on a AWS machine:

java-1.8.0-openjdk-1.8.0.242.b08-0.50.amzn1.x86_64

We have updated this machine 8 times with no issues. If we roll back our instance to 1.8.0.222, the errors go away. Is anyone running 1.8.0.242? ALSO, does anyone know where the “No compatible attachment provider is available” is coming from?

wwilliams · March 24, 2020, 10:20pm

UPDATE - NEW FINDINGS

So we just restarted the server(s) and no errors occurred for 45 minutes. We then updated a script and opened it - boom … the error popped up again. It appears to occur when a script is re-inspected by Lucee. Here is the most recent output in the Application.log:

“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [sun.misc.Launcher$AppClassLoader@70dea4e]”
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [java.net.URLClassLoader@7699a589]”
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [lucee.commons.io.res.util.ResourceClassLoader@303ae0a5]”
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“looking for tools.jar”
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“couldn’t find tools.jar at: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.242.b08-0.50.amzn1.x86_64/jre/lib/tools.jar”
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“for IBM SDK couldn’t find /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.242.b08-0.50.amzn1.x86_64/lib/tools.jar”
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“found /opt/lucee/tomcat/lucee-server/context/tools-linux-7u25.jar”
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“tools.jar used:/opt/lucee/tomcat/lucee-server/context/tools-linux-7u25.jar”
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“add /opt/lucee/tomcat/lucee-server/context/bin to library path”
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“loaded VirtualMachine class:com.sun.tools.attach.VirtualMachine”
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“try to load agent (path:/opt/lucee/tomcat/lucee-server/context/lucee-external-agent.jar)”
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“pid:2619”
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,"java.lang.ExceptionInInitializerError;java.lang.ExceptionInInitializerError;java.lang.ExceptionInInitializerError
at sun.tools.attach.LinuxAttachProvider.attachVirtualMachine(LinuxAttachProvider.java:63)
at com.sun.tools.attach.VirtualMachine.attach(VirtualMachine.java:213)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at lucee.runtime.instrumentation.InstrumentationFactory.loadAgent(InstrumentationFactory.java:328)
at lucee.runtime.instrumentation.InstrumentationFactory.access$400(InstrumentationFactory.java:58)
at lucee.runtime.instrumentation.InstrumentationFactory$1.run(InstrumentationFactory.java:109)
at java.security.AccessController.doPrivileged(Native Method)
at lucee.runtime.instrumentation.InstrumentationFactory.getInstrumentation(InstrumentationFactory.java:75)
at lucee.commons.lang.PhysicalClassLoader.loadClass(PhysicalClassLoader.java:192)
at lucee.runtime.MappingImpl.getPhysicalClass(MappingImpl.java:253)
at lucee.runtime.PageSourceImpl._compile(PageSourceImpl.java:408)
at lucee.runtime.PageSourceImpl.compile(PageSourceImpl.java:372)
at lucee.runtime.PageSourceImpl.loadPhysical(PageSourceImpl.java:315)
at lucee.runtime.PageSourceImpl.loadPageThrowTemplateException(PageSourceImpl.java:221)
at lucee.runtime.PageSourceImpl.loadPage(PageSourceImpl.java:986)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:905)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at template.main_cfm$cf.call(/template/main.cfm:131)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:913)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at index_cfm$cf.call(/index.cfm:2)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:913)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at application_cfc$cf.udfCall(/Application.cfc:23)
at lucee.runtime.type.UDFImpl.implementation(UDFImpl.java:106)
at lucee.runtime.type.UDFImpl._call(UDFImpl.java:342)
at lucee.runtime.type.UDFImpl.call(UDFImpl.java:215)
at lucee.runtime.ComponentImpl._call(ComponentImpl.java:646)
at lucee.runtime.ComponentImpl._call(ComponentImpl.java:568)
at lucee.runtime.ComponentImpl.call(ComponentImpl.java:1898)
at lucee.runtime.listener.ModernAppListener.call(ModernAppListener.java:436)
at lucee.runtime.listener.ModernAppListener._onRequest(ModernAppListener.java:215)
at lucee.runtime.listener.MixedAppListener.onRequest(MixedAppListener.java:42)
at lucee.runtime.PageContextImpl.execute(PageContextImpl.java:2415)
at lucee.runtime.PageContextImpl._execute(PageContextImpl.java:2405)
at lucee.runtime.PageContextImpl.executeCFML(PageContextImpl.java:2380)
at lucee.runtime.engine.Request.exe(Request.java:43)
at lucee.runtime.engine.CFMLEngineImpl._service(CFMLEngineImpl.java:1110)
at lucee.runtime.engine.CFMLEngineImpl.serviceCFML(CFMLEngineImpl.java:1056)
at lucee.loader.engine.CFMLEngineWrapper.serviceCFML(CFMLEngineWrapper.java:103)
at lucee.loader.servlet.CFMLServlet.service(CFMLServlet.java:62)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:478)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:342)
at org.apache.coyote.ajp.AjpProcessor.service(AjpProcessor.java:486)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:868)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1459)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1847)
at java.lang.Runtime.loadLibrary0(Runtime.java:871)
at java.lang.System.loadLibrary(System.java:1124)
at sun.tools.attach.LinuxVirtualMachine.(LinuxVirtualMachine.java:336)
… 69 more
"
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [sun.misc.Launcher$AppClassLoader@70dea4e]”
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [java.net.URLClassLoader@7699a589]”
“INFO”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“Instrumentation”,“not found [lucee.runtime.instrumentation.ExternalAgent] in ClassLoader [lucee.commons.io.res.util.ResourceClassLoader@303ae0a5]”
“ERROR”,“ajp-nio-8009-exec-4”,“03/24/2020”,“22:14:37”,“compilation”,"No compatible attachment provider is available;No compatible attachment provider is available;java.lang.IllegalStateException: No compatible attachment provider is available
at lucee.runtime.instrumentation.InstrumentationFactoryExternal.install(InstrumentationFactoryExternal.java:390)
at lucee.runtime.instrumentation.InstrumentationFactoryExternal.install(InstrumentationFactoryExternal.java:375)
at lucee.runtime.instrumentation.InstrumentationFactoryExternal.install(InstrumentationFactoryExternal.java:344)
at lucee.runtime.instrumentation.InstrumentationFactoryExternal.install(InstrumentationFactoryExternal.java:330)
at lucee.runtime.instrumentation.InstrumentationFactory.getInstrumentation(InstrumentationFactory.java:126)
at lucee.commons.lang.PhysicalClassLoader.loadClass(PhysicalClassLoader.java:192)
at lucee.runtime.MappingImpl.getPhysicalClass(MappingImpl.java:253)
at lucee.runtime.PageSourceImpl._compile(PageSourceImpl.java:408)
at lucee.runtime.PageSourceImpl.compile(PageSourceImpl.java:372)
at lucee.runtime.PageSourceImpl.loadPhysical(PageSourceImpl.java:315)
at lucee.runtime.PageSourceImpl.loadPageThrowTemplateException(PageSourceImpl.java:221)
at lucee.runtime.PageSourceImpl.loadPage(PageSourceImpl.java:986)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:905)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at template.main_cfm$cf.call(/template/main.cfm:131)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:913)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at index_cfm$cf.call(/index.cfm:2)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:913)
at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:836)
at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818)
at application_cfc$cf.udfCall(/Application.cfc:23)
at lucee.runtime.type.UDFImpl.implementation(UDFImpl.java:106)
at lucee.runtime.type.UDFImpl._call(UDFImpl.java:342)
at lucee.runtime.type.UDFImpl.call(UDFImpl.java:215)
at lucee.runtime.ComponentImpl._call(ComponentImpl.java:646)
at lucee.runtime.ComponentImpl._call(ComponentImpl.java:568)
at lucee.runtime.ComponentImpl.call(ComponentImpl.java:1898)
at lucee.runtime.listener.ModernAppListener.call(ModernAppListener.java:436)
at lucee.runtime.listener.ModernAppListener._onRequest(ModernAppListener.java:215)
at lucee.runtime.listener.MixedAppListener.onRequest(MixedAppListener.java:42)
at lucee.runtime.PageContextImpl.execute(PageContextImpl.java:2415)
at lucee.runtime.PageContextImpl._execute(PageContextImpl.java:2405)
at lucee.runtime.PageContextImpl.executeCFML(PageContextImpl.java:2380)
at lucee.runtime.engine.Request.exe(Request.java:43)
at lucee.runtime.engine.CFMLEngineImpl._service(CFMLEngineImpl.java:1110)
at lucee.runtime.engine.CFMLEngineImpl.serviceCFML(CFMLEngineImpl.java:1056)
at lucee.loader.engine.CFMLEngineWrapper.serviceCFML(CFMLEngineWrapper.java:103)
at lucee.loader.servlet.CFMLServlet.service(CFMLServlet.java:62)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:478)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:342)
at org.apache.coyote.ajp.AjpProcessor.service(AjpProcessor.java:486)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:868)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1459)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
"

wwilliams · March 25, 2020, 1:05am

So I was wrong. We have a few different sites / web contexts and we only modified one script and they are all showing this error. So it is not from file changes. It looks like it happens just every once in a while. Like every 5-30 minutes. It doesn’t appear to be causing pages to error out, it is just adding the INFO and ERRORS like the ones above.

andreas · March 25, 2020, 2:28am

Looks like some jars can’t be loaded because thet are not being found. Can you cross check and look if the jars exist in your new Java environment?

wwilliams · March 25, 2020, 3:31am

Thx for the reply!

Nope, but it (tools.jar) is not on any of our machines, even the ones that have not been updated to 1.8.0.242. We looked in everyone of the following folders within the /usr/lib/jvm/ folder:

java-1.8.0-openjdk-1.8.0.151-1.b12.35.amzn1.x86_64
java-1.8.0-openjdk-1.8.0.161-0.b14.36.amzn1.x86_64
java-1.8.0-openjdk-1.8.0.171-7.b10.37.amzn1.x86_64
java-1.8.0-openjdk-1.8.0.171-8.b10.38.amzn1.x86_64
java-1.8.0-openjdk-1.8.0.181-8.b13.39.39.amzn1.x86_64
java-1.8.0-openjdk-1.8.0.191.b12-0.42.amzn1.x86_64
java-1.8.0-openjdk-1.8.0.201.b09-0.43.amzn1.x86_64
java-1.8.0-openjdk-1.8.0.222.b10-0.47.amzn1.x86_64
java-1.8.0-openjdk-1.8.0.242.b08-0.50.amzn1.x86_64
jre
jre-1.8.0
jre-1.8.0-openjdk
jre-1.8.0-openjdk.x86_64
jre-openjdk

NOTE: We have set the JRE home folder within the Lucee /opt/lucee/tomcat/bin/setenv.sh file to /usr/lib/jvm/jre. This has worked for over 2 years with no issues. Any thoughts would be appreciated!

andreas · March 25, 2020, 4:27am

Strange. I can see that tools.jar in my java zulu. And if you download the zip of AdoptOptionJDK jdk8u242-b08.zip it is located in the lib folder. Where do you get your JDKs from?

further thinking: If it always worked on machines that doesn’t have the tools.jar, why might that specific machines ask for that specific tool.jar then? Ist there anything different on that machines going on? E.g. use of extensions/plug-ins?

andreas · March 25, 2020, 4:44am

Just downloaded Amazons Correto 8 Linux Java latest JDK. And tool.jar is also there.

bdw429s · March 25, 2020, 4:57am

This is a known issue I’ve seen many people run into on Java 8 update 242. Just roll back to update 232. I’ve tweeted about this and we covered it in the MoD podcast too. I have a ticket in the Lucee bug tracker for it, but it’s likely a change in the JDK. I spoke with several OpenJDK providers at Devnexus last month however and none of them had heard of the issue though. FWIW, moving to Java 11 also seems to get rid of the issue, but I’d recommend testing 5.3.4.85-snapshot as it has a few more fixes that are in build 80.

wwilliams · March 25, 2020, 1:26pm

At least I’m not going crazy!

What is the best way to rollback to 232? I currently don’t have 232 on any of the machines. We went from 222 straight to 242. When I do a “update-alternatives --config java”, this comes up:

There is 1 program that provides 'java'.

  Selection    Command
-----------------------------------------------
*+ 1           /usr/lib/jvm/jre-1.8.0-openjdk.x86_64/bin/java

NOTE: Only shows the OpenJDK 1.8.0.

Thanks in advance!

bdw429s · March 25, 2020, 4:48pm

How you install Java and tell your installation to use that installation depends on many factors including what sort of Lucee installation you have. I use CommandBox, so it’s dead easy. I just tell CommandBox what version of Java I want it to start the server with and that’s it. If you’ve used the Lucee installer, I assume updating the java_home env var is probably enough, but you’d need to check the Tomcat/catalina start scripts to see how they’re finding java in the first place. Update 222 may be fine, it’s just an update older than 232.

wwilliams · March 25, 2020, 11:03pm

So I ended up downgrading back to 222 and everything is working perfectly again. I appreciate the Lucee users who responded and helped me through this issue. Brad @bdw429s, do you have the ticket number for the Bug Tracker case you opened? I would love to keep an eye on it, so I can upgrade to 242 whenever Lucee gets patched.

Hope everyone is staying safe and handling our new working conditions well. Thanks again all!

bdw429s · March 25, 2020, 11:12pm

The ticket is here, but I wouldn’t expect it to ever get worked on
https://luceeserver.atlassian.net/browse/LDEV-2717

My understanding is that Lucee 5.3.6 has removed the instrumentation method entirely, or at least stopped using it so I doubt they’ll ever go back and update versions of Lucee such as 5.3.4 that have effectively “gone cold” as far as updates are concerned. I’m also not quite clear whether it’s Lucee’s bug or Java’s bug to be honest.

andreas · March 26, 2020, 9:05am

Thanks Bro! Stay safe too! I wish the best to everyone during these hard times.