4 Separate Servers (different machines) Lucee Stopped On All Of Them Simultaneously

dev support
1

We have 4 “separate servers” and instances of lucee running in AWS. Not 4 instances of lucee running on a single web server. We got error warnings from our healthchecks… Lucee stopped responding on all of them almost simultaneously. We use an RDS SQL server. I see a lot of sqlserver errors below but why would any of this cause the lucee service to choke and stop responding? I have googled the error but nothing that would indicate that lucee would crash, or maybe java crashed?

Server 1
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:13 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:33:13 PM javax.mail.Session loadResource
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text-4.cfm
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text-7.cfm
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text-4.cfm
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text-4.cfm
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:38:38 PM javax.mail.Session loadResource
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text_reviews.cfm
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text_swos.cfm
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text_reviews.cfm
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text_reviews.cfm
[ERROR] Jun 16, 2023 8:38:40 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:38:40 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:38:40 PM javax.mail.Session loadResource

Server 2
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:13 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:33:13 PM javax.mail.Session loadResource
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text-4.cfm
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text-7.cfm
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text-4.cfm
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text-4.cfm
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:38:38 PM javax.mail.Session loadResource
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text_reviews.cfm
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text_swos.cfm
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text_reviews.cfm
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text_reviews.cfm
[ERROR] Jun 16, 2023 8:38:40 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:38:40 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:38:40 PM javax.mail.Session loadResource

Server 3
[ERROR] Jun 16, 2023 8:38:37 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:38:38 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text_entad.cfm
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text-6.cfm
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text_swos.cfm
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text-5.cfm
[ERROR] Jun 16, 2023 8:38:40 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:38:40 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:47:46 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:52:27 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:54:00 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:54:14 PM javax.mail.Session loadResource

Server 4
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader readPacket
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS
[ERROR] Jun 16, 2023 8:33:12 PM com.microsoft.sqlserver.jdbc.TDSReader throwInvalidTDS

Also seeing this error across all of them as well.
[ERROR] Jun 16, 2023 8:38:40 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:38:40 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:47:46 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:52:27 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:54:00 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 8:54:14 PM javax.mail.Session loadResource
[ERROR] Jun 16, 2023 9:02:36 PM javax.mail.Session loadResource

Don’t forget to tell us about your stack!

OS: ??? windows server 2022
Java Version: Command Box Version
Tomcat Version: Command Box Version
Lucee Version: ??? 5.3.9+160

2

given it all happened at the same time, I think the front fell off your database?

2 Likes
3

outside of that being absolutely hilarious… this would cause lucee to crash? Wouldn’t it just kill the connection? Is there a setting in the lucee server we should check that would kill the request?

4

this really shouldn’t cause lucee to crash out

is there anything in the server.out.txt or in the out.log / err.log ,

along the lines of

C:\work\commandBox\server\9B2B41F3312FB30104FACDE9029E3C1A-preside-6\lucee-6.0.0-BETA.451\logs\server.out.txt

C:\work\commandBox\server\9B2B41F3312FB30104FACDE9029E3C1A-preside-6\lucee-6.0.0-BETA.451\WEB-INF\lucee-server\context\logs\ out.log or err.log

5

You didn’t tell us what your healthchecks for the Lucee containers actually checks. If it checks the DB… the DB issue could have caused your Lucee containers to become unhealthy. At the same time. And whatever listens to yer healthchecks then… restarts the Lucee containers…

6

The health check runs a CFM page to ensure it resolves appropriately. The server itself is/was running, Lucee stopped responding.

7

Here the the server.out.txt log, below is the other out.log

ERROR] runwar.context: Jun 16, 2023 8:38:38 PM javax.mail.Session loadResource
WARNING: expected resource not found: /META-INF/javamail.default.address.map

[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text_reviews.cfm
java.lang.ThreadDeath: null
at java.lang.Thread.stop(Unknown Source) ~[?:?]
at lucee.commons.io.SystemUtil._stop(SystemUtil.java:1342) ~[?:?]
at lucee.commons.io.SystemUtil.stop(SystemUtil.java:1333) ~[?:?]
at lucee.commons.io.StopThread.run(SystemUtil.java:1755) ~[?:?]
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text_swos.cfm
java.lang.ThreadDeath: null
at java.lang.Thread.stop(Unknown Source) ~[?:?]
at lucee.commons.io.SystemUtil._stop(SystemUtil.java:1342) ~[?:?]
at lucee.commons.io.SystemUtil.stop(SystemUtil.java:1333) ~[?:?]
at lucee.commons.io.StopThread.run(SystemUtil.java:1755) ~[?:?]
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text_reviews.cfm
java.lang.ThreadDeath: null
at java.lang.Thread.stop(Unknown Source) ~[?:?]
at lucee.commons.io.SystemUtil._stop(SystemUtil.java:1342) ~[?:?]
at lucee.commons.io.SystemUtil.stop(SystemUtil.java:1333) ~[?:?]
at lucee.commons.io.StopThread.run(SystemUtil.java:1755) ~[?:?]
[ERROR] io.undertow.request: UT005023: Exception handling request to /batch_jobs/batch_text_reviews.cfm
java.lang.ThreadDeath: null
at java.lang.Thread.stop(Unknown Source) ~[?:?]
at lucee.commons.io.SystemUtil._stop(SystemUtil.java:1342) ~[?:?]
at lucee.commons.io.SystemUtil.stop(SystemUtil.java:1333) ~[?:?]
at lucee.commons.io.StopThread.run(SystemUtil.java:1755) ~[?:?]
[ERROR] runwar.context: Jun 16, 2023 8:38:40 PM javax.mail.Session loadResource
WARNING: expected resource not found: /META-INF/javamail.default.address.map

[ERROR] runwar.context: Jun 16, 2023 8:38:40 PM javax.mail.Session loadResource
WARNING: expected resource not found: /META-INF/javamail.default.address.map

[ERROR] runwar.context: Jun 16, 2023 8:38:40 PM javax.mail.Session loadResource
WARNING: expected resource not found: /META-INF/javamail.default.address.map

context/logs/OUT.log
2023-06-16 20:30:29.469 application:xml com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl is used as DocumentBuilderFactory
2023-06-16 20:30:29.877 lucee.runtime.config.XMLConfigWebFactory start reading config
2023-06-16 20:30:29.925 lucee.runtime.config.XMLConfigWebFactory fixed LFI
2023-06-16 20:30:29.925 lucee.runtime.config.XMLConfigWebFactory fixed salt
2023-06-16 20:30:29.925 lucee.runtime.config.XMLConfigWebFactory fixed S3
2023-06-16 20:30:29.925 lucee.runtime.config.XMLConfigWebFactory fixed PSQ
2023-06-16 20:30:29.925 lucee.runtime.config.XMLConfigWebFactory fixed logging
2023-06-16 20:30:29.940 lucee.runtime.config.XMLConfigWebFactory fixed Extension
2023-06-16 20:30:29.940 lucee.runtime.config.XMLConfigWebFactory fixed component mappings
2023-06-16 20:30:29.940 lucee.runtime.config.XMLConfigWebFactory deploy web context
2023-06-16 20:30:29.940 lucee.runtime.config.XMLConfigWebFactory loaded config
2023-06-16 20:30:29.940 lucee.runtime.config.XMLConfigWebFactory loaded constants
2023-06-16 20:30:30.160 lucee.runtime.config.XMLConfigWebFactory loaded loggers
2023-06-16 20:30:30.160 lucee.runtime.config.XMLConfigWebFactory loaded temp dir
2023-06-16 20:30:30.176 lucee.runtime.config.XMLConfigWebFactory loaded id
2023-06-16 20:30:30.176 lucee.runtime.config.XMLConfigWebFactory loaded version
2023-06-16 20:30:30.176 lucee.runtime.config.XMLConfigWebFactory loaded security
2023-06-16 20:30:30.176 lucee.runtime.config.XMLConfigWebFactory loaded lib
2023-06-16 20:30:30.176 lucee.runtime.config.XMLConfigWebFactory loaded system
2023-06-16 20:30:30.192 lucee.runtime.config.XMLConfigWebFactory loaded resource providers
2023-06-16 20:30:30.538 lucee.runtime.config.XMLConfigWebFactory loaded filesystem
2023-06-16 20:30:30.616 lucee.runtime.config.XMLConfigWebFactory loaded extension bundles
2023-06-16 20:30:30.616 lucee.runtime.config.XMLConfigWebFactory loaded webservice
2023-06-16 20:30:30.616 lucee.runtime.config.XMLConfigWebFactory loaded orm
2023-06-16 20:30:30.616 lucee.runtime.config.XMLConfigWebFactory loaded cache handlers
2023-06-16 20:30:30.632 lucee.runtime.config.XMLConfigWebFactory loaded charset
2023-06-16 20:30:30.632 lucee.runtime.config.XMLConfigWebFactory loaded application
2023-06-16 20:30:30.648 lucee.runtime.config.XMLConfigWebFactory loaded mappings
2023-06-16 20:30:30.648 lucee.runtime.config.XMLConfigWebFactory loaded rest
2023-06-16 20:30:30.648 lucee.runtime.config.XMLConfigWebFactory loaded extensions
2023-06-16 20:30:30.648 lucee.runtime.config.XMLConfigWebFactory loaded page pool
2023-06-16 20:30:30.663 lucee.runtime.config.XMLConfigWebFactory loaded datasources
2023-06-16 20:30:30.805 lucee.runtime.config.XMLConfigWebFactory loaded cache
2023-06-16 20:30:30.805 lucee.runtime.config.XMLConfigWebFactory loaded custom tag mappings
2023-06-16 20:30:30.805 lucee.runtime.config.XMLConfigWebFactory loaded tags
2023-06-16 20:30:30.821 lucee.runtime.config.XMLConfigWebFactory loaded regional
2023-06-16 20:30:30.821 lucee.runtime.config.XMLConfigWebFactory loaded compiler
2023-06-16 20:30:30.821 lucee.runtime.config.XMLConfigWebFactory loaded scope
2023-06-16 20:30:30.821 lucee.runtime.config.XMLConfigWebFactory loaded mail
2023-06-16 20:30:30.821 lucee.runtime.config.XMLConfigWebFactory loaded search
2023-06-16 20:30:30.821 lucee.runtime.config.XMLConfigWebFactory loaded scheduled tasks
2023-06-16 20:30:30.821 lucee.runtime.config.XMLConfigWebFactory loaded debug
2023-06-16 20:30:30.821 lucee.runtime.config.XMLConfigWebFactory loaded error
2023-06-16 20:30:30.836 lucee.runtime.config.XMLConfigWebFactory loaded regex
2023-06-16 20:30:30.836 lucee.runtime.config.XMLConfigWebFactory loaded cfx
2023-06-16 20:30:30.836 lucee.runtime.config.XMLConfigWebFactory loaded component
2023-06-16 20:30:30.836 lucee.runtime.config.XMLConfigWebFactory loaded update
2023-06-16 20:30:30.836 lucee.runtime.config.XMLConfigWebFactory loaded java
2023-06-16 20:30:30.836 lucee.runtime.config.XMLConfigWebFactory loaded setting
2023-06-16 20:30:30.836 lucee.runtime.config.XMLConfigWebFactory loaded proxy
2023-06-16 20:30:30.836 lucee.runtime.config.XMLConfigWebFactory loaded remote clients
2023-06-16 20:30:30.836 lucee.runtime.config.XMLConfigWebFactory loaded video
2023-06-16 20:30:30.836 lucee.runtime.config.XMLConfigWebFactory loaded flex
2023-06-16 20:30:30.946 lucee.runtime.config.XMLConfigWebFactory loaded settings2
2023-06-16 20:30:30.946 lucee.runtime.config.XMLConfigWebFactory loaded listeners
2023-06-16 20:30:30.962 lucee.runtime.config.XMLConfigWebFactory loaded dump writers
2023-06-16 20:30:30.962 lucee.runtime.config.XMLConfigWebFactory loaded gateways
2023-06-16 20:30:30.962 lucee.runtime.config.XMLConfigWebFactory loaded exe log
2023-06-16 20:30:30.978 lucee.runtime.config.XMLConfigWebFactory loaded queue
2023-06-16 20:30:30.978 lucee.runtime.config.XMLConfigWebFactory loaded monitors
2023-06-16 20:30:30.978 lucee.runtime.config.XMLConfigWebFactory loaded login
2023-06-16 20:30:30.978 lucee.runtime.config.XMLConfigWebFactory loaded startup hook
2023-06-16 20:30:31.182 lucee.runtime.config.XMLConfigWebFactory ===================================================================
WEB CONTEXT (114edb1af1edb2fb19707f65922400e8)

  • config:C:\Users\Administrator.CommandBox\server\4C607C424B8B6F86D0DC46DB8F6F5F28-payments\lucee-5.3.9.160\WEB-INF\lucee-web (custom setting)
  • webroot:C:\websites\payments
  • hash:114edb1af1edb2fb19707f65922400e8
  • label:114edb1af1edb2fb19707f65922400e8
    ===================================================================

2023-06-16 20:30:31.261 lucee.runtime.config.XMLConfigWebFactory start reading config
2023-06-16 20:30:31.261 lucee.runtime.config.XMLConfigWebFactory fixed LFI
2023-06-16 20:30:31.261 lucee.runtime.config.XMLConfigWebFactory fixed salt
2023-06-16 20:30:31.261 lucee.runtime.config.XMLConfigWebFactory fixed S3
2023-06-16 20:30:31.261 lucee.runtime.config.XMLConfigWebFactory fixed PSQ
2023-06-16 20:30:31.261 lucee.runtime.config.XMLConfigWebFactory fixed logging
2023-06-16 20:30:31.261 lucee.runtime.config.XMLConfigWebFactory fixed Extension
2023-06-16 20:30:31.261 lucee.runtime.config.XMLConfigWebFactory fixed component mappings
2023-06-16 20:30:31.277 lucee.runtime.config.XMLConfigWebFactory deploy web context
2023-06-16 20:30:31.277 lucee.runtime.config.XMLConfigWebFactory loaded config
2023-06-16 20:30:31.277 lucee.runtime.config.XMLConfigWebFactory loaded constants
2023-06-16 20:30:31.292 lucee.runtime.config.XMLConfigWebFactory loaded loggers
2023-06-16 20:30:31.607 lucee.runtime.config.XMLConfigWebFactory loaded temp dir
2023-06-16 20:30:31.607 lucee.runtime.config.XMLConfigWebFactory loaded id
2023-06-16 20:30:31.607 lucee.runtime.config.XMLConfigWebFactory loaded version
2023-06-16 20:30:31.607 lucee.runtime.config.XMLConfigWebFactory loaded security
2023-06-16 20:30:31.607 lucee.runtime.config.XMLConfigWebFactory loaded lib
2023-06-16 20:30:31.607 lucee.runtime.config.XMLConfigWebFactory loaded system
2023-06-16 20:30:31.607 lucee.runtime.config.XMLConfigWebFactory loaded resource providers
2023-06-16 20:30:31.622 lucee.runtime.config.XMLConfigWebFactory loaded filesystem
2023-06-16 20:30:31.622 lucee.runtime.config.XMLConfigWebFactory loaded extension bundles
2023-06-16 20:30:31.622 lucee.runtime.config.XMLConfigWebFactory loaded webservice
2023-06-16 20:30:31.622 lucee.runtime.config.XMLConfigWebFactory loaded orm
2023-06-16 20:30:31.622 lucee.runtime.config.XMLConfigWebFactory loaded cache handlers
2023-06-16 20:30:31.622 lucee.runtime.config.XMLConfigWebFactory loaded charset
2023-06-16 20:30:31.622 lucee.runtime.config.XMLConfigWebFactory loaded application
2023-06-16 20:30:31.748 lucee.runtime.config.XMLConfigWebFactory loaded mappings
2023-06-16 20:30:31.764 lucee.runtime.config.XMLConfigWebFactory loaded rest
2023-06-16 20:30:31.764 lucee.runtime.config.XMLConfigWebFactory loaded extensions
2023-06-16 20:30:31.764 lucee.runtime.config.XMLConfigWebFactory loaded page pool
2023-06-16 20:30:31.764 lucee.runtime.config.XMLConfigWebFactory loaded datasources
2023-06-16 20:30:31.764 lucee.runtime.config.XMLConfigWebFactory loaded cache
2023-06-16 20:30:31.764 lucee.runtime.config.XMLConfigWebFactory loaded custom tag mappings
2023-06-16 20:30:31.764 lucee.runtime.config.XMLConfigWebFactory loaded tags
2023-06-16 20:30:31.764 lucee.runtime.config.XMLConfigWebFactory loaded regional
2023-06-16 20:30:31.764 lucee.runtime.config.XMLConfigWebFactory loaded compiler
2023-06-16 20:30:31.764 lucee.runtime.config.XMLConfigWebFactory loaded scope
2023-06-16 20:30:31.764 lucee.runtime.config.XMLConfigWebFactory loaded mail
2023-06-16 20:30:31.764 lucee.runtime.config.XMLConfigWebFactory loaded search
2023-06-16 20:30:31.780 lucee.runtime.config.XMLConfigWebFactory loaded scheduled tasks
2023-06-16 20:30:31.780 lucee.runtime.config.XMLConfigWebFactory loaded debug
2023-06-16 20:30:31.780 lucee.runtime.config.XMLConfigWebFactory loaded error
2023-06-16 20:30:31.795 lucee.runtime.config.XMLConfigWebFactory loaded regex
2023-06-16 20:30:31.795 lucee.runtime.config.XMLConfigWebFactory loaded cfx
2023-06-16 20:30:31.795 lucee.runtime.config.XMLConfigWebFactory loaded component
2023-06-16 20:30:31.795 lucee.runtime.config.XMLConfigWebFactory loaded update
2023-06-16 20:30:31.795 lucee.runtime.config.XMLConfigWebFactory loaded java
2023-06-16 20:30:31.795 lucee.runtime.config.XMLConfigWebFactory loaded setting
2023-06-16 20:30:31.795 lucee.runtime.config.XMLConfigWebFactory loaded proxy
2023-06-16 20:30:31.795 lucee.runtime.config.XMLConfigWebFactory loaded remote clients
2023-06-16 20:30:31.795 lucee.runtime.config.XMLConfigWebFactory loaded video
2023-06-16 20:30:31.795 lucee.runtime.config.XMLConfigWebFactory loaded flex
2023-06-16 20:30:31.842 lucee.runtime.config.XMLConfigWebFactory loaded settings2
2023-06-16 20:30:31.842 lucee.runtime.config.XMLConfigWebFactory loaded listeners
2023-06-16 20:30:31.842 lucee.runtime.config.XMLConfigWebFactory loaded dump writers
2023-06-16 20:30:31.858 lucee.runtime.config.XMLConfigWebFactory loaded gateways
2023-06-16 20:30:31.858 lucee.runtime.config.XMLConfigWebFactory loaded exe log
2023-06-16 20:30:31.858 lucee.runtime.config.XMLConfigWebFactory loaded queue
2023-06-16 20:30:31.858 lucee.runtime.config.XMLConfigWebFactory loaded monitors
2023-06-16 20:30:31.858 lucee.runtime.config.XMLConfigWebFactory loaded login
2023-06-16 20:30:31.858 lucee.runtime.config.XMLConfigWebFactory loaded startup hook
2023-06-16 20:30:32.707 lucee.runtime.config.XMLConfigWebFactory added tag meta data

8

what version of commandbox are you running?

9

command box v5.6.1+00618

10

i’d be updating that, latest is 5.90

11

Did all the servers have the same exception triggered by the code within the template above?

12

Yes, i believe so. We have isolated the scheduled tasks to a different server now so that they are not concurrently running.