SOAP Webservice performance

Since a few weeks our soap webservice went very slow.
I do not know what has changed, maybe the underlaying tomcat version with a linux update.
We have a testbox suite that run real webrequests to the local host, erlier it took 60s for all tests, after migrating to aws it wun in about 45s, and since we moved to a larger machine and used 8GB ram for lucee, we could run all testcases in about 30s.

Now we got complains of the webservice clients that everything went very slow.
My Testcases do actually taking over 200s now.
I tryed several settings and lucee versions.
It was long time running on the old 5.2.x version prior the axis extension.
Actually i can run it also on 3.3.x, i tryed Axcis 24 / 25 / 27 all seems to be the same.
I checked with the fusion reactor support and they said it is lucee internally wastimng the time by mapping my input objects ( only strings., numbers and dates ) into the java objects.

When i observe the single requests, they all taking more then 400ms, and inside is mostly one sql statement which takes 1 - 4 ms… The rest ( 80 - 95% of the time ) lucee is just convertimng my arguments.

The code for the most of the webservice methods is very easy stuff, just arguments vaklidating, and fire one or 2 sql queries on oracle. FR show us that the SQL is allways quick.

What can be the cause of this behaviour ?
I never tryed to change the underlaying tomcat, which i think it’s possiblöy updated by the linux apt update.

Switching to REST is a long term alternative, but we need a solution now, since our data load is slowed down to 15 - 20% of the original performance.

We urgently needing support here.

Kind regards
Rene

OS: Linux Ubuntu 18 Linux (5.4.0-1056-aws [amd64])
Java Version: 25.181-b13 (1.8.0_181)
Tomcat Version: 8.5.33
Lucee Version: 5.2.9.31 & 5.3.8.201

which java version are you running?

25.181-b13 (1.8.0_181)
Java™ SE Runtime Environment (1.8.0_181-b13)

I’m stucking here, I canot see what has changed in my system.
I checked tomcat ( could be updated on a system update ) but the tomcat version seems from 2018 and packed into the lucee installer.

This is the output of version.sh:

root@secure6:/opt/lucee/tomcat/bin# ./version.sh
Server version: Apache Tomcat/8.5.33
Server built:   Aug 12 2018 08:20:08 UTC
Server number:  8.5.33.0
OS Name:        Linux
OS Version:     5.4.0-1055-aws
Architecture:   amd64
JVM Version:    1.8.0_292-8u292-b10-0ubuntu1~18.04-b10
JVM Vendor:     Private Build

These settings seems untouched between my two versions.

5.2.9.31 and 5.3.8.201

And since tomcat is an old version, i guess it is no canditate for my issues.

JVM comes also from the lucee installer, does it update by the apt-get commands too ?