CFModule vs CFImport - radically different performance?

Zackster · February 25, 2021, 3:44pm

bug logged [LDEV-3300] - Lucee

can you try creating the mapping to ram://tags rather than just ram://

bennadel · February 25, 2021, 3:56pm

I don’t think so – it shows up as “red” when I try to include the path:

Zackster · February 25, 2021, 4:16pm

the red is coz physical isn’t set for ram:// which may explain some of the performance difference???

github.com

lucee/Lucee/blob/5.3/core/src/main/cfml/context/admin/resources.mappings.list.cfm#L42


      
          							<td nowrap="nowrap">
          								<input type="hidden" name="virtual_#mappings.currentrow#" value="#mappings.virtual#">
          								<cfif len(mappings.virtual) gt 19>
          									<abbr title="#mappings.virtual#">#cut(mappings.virtual, 16)#...</abbr>
          								<cfelse>
          									#mappings.virtual#
          								</cfif>
          							</td>
          							
          							<!--- physical --->
          							<cfset css=iif(len(mappings.physical) EQ 0 and len(mappings.strPhysical) NEQ 0,de('Red'),de(''))>
          							<td class="tblContent#css# longwords">
          								<cfif FALSE and len(mappings.strPhysical) gt 39>
          									<abbr title="#mappings.strPhysical#">#left(mappings.strPhysical, 20)#...#right(mappings.strPhysical, 16)#</abbr>
          								<cfelse>
          									#mappings.strPhysical#
          								</cfif>
          							</td>
          							<!--- archive --->
          							<cfset css=iif(len(mappings.archive) EQ 0 and len(mappings.strArchive) NEQ 0,de('Red'),de(''))>
          							<td class="tblContent#css# longwords">

bennadel · February 25, 2021, 4:49pm

Now you’re over my head

As an aside, I don’t think I’ve seen iif() / de() code in a long time!

Zackster · February 25, 2021, 4:52pm

it’s all detective work…

you should file a performance bug about the ram mapping being slower than expected (not caching with once?)

dswitzer · March 4, 2021, 6:10pm

@bennadel,

You’ve probably done this already, but just in case, check to make sure your Docker instance has enough RAM. Maybe part of the issue is there is a lot of disk swapping occurring because there’s not enough memory available. That could explain why it’s slow using the RAM drive.

bennadel · March 5, 2021, 10:50am

That’s a good question. I’m not really good at configuring all the Docker for Mac stuff. I think I have 4 CPUs, 10 GB RAM, and 1 GB of swap space allocated. I have no idea if that’s good or not Docker performance is all magic to me.

dswitzer · March 5, 2021, 1:45pm

Let me preface by stating that I don’t use a Mac or Docker, so there might be other more well know issues at play for which I’m unaware.

However, memory allotment gets tricky when dealing with containers and VMs. The problem is you’re dealing with the memory allotment on your Host (i.e. Mac), the VM container and then the various things running inside the VM (including the JVM).

So if you gave your Docker container access to 10GBs of RAM, but your Mac only has 16GBs of RAM you could very well be running into swapping issues on your Mac. I know I always have Firefox and multiple instance of Chrome running and Chrome can really eat up memory. You start to add in all the various Developer Tools you might be running (IDE, Photoshop, Database, etc) and you could easily be having swapping issues at your Mac OS level.

Then there’s the Docker container. Not knowing what’s running in your Docker container, they may be enough, maybe it’s overkill or maybe it’s not enough. That seems like a ton, but maybe there’s a bunch of micro services and a database running inside that container that chews up all that memory. Then there’s the JVM memory settings. If those are set higher than the Docker memory settings, that’s going to cause issues. Or maybe the JVM settings are way to low, so it’s forcing a ton of garbage collection and the JVM is fighting memory issues even though the Docker container has plenty of memory available.

So, it may be all of this is fine, but if you haven’t looked things over, it’s worth doing just to make sure you haven’t created a bottleneck somewhere accidentally.

bennadel · March 8, 2021, 12:54pm

Ha ha, which basically sums up why some of this stuff is so hard to reason about! I appreciate the insight.

bennadel · March 19, 2021, 2:08pm

For what it is worth, I finally just deployed some test code to production to see what a “real world” performance scenario would be – turns out, this is much less of an issue in our production *nix machines. In fact, the File IO seems to be 68-times slower in my local Docker setup. So, I think the <cfimport> solution is still viable in production.