I’ve been reading through the Lucee documentation for all the recent AI-based additions which have been added to the language over the last year or so, but I’m not seeing anything about how logging/tracking of the calls to the AI providers can be implemented.
We’re currently using a small custom framework we have been using for our AI integrations, because part of our requirement is that we can log the prompts sent, responses received, and with the prompt/response token counts (so we can verify billing/throttle customers based on prompt usage).
Maybe I’m missing it, but are there any hooks with the current AI functionality which would allow us to add some tracking/logging to the native AI functionality so we could capture this information?
We are getting ready to implement MCP support for our application, so thought w/Lucee’s planned support for MCP it would make sense to look into migrating to Lucee’s native AI functionality, but the lack of support for being able to track this stuff is prohibitive for us.
Am I missing something? Are there some ways we might be able to implement this tracking/logging?