LLM token usage in Elasticsearch Service Billing integration

Elastic Stack Elasticsearch
1

Hey guys!

I installed Elasticsearch Service Billing integration but cannot find my LLM token usage. I may see it in Elastic Cloud:

image
image1038×217 6.3 KB

However, I want to see this info in Elastic integration

If it is not possible, how can I track how many tokens the specific account consumed?

Thanks!

2

It may take some time to be collected by the integration, but the data is there.

it is the type inference.

3

Hey @leandrojmp , thank you for response! Indeed, inference appeared after some time

Though, I still cannot find the wait to drilldown this usage per account

So, I want to be able address the question "which account does consume the most of the tokens?" on some graph

I found Kibana API:

POST kbn://api/agent_builder/agents/elastic-ai-agent/consumption
{"size": 25, "sort_field": "updated_at", "sort_order": "desc"}

which returns an account and token usage

However, to make it useful I need to write a little script which will execute this request every N minutes, send it to Elastic and then you this dataset to build visualizations

But maybe I missed something and such data is available somewhere else in Elastic already?

Thanks!