Hi
I have a task where I need to figure out how to collect metrics from Confluent Cloud in ELK Stack.
I have been looking into metricbeat http module and I'm able to query metrics from the Confluent Cloud API: https://api.telemetry.confluent.cloud:443
the problem is the response I get does not indicate WHAT metric is returned. I know the query it self as for a specific metric. But this information is not available in ELK
So I'm looking for a way to "enrich" the response data from Confluent Cloud.
IS their a way to add like a keywork the result ?
This is what my query looks like:
"aggregations": [
{
"metric": "io.confluent.kafka.server/received_records"
}
],
"filter": {
"op": "OR",
"filters": [
{
"field": "resource.kafka.id",
"op": "EQ",
"value": "lkc-99oxm"
},
{
"field": "resource.kafka.id",
"op": "EQ",
"value": "lkc-o8r7p"
}
]
},
"granularity": "PT1M",
"group_by": [
"metric.partition",
"resource.kafka.id"
],
"intervals": [
"now-2m|m/now-1m|m"
],
"limit": 1000
}'
Also is their a document that explain all availabe configurations for the http module ?