I'm looking to calculate lag for kafka which seems like it is kafka.partition.offset.newest - kafka.consumergroup.offset. Those fields are in different documents though across the consumergroup and partition metricset. Is there a way to join those or how would you write the query?
If we could have an identical field to group with on each document for topic name I think that would work.
Hi Richard
The way the Kafka module is working at the moment is not optimal. We plan to mostly redo it based on the feedback we got so far. There are several issues open in the Github repo. It would be great if you could comment with the above for example here: https://github.com/elastic/beats/issues/3005
I've added it.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.