I wonder if there a proper way to measure the number of emitted events per pod/container in Kubernetes, every 1 minute before they being sent to Logstash.
I see that Filebeat saves the offset of each harvested file in the registry file, is it possible to translate this offset into number of consumed lines?
If not, Is there any other efficient way to send the number of emitted events for each pod in a Kubernetes cluster as a metric to some backend?
Having a separate tool that will run for each pod and calculate the number of log lines will be probably overkilling. Assuming that Filebeat already tracks each log file, it will be much easier to make use of it somehow.