Recently I upgraded filebeat version, and got a problem for monitoring.
I was using httpprof /debug/metrics to check kafka output rate in one minute for monitoring.
(it is supplied from Sarama kafka lib. )
/debug/metrics is merged to /debug/vars, but only few metrics.
(libbeat.output.kafka.bytes_write, libbeat.output.kafka.bytes_read, no 'rate' on name, but actually it is rate for whole living time of filebeat)
there is no one-minute rate field.
actually, I just need metrics(ex, Non-zero metrics in the last 30s: ~) on logging file,
but httpprof /debug/vars don't have anything about that.
I think one-minute rate is most important meter it can helps to be noticed various problems from source to target. (application, filebeat, (in this case) kafka)
Now, I start to modify my monitoring script to make one-minute rate(compare "published_events" from previous response and current one...
I hope to be improved this
Or if i missed something, plz let me know how to get one-minute publish rate.