Hi!
We are currently setting up monitoring for our Logstash instances.
Metricbeat on the Logstash is configured as described in the instructions:
- module: logstash
metricsets:
- node
- node_stats
xpack.enabled: true
period: 10s
hosts: ["localhost:9600"]
output.elasticsearch:
# Array of hosts to connect to.
hosts:
- https://es-rm-1.<domain>
- https://es-rm-2.<domain>
# Protocol - either `http` (default) or `https`.
#protocol: "https"
username: "logstash"
password: "redacted"
Receiving data works fine, the stack monitoring shows informations about pipelines.
These pipelines exist: syslog, exim, dhcpd, radiusd, panorama, output-elastic, output-percent
However, for some reason, specifically pipelines with an output plugin "elasticsearch" are not shown:
As soon as I replace the elasticsearch output plugin with the stdout plugin, the pipeline shows up in the view. Is this by design or is there a setting we have to change?
FWIW, the pipeline does show up in the output of http://localhost:9600/_node/stats/pipelines
curl -s http://localhost:9600/_node/stats/pipelines | jq -r '.pipelines | to_entries[] | .key'
output-percent
exim
radiusd
dhcpd
panorama
output-elastic
syslog
Thanks for any help!
Best Regards
Peter