Hi,
How can we see the size of the batches logstash is pushing to elasticsearch?
Thx
D
AFAIK you cannot set only for the output. You can set on a pipeline level.
pipeline.batch.size: 125
pipeline.batch.delay: 50
That is the configured batch size within the pipeline. I'm interested in seeing the size of the batches hitting the wire.
If you want to see current activities, go to Kibana->Management->Stack monitoring. Before that you should configure LS for monitoring.
On ELK 8.x you should use Metricbeat. For older versions, you can use X-pack. Add in logstash.yml.
xpack.monitoring.enabled: true
xpack.monitoring.collection.interval: 10s
xpack.monitoring.collection.pipeline.details.enabled: true
xpack.monitoring.elasticsearch.hosts: ["http://eshost:9200"]
And of course you can do it manually on the LS host:
http://localhost:9600/_node/stats/pipelines?pretty
http://localhost:9600/_node/stats/events?pretty
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.