Output Batch Sizes

[dawiro]

Hi,
How can we see the size of the batches logstash is pushing to elasticsearch?

Thx
D

[Rios]

AFAIK you cannot set only for the output. You can set on a pipeline level.

pipeline.batch.size: 125
pipeline.batch.delay: 50

[dawiro]

That is the configured batch size within the pipeline. I'm interested in seeing the size of the batches hitting the wire.

[Rios]

If you want to see current activities, go to Kibana->Management->Stack monitoring. Before that you should configure LS for monitoring.
On ELK 8.x you should use Metricbeat. For older versions, you can use X-pack. Add in logstash.yml.

xpack.monitoring.enabled: true
xpack.monitoring.collection.interval: 10s
xpack.monitoring.collection.pipeline.details.enabled: true
xpack.monitoring.elasticsearch.hosts: ["http://eshost:9200"]

And of course you can do it manually on the LS host:

http://localhost:9600/_node/stats/pipelines?pretty
http://localhost:9600/_node/stats/events?pretty