Hello TL;DR - What pipelines must be set a persistent queues to avoid losing data, in a pepeline-to-pipeline distributor pattern We are using Pipeline to pipeline comunication in Logstash. We use the distributor pattern, since we have a Logstash input where we get all the events from several Fileb…

Pipeline to pipeline distributor, how not to lose events

Badger October 14, 2019, 12:19pm 4

I do not think so, queue size appears to be a global option.

Topic		Replies	Views
Logstash persistent queues with pipelines behaivour Logstash	1	266	October 27, 2020
Logstash multiple pipelines failure with persistent queues Logstash	5	1442	March 7, 2022
Persistent Queues - invitation for beta testing! Logstash	7	1480	April 13, 2017
Logstash always queue in multiple pipeline Elasticsearch elastic-stack-monitoring , elastic-stack-security , ingest-pipeline	3	259	September 4, 2023
Logstash persistent queue feature Logstash	3	1023	January 9, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Pipeline to pipeline distributor, how not to lose events

Related topics