We are using Logstash 7.4.2. Once in 3-4 days, Logstash stops processing events and its not parsing new events till we restart the service. We see only below error in log , :body=>"{"error":{"root_cause":[{"type":"action_request_validation_exception","reason":"Validation Failed: 1: id is missing;"}…

Logstash stops getting events once in 3 days

Badger June 7, 2021, 5:11pm 11

logstash has an at-least-once delivery model, so certain problems can cause it to hang forever. There is more discussion on this here and here. Changing that would require code changes.

Does Logstash Persistent Queue support Syslog Plugin

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.