How to monitor that logstash has stopped listening on tcp listener?

Elastic Stack Logstash
1

Logstash 5.6.4, on CentOS

We are exploring the logstash monitoring system.

Specifically, we see logstash run fine for awhile, but then stop listening on TCP, and the logstash log (/var/log/logstash/logstash-plain.log) fills with:

[2017-11-17T00:05:44,321][ERROR][logstash.outputs.elasticsearch] Encountered a retryable error. Will Retry with exponential backoff {:code=>400, :url=>"http://<IP of ES server>:9200/_bulk"}

So far, we do not see any monitor tags that will tell us that errors are occurring, or that the tcp listener is hung.

We looked at a number of monitor stats, when the system was hung (output is here: https://pastebin.com/Aysn229G ), and have not spotted a monitor that would alert us to the problem.

What are we missing?

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.