Logstash failing with "Encountered a retryable error."

Elastic Stack Logstash
1

Environment:

Logstash 5.6.3
Elastic 5.5

We have been seeeing lot of error messages in logstash logs lately. Not sure what the issue is. Please provide some pointers.

Dec  8 11:59:13 ls01 journal: 
{"level":"ERROR","loggerName":"logstash.outputs.elasticsearch","timeMillis":1512752353365,"thread":"
[main]>worker1","logEvent":{"message":"Encountered a retryable error. Will Retry with exponential 
backoff ","code":500,"url":"https://eshost:443/_bulk"}}#015

Logstash output:

output {
 stdout { codec => rubydebug }
 if [type] == "abc" {
 elasticsearch {
 hosts => [ https://eshost:443 ]
 index => "abc-%{+YYYY.ww}"
 document_type => "abc"
 }
 kafka {
 topic_id => "abc"
 codec => "json"
 compression_type => "lz4"
 bootstrap_servers => "<some-ip>:9092"
 }
 }
}
2

It appears Elasticsearch returned a 500 error (internal server error). Check the ES logs for clues.

1 Like
3

I ended up using this plugin https://github.com/awslabs/logstash-output-amazon_es in favor of https://github.com/logstash-plugins/logstash-output-elasticsearch and adjusted pipeline.batch.size to fit our needs. Works like a charm without a single error.

I believe this solution fits well for ES running in AWS.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.