# Logstash failing with "Encountered a retryable error."

**URL:** <https://discuss.elastic.co/t/logstash-failing-with-encountered-a-retryable-error/110879>\
**Category:** Logstash\
**Created:** [December 8, 2017, 5:06pm UTC](https://discuss.elastic.co/t/logstash-failing-with-encountered-a-retryable-error/110879 "2017-12-08T17:06:43Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![gudladona](https://avatars.discourse-cdn.com/v4/letter/g/8491ac/32.png) [@gudladona](https://discuss.elastic.co/u/gudladona)\
**Post date:** [December 8, 2017, 5:06pm UTC](https://discuss.elastic.co/t/logstash-failing-with-encountered-a-retryable-error/110879/1 "2017-12-08T17:06:43Z")

</div>

Environment:

Logstash `5.6.3`  
Elastic `5.5`

We have been seeeing lot of error messages in logstash logs lately. Not sure what the issue is. Please provide some pointers.

```
Dec 8 11:59:13 ls01 journal: 
{"level":"ERROR","loggerName":"logstash.outputs.elasticsearch","timeMillis":1512752353365,"thread":"
[main]>worker1","logEvent":{"message":"Encountered a retryable error. Will Retry with exponential 
backoff ","code":500,"url":"https://eshost:443/_bulk"}}#015

```

Logstash output:

```auto
output {
 stdout { codec => rubydebug }
 if [type] == "abc" {
 elasticsearch {
 hosts => [https://eshost:443]
 index => "abc-%{+YYYY.ww}"
 document_type => "abc"
 }
 kafka {
 topic_id => "abc"
 codec => "json"
 compression_type => "lz4"
 bootstrap_servers => "<some-ip>:9092"
 }
 }
}

```

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [December 11, 2017, 7:15am UTC](https://discuss.elastic.co/t/logstash-failing-with-encountered-a-retryable-error/110879/2 "2017-12-11T07:15:30Z")

</div>

It appears Elasticsearch returned a 500 error (internal server error). Check the ES logs for clues.

---

<div class="post-metadata">

**Author:** ![gudladona](https://avatars.discourse-cdn.com/v4/letter/g/8491ac/32.png) [@gudladona](https://discuss.elastic.co/u/gudladona)\
**Post date:** [December 13, 2017, 4:39pm UTC](https://discuss.elastic.co/t/logstash-failing-with-encountered-a-retryable-error/110879/3 "2017-12-13T16:39:15Z")

</div>

I ended up using this plugin [https://github.com/awslabs/logstash-output-amazon\_es](https://github.com/awslabs/logstash-output-amazon_es) in favor of [https://github.com/logstash-plugins/logstash-output-elasticsearch](https://github.com/logstash-plugins/logstash-output-elasticsearch) and adjusted `pipeline.batch.size` to fit our needs. Works like a charm without a single error.

I believe this solution fits well for ES running in AWS.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [January 10, 2018, 4:39pm UTC](https://discuss.elastic.co/t/logstash-failing-with-encountered-a-retryable-error/110879/4 "2018-01-10T16:39:18Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.