# Encountered a retryable error. Will Retry with exponential backoff code=\>400

**URL:** <https://discuss.elastic.co/t/encountered-a-retryable-error-will-retry-with-exponential-backoff-code-400/197364>\
**Category:** Logstash\
**Created:** [August 29, 2019, 2:33pm UTC](https://discuss.elastic.co/t/encountered-a-retryable-error-will-retry-with-exponential-backoff-code-400/197364 "2019-08-29T14:33:49Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Thilak](https://avatars.discourse-cdn.com/v4/letter/t/4af34b/32.png) [@Thilak](https://discuss.elastic.co/u/Thilak)\
**Post date:** [August 29, 2019, 2:33pm UTC](https://discuss.elastic.co/t/encountered-a-retryable-error-will-retry-with-exponential-backoff-code-400/197364/1 "2019-08-29T14:33:49Z")

</div>

Hello  
I was using logstash 7.0.1 while running the below config file i was continuously getting retry-able error (400)

```auto
input {
 elasticsearch {
 hosts => ["https://ful-elastic.com:443/_bulk"]
 user => "username"
 password => "password"
 index => "testing"
 size => 100
 scroll => "1m"
 }
}

filter {

}
output {
 amazon_es {
 hosts => ["https://example.com:443"]
 region => "us-east-1"
 aws_access_key_id => "accessKeyId"
 aws_secret_access_key => "password"
 index => "testing"
 }
}

```

This is error we are getting continuously

[2019-08-29T19:55:49,399][ERROR][logstash.outputs.elasticsearch] Encountered a retryable error. Will Retry with exponential backoff {:code=\>400, :url=\>"[https://example.com:443/\_bulk](https://example.com:443/_bulk)"}  
[2019-08-29T19:55:49,620][ERROR][logstash.outputs.elasticsearch] Encountered a retryable error. Will Retry with exponential backoff {:code=\>400, :url=\>""[https://example.com:443/\_bulk](https://example.com:443/_bulk)"}  
[2019-08-29T19:55:52,818][ERROR][logstash.outputs.elasticsearch] Encountered a retryable error. Will Retry with exponential backoff {:code=\>400, :url=\>""[https://example.com:443/\_bulk](https://example.com:443/_bulk)"}

Can't able to find the reason why it is happening continuously?

---

<div class="post-metadata">

**Author:** ![rugenl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rugenl/32/12887_2.png) [@rugenl](https://discuss.elastic.co/u/rugenl)\
**Post date:** [August 29, 2019, 3:09pm UTC](https://discuss.elastic.co/t/encountered-a-retryable-error-will-retry-with-exponential-backoff-code-400/197364/2 "2019-08-29T15:09:41Z")

</div>

Does the "testing" index exist in aws? I've seen similar errors when the index didn't exist and it couldn't be automatically created for some reason.

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [August 29, 2019, 4:13pm UTC](https://discuss.elastic.co/t/encountered-a-retryable-error-will-retry-with-exponential-backoff-code-400/197364/3 "2019-08-29T16:13:37Z")

</div>

Is there a more informative error in the elasticsearch logs?

---

<div class="post-metadata">

**Author:** ![Thilak](https://avatars.discourse-cdn.com/v4/letter/t/4af34b/32.png) [@Thilak](https://discuss.elastic.co/u/Thilak)\
**Post date:** [August 30, 2019, 4:28am UTC](https://discuss.elastic.co/t/encountered-a-retryable-error-will-retry-with-exponential-backoff-code-400/197364/4 "2019-08-30T04:28:37Z")

</div>

> [@rugenl](#):
>
> Does the "testing" index exist in aws? I've seen similar errors when the index didn't exist and it couldn't be automatically created for some reason.

Yeah even after creating the testing index in aws-es with the same mapping type throwing same retryable error - 400

---

<div class="post-metadata">

**Author:** ![Thilak](https://avatars.discourse-cdn.com/v4/letter/t/4af34b/32.png) [@Thilak](https://discuss.elastic.co/u/Thilak)\
**Post date:** [August 30, 2019, 4:39am UTC](https://discuss.elastic.co/t/encountered-a-retryable-error-will-retry-with-exponential-backoff-code-400/197364/5 "2019-08-30T04:39:21Z")

</div>

Hey this is entire logs we got in our end  
Sending Logstash logs to /Users/thilak/Desktop/logstash-7.0.1/logs which is now configured via log4j2.properties

[2019-08-30T09:55:24,262][WARN][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified

[2019-08-30T09:55:24,306][INFO][logstash.runner] Starting Logstash {"logstash.version"=\>"7.0.1"}

/Users/thilak/Desktop/logstash-7.0.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-amazon\_es-6.4.2-java/lib/logstash/outputs/amazon\_es/http\_client/pool.rb:33: warning: already initialized constant ROOT\_URI\_PATH

/Users/thilak/Desktop/logstash-7.0.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-amazon\_es-6.4.2-java/lib/logstash/outputs/amazon\_es/http\_client/pool.rb:36: warning: already initialized constant DEFAULT\_OPTIONS

/Users/thilak/Desktop/logstash-7.0.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-amazon\_es-6.4.2-java/lib/logstash/outputs/amazon\_es/http\_client/pool.rb:160: warning: already initialized constant ES1\_SNIFF\_RE\_URL

/Users/thilak/Desktop/logstash-7.0.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-amazon\_es-6.4.2-java/lib/logstash/outputs/amazon\_es/http\_client/manticore\_adapter.rb:7: warning: already initialized constant DEFAULT\_HEADERS

/Users/thilak/Desktop/logstash-7.0.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-amazon\_es-6.4.2-java/lib/logstash/outputs/amazon\_es/http\_client.rb:24: warning: already initialized constant TARGET\_BULK\_BYTES

/Users/thilak/Desktop/logstash-7.0.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-amazon\_es-6.4.2-java/lib/logstash/outputs/amazon\_es/common.rb:8: warning: already initialized constant DOC\_DLQ\_CODES

/Users/thilak/Desktop/logstash-7.0.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-amazon\_es-6.4.2-java/lib/logstash/outputs/amazon\_es/common.rb:9: warning: already initialized constant DOC\_SUCCESS\_CODES

/Users/thilak/Desktop/logstash-7.0.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-amazon\_es-6.4.2-java/lib/logstash/outputs/amazon\_es/common.rb:10: warning: already initialized constant DOC\_CONFLICT\_CODE

/Users/thilak/Desktop/logstash-7.0.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-amazon\_es-6.4.2-java/lib/logstash/outputs/amazon\_es/common.rb:16: warning: already initialized constant VERSION\_TYPES\_PERMITTING\_CONFLICT

/Users/thilak/Desktop/logstash-7.0.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-amazon\_es-6.4.2-java/lib/logstash/outputs/amazon\_es/common.rb:133: warning: already initialized constant VALID\_HTTP\_ACTIONS

/Users/thilak/Desktop/logstash-7.0.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-amazon\_es-6.4.2-java/lib/logstash/outputs/amazon\_es/common.rb:247: warning: already initialized constant DEFAULT\_EVENT\_TYPE\_ES6

/Users/thilak/Desktop/logstash-7.0.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-amazon\_es-6.4.2-java/lib/logstash/outputs/amazon\_es/common.rb:248: warning: already initialized constant DEFAULT\_EVENT\_TYPE\_ES7

url template  
{:scheme=\>"https", :user=\>nil, :password=\>nil, :host=\>"URLTEMPLATE", :port=\>443, :path=\>nil}

[2019-08-30T09:55:40,246][INFO][logstash.outputs.elasticsearch] Elasticsearch pool URLs updated {:changes=\>{:removed=\>, :added=\>[[https://example.com:443/\_bulk](https://example.com/_bulk)]}}

[2019-08-30T09:55:40,265][INFO][logstash.outputs.elasticsearch] Running health check to see if an Elasticsearch connection is working {:healthcheck\_url=\>[https://search-full-es-test-ow3zdiqyfv2dxu75hxwczayzxi.us-east-1.es.amazonaws.com:443/](https://search-full-es-test-ow3zdiqyfv2dxu75hxwczayzxi.us-east-1.es.amazonaws.com:443/), :path=\>"/"}

[2019-08-30T09:55:42,813][WARN][logstash.outputs.elasticsearch] Restored connection to ES instance {:url=\>"[https://example.com:443/\_bulk](https://example.com/_bulk)/"}

[2019-08-30T09:55:43,196][INFO][logstash.outputs.elasticsearch] ES Output version determined {:es\_version=\>6}

[2019-08-30T09:55:43,201][WARN][logstash.outputs.elasticsearch] Detected a 6.x and above cluster: the `type` event field won't be used to determine the document \_type {:es\_version=\>6}

[2019-08-30T09:55:43,237][INFO][logstash.outputs.elasticsearch] New Elasticsearch output {:class=\>"LogStash::Outputs::ElasticSearch", :hosts=\>["[https://example.com:443/\_bulk](https://example.com/_bulk)]"]}

[2019-08-30T09:55:43,263][INFO][logstash.outputs.elasticsearch] Using mapping template from {:path=\>nil}

[2019-08-30T09:55:43,280][INFO][logstash.javapipeline] Starting pipeline {:pipeline\_id=\>"main", "pipeline.workers"=\>4, "pipeline.batch.size"=\>125, "pipeline.batch.delay"=\>50, "pipeline.max\_inflight"=\>500, :thread=\>"#\<Thread:0x1bef95e0 run\>"}

[2019-08-30T09:55:43,293][INFO][logstash.outputs.elasticsearch] Attempting to install template {:manage\_template=\>{"template"=\>"logstash-_", "version"=\>60001, "settings"=\>{"index.refresh\_interval"=\>"5s"}, "mappings"=\>{"default"=\>{"dynamic\_templates"=\>[{"message\_field"=\>{"path\_match"=\>"message", "match\_mapping\_type"=\>"string", "mapping"=\>{"type"=\>"text", "norms"=\>false}}}, {"string\_fields"=\>{"match"=\>"_", "match\_mapping\_type"=\>"string", "mapping"=\>{"type"=\>"text", "norms"=\>false, "fields"=\>{"keyword"=\>{"type"=\>"keyword", "ignore\_above"=\>256}}}}}], "properties"=\>{"@timestamp"=\>{"type"=\>"date"}, "@version"=\>{"type"=\>"keyword"}, "geoip"=\>{"dynamic"=\>true, "properties"=\>{"ip"=\>{"type"=\>"ip"}, "location"=\>{"type"=\>"geo\_point"}, "latitude"=\>{"type"=\>"half\_float"}, "longitude"=\>{"type"=\>"half\_float"}}}}}}}}

[2019-08-30T09:55:44,137][INFO][logstash.javapipeline] Pipeline started {"pipeline.id"=\>"main"}

[2019-08-30T09:55:44,233][INFO][logstash.agent] Pipelines running {:count=\>1, :running\_pipelines=\>[:main], :non\_running\_pipelines=\>}

[2019-08-30T09:55:44,845][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=\>9600}

[2019-08-30T09:55:48,895][ERROR][logstash.outputs.elasticsearch] Encountered a retryable error. Will Retry with exponential backoff {:code=\>400, :url=\>"[https://example.com:443/\_bulk](https://example.com/_bulk)"}  
[2019-08-30T09:55:48,895][ERROR][logstash.outputs.elasticsearch] Encountered a retryable error. Will Retry with exponential backoff {:code=\>400, :url=\>"[https://example.com:443/\_bulk](https://example.com/_bulk)"}  
[2019-08-30T09:55:48,895][ERROR][logstash.outputs.elasticsearch] Encountered a retryable error. Will Retry with exponential backoff {:code=\>400, :url=\>"[https://example.com:443/\_bulk](https://example.com/_bulk)"}  
[2019-08-30T09:55:48,895][ERROR][logstash.outputs.elasticsearch] Encountered a retryable error. Will Retry with exponential backoff {:code=\>400, :url=\>"[https://example.com:443/\_bulk](https://example.com/_bulk)"}  
[2019-08-30T09:55:48,895][ERROR][logstash.outputs.elasticsearch] Encountered a retryable error. Will Retry with exponential backoff {:code=\>400, :url=\>"[https://example.com:443/\_bulk](https://example.com/_bulk)"}

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 27, 2019, 6:18am UTC](https://discuss.elastic.co/t/encountered-a-retryable-error-will-retry-with-exponential-backoff-code-400/197364/7 "2019-09-27T06:18:32Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
