# Logstash Error : S3 input plugins

**URL:** <https://discuss.elastic.co/t/logstash-error-s3-input-plugins/313432>\
**Category:** Logstash\
**Created:** [September 1, 2022, 10:48am UTC](https://discuss.elastic.co/t/logstash-error-s3-input-plugins/313432 "2022-09-01T10:48:40Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![priyankamondalhcl](https://avatars.discourse-cdn.com/v4/letter/p/57b2e6/32.png) [@priyankamondalhcl](https://discuss.elastic.co/u/priyankamondalhcl)\
**Post date:** [September 1, 2022, 10:48am UTC](https://discuss.elastic.co/t/logstash-error-s3-input-plugins/313432/1 "2022-09-01T10:48:40Z")

</div>

Hi Team,

I am using us3 input plugins which was connecting with S3 bucket and provided data to elasticsearch. but suddenly, It stopped working.  
My configuration  
input {  
s3 {  
"access\_key\_id" =\> ""  
"secret\_access\_key" =\> ""  
"bucket" =\> "billing"  
"prefix" =\> "billing\_2020/billing/"  
"exclude\_pattern" =\> "/20220801-20220901|.json$"  
"region" =\> "us-east-1"  
"include\_object\_properties" =\> true  
"watch\_for\_new\_files" =\> true  
"temporary\_directory" =\> "/etc/logstash/conf.d/aws-logstash-file"  
"sincedb\_path" =\> "/etc/logstash/conf.d/aws-logstash-file/sincedb\_path"  
"additional\_settings" =\> {  
"force\_path\_style" =\> true  
"follow\_redirects" =\> false  
}

```
        }
      }

```

And the error

[2022-09-01T15:35:41,953][ERROR][logstash.javapipeline][finops-aws-s3-july][12a27325e7715261030dbe19d3632a4f2de876ed83169d72f364e8b41da58c2f] A plugin had an unrecoverable error. Will restart this plugin.  
Pipeline\_id:finops-aws-s3-july  
Plugin: \<LogStash::Inputs::S3 access\_key\_id=\>"", bucket=\>"billing", include\_object\_properties=\>true, additional\_settings=\>{"force\_path\_style"=\>"true", "follow\_redirects"=\>"false"}, prefix=\>"billing\_2020/billing/", temporary\_directory=\>"/etc/logstash/conf.d/aws-logstash-file", secret\_access\_key=\>, exclude\_pattern=\>"\/20220801-20220901|\.json$", id=\>"12a27325e7715261030dbe19d3632a4f2de876ed83169d72f364e8b41da58c2f", region=\>"us-east-1", sincedb\_path=\>"/etc/logstash/conf.d/aws-logstash-file/sincedb\_path", watch\_for\_new\_files=\>true, enable\_metric=\>true, codec=\>\<LogStash::Codecs::Plain id=\>"plain\_ba215017-5566-4a74-83d6-bbe63cd9e10e", enable\_metric=\>true, charset=\>"UTF-8"\>, role\_session\_name=\>"logstash", delete=\>false, interval=\>60, gzip\_pattern=\>".gz(ip)?$"\>  
Error: Connection reset  
Exception: Seahorse::Client::NetworkingError  
Stack: /usr/share/logstash/vendor/jruby/lib/ruby/stdlib/net/http.rb:1018:in `connect' /usr/share/logstash/vendor/jruby/lib/ruby/stdlib/net/http.rb:934:in `do\_start'  
/usr/share/logstash/vendor/jruby/lib/ruby/stdlib/net/http.rb:929:in `start' /usr/share/logstash/vendor/jruby/lib/ruby/stdlib/delegate.rb:83:in `method\_missing'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/seahorse/client/net\_http/connection\_pool.rb:307:in `start_session' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/seahorse/client/net_http/connection_pool.rb:100:in `session\_for'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/seahorse/client/net\_http/handler.rb:128:in `session' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/seahorse/client/net_http/handler.rb:76:in `transmit'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/seahorse/client/net\_http/handler.rb:50:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/seahorse/client/plugins/content_length.rb:24:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/seahorse/client/plugins/request\_callback.rb:85:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/plugins/s3_signer.rb:132:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/plugins/s3\_signer.rb:63:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/plugins/s3_host_id.rb:17:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/xml/error\_handler.rb:10:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/transfer_encoding.rb:26:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/helpful\_socket\_errors.rb:12:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/plugins/s3_signer.rb:110:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/retry\_errors.rb:360:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/retry_errors.rb:394:in `retry\_request'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/retry\_errors.rb:382:in `retry_if_possible' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/retry_errors.rb:371:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/retry\_errors.rb:394:in `retry_request' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/retry_errors.rb:382:in `retry\_if\_possible'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/retry\_errors.rb:371:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/retry_errors.rb:394:in `retry\_request'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/retry\_errors.rb:382:in `retry_if_possible' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/retry_errors.rb:371:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/http\_checksum.rb:19:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/endpoint_pattern.rb:30:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/plugins/accelerate.rb:67:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/checksum_algorithm.rb:136:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/plugins/dualstack.rb:41:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/plugins/iad_regional_endpoint.rb:39:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/plugins/expect\_100\_continue.rb:22:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/plugins/bucket_name_restrictions.rb:26:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/plugins/arn.rb:62:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/rest/handler.rb:10:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/recursion\_detection.rb:18:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/user_agent.rb:13:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/endpoint\_discovery.rb:80:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/seahorse/client/plugins/endpoint.rb:47:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/param\_validator.rb:26:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/plugins/arn.rb:88:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/seahorse/client/plugins/raise\_response\_errors.rb:16:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/plugins/sse_cpk.rb:24:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/plugins/dualstack.rb:27:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/plugins/accelerate.rb:56:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/checksum\_algorithm.rb:111:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/jsonvalue_converter.rb:16:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/idempotency\_token.rb:19:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/param_converter.rb:26:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/seahorse/client/plugins/request\_callback.rb:71:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/plugins/response_paging.rb:12:in `call'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/seahorse/client/plugins/response\_target.rb:24:in `call' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/seahorse/client/request.rb:72:in `send\_request'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/client.rb:8556:in `list_objects_v2' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-s3-1.114.0/lib/aws-sdk-s3/bucket.rb:912:in `block in objects'  
org/jruby/RubyGenerator.java:99:in `each' org/jruby/RubyEnumerator.java:392:in `each'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/resources/collection.rb:101:in `block in non_empty_batches' org/jruby/RubyGenerator.java:99:in `each'  
org/jruby/RubyEnumerator.java:392:in `each' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/resources/collection.rb:52:in `block in each'  
org/jruby/RubyGenerator.java:99:in `each' org/jruby/RubyEnumerator.java:392:in `each'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/aws-sdk-core-3.131.6/lib/aws-sdk-core/resources/collection.rb:58:in `each' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/logstash-integration-aws-7.0.0/lib/logstash/inputs/s3.rb:141:in `list\_new\_files'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/logstash-integration-aws-7.0.0/lib/logstash/inputs/s3.rb:183:in `process_files' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/logstash-integration-aws-7.0.0/lib/logstash/inputs/s3.rb:130:in `block in run'  
/usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/stud-0.0.23/lib/stud/interval.rb:20:in `interval' /usr/share/logstash/vendor/bundle/jruby/2.6.0/gems/logstash-integration-aws-7.0.0/lib/logstash/inputs/s3.rb:129:in `run'  
/usr/share/logstash/logstash-core/lib/logstash/java\_pipeline.rb:410:in `inputworker' /usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:401:in `block in start\_input'

Please help me why suddenly it stopped working. But same credential/config is working on another server for different bucket

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 29, 2022, 10:49am UTC](https://discuss.elastic.co/t/logstash-error-s3-input-plugins/313432/2 "2022-09-29T10:49:13Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
