Logstash S3 Input Error

Elastic Stack Logstash
1

Hi All,

I am getting this error while running logstash with S3 input plugin. Is there anything wrong with my config.

 include_object_properties=>false>
  Error: Net::OpenTimeout
  Exception: Seahorse::Client::NetworkingError
  Stack: uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/net/protocol.rb:41:in `ssl_socket_connect'
uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/net/http.rb:985:in `connect'
uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/net/http.rb:924:in `do_start'
uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/net/http.rb:919:in `start'
uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/delegate.rb:83:in `method_missing'
/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/aws-sdk-core-2.11.415/lib/seahorse/client/net_http/connection_pool.rb:285:in `start_                                  session'
/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/aws-sdk-core-2.11.415/lib/seahorse/client/net_http/connection_pool.rb:92:in `session                                  _for'
/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/aws-sdk-core-2.11.415/lib/seahorse/client/net_http/handler.rb:119:in `session'
/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/aws-sdk-core-2.11.415/lib/seahorse/client/net_http/handler.rb:71:in `transmit'
/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/aws-sdk-core-2.11.415/lib/seahorse/client/net_http/handler.rb:45:in `call'
/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/aws-sdk-core-2.11.415/lib/seahorse/client/plugins/content_length.rb:12:in `call'
/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/aws-sdk-core-2.11.415/lib/aws-sdk-core/plugins/s3_request_signer.rb:88:in `call'
/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/aws-sdk-core-2.11.415/lib/aws-sdk-core/plugins/s3_request_signer.rb:23:in `call'
/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/aws-sdk-core-2.11.415/lib/aws-sdk-core/plugins/s3_host_id.rb:14:in `call'
/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/aws-sdk-core-2.11.415/lib/aws-sdk-core/xml/error_handler.rb:8:in `call'
/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/aws-sdk-core-2.11.415/lib/aws-sdk-core/plugins/helpful_socket_errors.rb:10:in `call'
/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/aws-sdk-core-2.11.415/lib/aws-sdk-core/plugins/s3_request_signer.rb:65:in `call'


input {
    s3 {
      type => "cloudtrail"
      bucket => "xxxxxxxxxxxxxxxxxx"
      prefix => "Accounts/dev/AWSLogs/xxxxxxxxxxxxx/CloudTrail/us-west-2/2020/"
      proxy_uri => "http://example.com:8080"
      role_arn => "arn:aws:iam::xxxxxxxxxxx:role/s3readrole"
      codec => "cloudtrail"
      region => "us-west-2"
      exclude_pattern => "/CloudTrail-Digest/"
      sincedb_path => "/usr/share/logstash/data/plugins/inputs/s3/dev"
      additional_settings => {
        "ssl_verify_peer" => false
      }
    }
  }

filter {
    if [recipientAccountId] == "xxxxxxxxxxxx" {
     mutate {
         add_field => { "account" => "dev" }
    }
  }
}
2

Just an update that I am trying to register 90+ inputs. I tried reducing the input to 2 and it works fine. Is there a limitation or system requirement to register those many inputs?

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.