Hello there,
I started a new s3 input plugin on logstash and noticed the following error in the logstash.log:
==========================
[2018-08-09T19:46:26,790][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}
[2018-08-09T19:46:43,822][ERROR][logstash.pipeline ] A plugin had an unrecoverable error. Will restart this plugin.
Pipeline_id:main
Plugin: <LogStash::Inputs::S3 access_key_id=>"123", secret_access_key=>, region=>"us-east-1", bucket=>"vvv-apaas-hls-cloudtrail", prefix=>"AWSLogs/xxxxxx/
CloudTrail/us-east-1/2018/08/09/", codec=><LogStash::Codecs::Plain id=>"plain_3a15bda5-6772-42d8-9eb4-fd901473fde3", enable_metric=>true, charset=>"UTF-8">, id=>"4cc2a77b3e48f7127152c9ea7aa
03b87e7210885d5bb361307e6dbbd592d8b3f", enable_metric=>true, role_session_name=>"logstash", delete=>false, interval=>60, temporary_directory=>"/tmp/logstash">
Error: Failed to open TCP connection to xxxx-cloudtrail.s3.amazonaws.com:443 (initialize: name or service not known)
Exception: Seahorse::Client::NetworkingError
Stack: org/jruby/ext/socket/RubyTCPSocket.java:137:in initialize' org/jruby/RubyIO.java:1154:inopen'
uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/net/http.rb:885:in block in connect' org/jruby/ext/timeout/Timeout.java:149:intimeout'
uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/net/http.rb:883:in connect' uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/net/http.rb:868:indo_start'
uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/net/http.rb:863:in start' uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/delegate.rb:83:inmethod_missing'
No data from s3 was been pulled to elasticsearch...
Here is the configuration:
==========================
input {
s3 {
access_key_id => "1234"
secret_access_key => "5678"
region => "us-east-1"
bucket => "my-cloudtrail"
prefix => "AWSLogs/CloudTrail/"
codec => "plain"
}
}
The filter part of this file is commented out to indicate that it
is optional.
filter {
}
output {
elasticsearch {
action => "index"
hosts => ["xx.xx.xx.xx"]
}
s3 {
access_key_id => "1234"
secret_access_key => "5678"
region => "us-east-1"
bucket => "my-backup-bucket"
}
}
Please help and let me know what went wrong
Thank you very much