Logstash s3 input plugin failed to work with subdirectories


(raba) #1

Hi,
I'm observing an couple of difficulties, until trying to grab the data from s3, if they stored on that way:

trailbucketname/usw1/AWSLogs/361190373704/CloudTrail/us-west-1////361190373704_CloudTrail_us-west-1_*.json.gz

the question is: is the provided option from s3 input logstash plugin are enough to match the following path, or it's impossible currently to work suggested schema?

my config is:

input{
s3 {
access_key_id => "..."
bucket => "trailbucketname"
region => "us-west-1"
secret_access_key => "..."
prefix => "usw1///////*/"
}
}
output{
stdout {
codec => rubydebug
}

, and verbosity does not show any visible error:

[2018-01-26T15:52:52,048][INFO ][logstash.inputs.s3 ] Registering s3 input {:bucket=>"trailbucketname", :region=>"us-west-1"}


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.