Logstash s3 input plugin: not indexing files under individual folder of bucket using prefix option

Elastic Stack Logstash
1

s3 bucket : elk
folders: syslog, errorlog etc..
filepattern: syslog-

input {
s3 {
access_key_id => ""
secret_access_key => ""
bucket => "elk"
region => "eu-central-1"
prefix => "syslog/syslog-"
additional_settings => {
force_path_style => true
follow_redirects => false
}
}
}

output {
elasticsearch {
hosts => ["http://localhost:9200"]
index => "apache2log-%{+YYYY.MM.dd}"
user => ""
password => ""
}
}

index is happening with all the files under different folders, need to process only files under particular folder
I tried the prefix option with the below formats, but not indexing as expected.

  1. syslog
  2. syslog/
  3. syslog/syslog-
2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.