Oops. Is it compulsory? AFAIK, it seems that it is not required. Even, if not properly provded, wouldn't it only be a bit slower?
Sending Logstash logs to /home/my_user/.../tmp/logstash-6.6.1/logs which is now configured via log4j2.properties
[2019-03-04T17:10:48,896][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2019-03-04T17:10:48,911][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"6.6.1"}
[2019-03-04T17:11:08,558][INFO ][logstash.pipeline ] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>8, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50}
[2019-03-04T17:11:08,779][INFO ][logstash.outputs.rabbitmq] Connected to RabbitMQ at
[2019-03-04T17:11:08,891][INFO ][logstash.inputs.s3 ] Registering s3 input {:bucket=>"my_bucket", :region=>"eu-west-1"}
[2019-03-04T17:11:09,231][INFO ][logstash.pipeline ] Pipeline started successfully {:pipeline_id=>"main", :thread=>"#<Thread:0x73d24490 run>"}
[2019-03-04T17:11:09,275][INFO ][logstash.agent ] Pipelines running {:count=>1, :running_pipelines=>[:main], :non_running_pipelines=>[]}
[2019-03-04T17:11:09,538][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}
[2019-03-04T17:11:11,370][ERROR][logstash.inputs.s3 ] S3 input: Unable to list objects in bucket {:prefix=>nil, :message=>"The request signature we calculated does not match the signature you provided. Check your key and signing method."}
The error seems to be the same and it might be linked to the prefix => NIL message, which keeps being shown online after 60 seconds… Note that I am still not pushing new files to the S3 instance. I only want to get "old" files...