Is it possible to use HTTP input and S3 input plugin together in logstash

Elastic Stack Logstash
1

We are trying to make S3 input prefix as dynamic value.

s3 {
bucket => "bucketName"
aws_credentials_file => "/root/logstash-5.3.0/config/aws_credentials.yaml"
delete => false
interval => 60 # seconds
prefix => "AWSLogs//CloudTrail/" ### ---> Dynamic
type => "cloudtrail"
codec => "cloudtrail"
sincedb_path => "/tmp/sincedb"
region => "us-east-1"
}

We are planning to use HTTP input plugin to get S3 prefix from the user end and passing the same S3 prefix to S3 input plugin. Is it possible to do so?

2

You could reference an environment variable that you pass to the Logstash process or you can simply generate the configuration file.

3

If the environment variable changes its value then we need to restart logstash service

4

Yes, of course.

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.