Is it possible to use HTTP input and S3 input plugin together in logstash

(Vinish Soman) #1

We are trying to make S3 input prefix as dynamic value.

s3 {
bucket => "bucketName"
aws_credentials_file => "/root/logstash-5.3.0/config/aws_credentials.yaml"
delete => false
interval => 60 # seconds
prefix => "AWSLogs//CloudTrail/" ### ---> Dynamic
type => "cloudtrail"
codec => "cloudtrail"
sincedb_path => "/tmp/sincedb"
region => "us-east-1"

We are planning to use HTTP input plugin to get S3 prefix from the user end and passing the same S3 prefix to S3 input plugin. Is it possible to do so?

(Magnus Bäck) #2

You could reference an environment variable that you pass to the Logstash process or you can simply generate the configuration file.

(Vinish Soman) #3

If the environment variable changes its value then we need to restart logstash service

(Magnus Bäck) #4

Yes, of course.

(system) #5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.