I have logs stored on AWS s3. I am using s3-input-plugin in logstash as input to read that logs. Now, I want to setup another logstash with same logs. I want to read logs twice from s3 because of network-out charges in AWS. So, I want to something like, Filebeat reading logs from s3 and sending those logs to multiple logstash. Is it possible ? Is there any other clean solution ?
I am expecting workflow as follows:
AWS S3 --> FileBeat --> Multiple logstash
Any help would be greatly appreciated in helping me solve this.