Execution order multiple S3 input plugins

Elastic Stack Logstash
1

Hi everyone,

A question about the execution order of logstash with multiple S3 input plugins ( points to different buckets ).

In such a scenario what is the expected behavior? Will logstash wait until each bucket is finished or will it pull data in a a-synchronized? From all of the buckets at the same time?

The use case I have is multiple bucket with different log types requiring different processing, some of the buckets are relatively small but others contains millions of log files so I'm trying to aboiua scenario where logstash is pulling from a single bucket until it moves to the others.

Thanks!

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.