Is there a way to split the load on multiple logstash instances to grab data from S3?
I would like for logstash instance 1 to grab only files ending in 1 and 2
logstash instance 2 to grab files ending in 3 and 4
and so on.
S3 looks like:
is there a specific configuration option in logstash that allows for this?
or maybe a different plug-in? or solution?