Possible to change order of key fields with S3 Output plugin?

Elastic Stack Logstash
1

Hi,

According to https://www.elastic.co/guide/en/logstash/current/plugins-outputs-s3.html, the objects created have a key with uuid before the date field. This makes listing objects by date range far less efficient, for example if I want to use Spark to load just a date range subset.

Is there any way to change the order of the fields in the key prefix so that date is before the uuid?

I.e., I current have objects like this:
ls.s3.03210fdc-c108-4e7d-8e49-72b614366eab.2020-02-28T04.04.part28.txt

and I would like to have:
ls.s3.2020-02-28T04.04.03210fdc-c108-4e7d-8e49-72b614366eab.part28.txt

thanks in advance for any pointers.

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.