S3 Output Plugin tag in Filename

Elastic Stack Logstash
1

The filenames uploaded to S3 are auto generated by logstash, but there seems to be a way to add a "tag" to the file name. What is the proper syntaxt to preform this function?

The docs mention this as a possibility, but don't define how it should be accomplished.

I have a tag set up on my input plugin.

tags => ["hello_world"]

I was expecting to see the filenames uploaded to s3 to be something like:
ls.s3.312bc026-2f5d-49bc-ae9f-5940cf4ad9a6.2013-04-18T10.00.hello_world.part0.txt

but getting:
ls.s3.312bc026-2f5d-49bc-ae9f-5940cf4ad9a6.2013-04-18T10.00.part0.txt

I looked at the rubydbug output of my events and see the tag hello_world being applied to my events.

 "tags" => [
        [0] "hello_world"
    ]
2

If you add a "tags" option to an input (or filter) plugin then it adds a [tags] field which is an array of strings. If you add a "tags" option to an s3 output plugin then it appends the tags to the file name.

The tags option needs to be on the output, not the input.

1 Like
3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.