Filebeat's stdin harvester_buffer_size leads to not processing messages

Elastic Stack Beats
1

I'd like to read from stdin to filebeat. It's in JSONL with json set on the stdin input.

When I send a single message of about 1600 bytes nothing gets processed, even if I ask the filebeat process to quit. I can get things processed if I send multiple messages, seemingly ~9 or 10 at a time get batched.

I worry that messages will sit in the harvester's buffer long-term if there's no further messages and that messages are lost during shutdowns.

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.