Filebeat blocks when reading STDIN and output is unavailable

Elastic Stack Beats
1

Hi,

I am using filebeat to read from STDIN from the STDOUT of an application. However once the filebeat's buffer is full, it stops reading from the STDIN, which blocks the execution of the application. This happens if the configured output is unavailable, and filebeat is unable to flush the events further downstream.

Is there any way to configure so filebeat continues reading from STDIN, even if it means dropping events? The side effect of it stopping the application is much worst than the one for dropping log events.

I have tested this to be the case both with the in memory queue, and the file circular queue.

Any help would be very much appreciated.

Regards,
Renato

2

Filebeat uses infinite retry. This can not be disabled right now. Once internal queues are full, they block. If you need your application stop/quit in time you're better advised to write to a log file.

1 Like
3

Thank you, this was very helpful!

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.