Filebeat not sending all the logs

  • In quite a strange behavior, Filebeat periodically stops sending logs to ES. We have an arrangement where we have installed Filebeat to tail NGINX logs and it straight to ES (not via Logstash). Here's a graph showing 4 hours of log submissions.

  • The valley in the graph represents a period where filebeat's log submission activity is very low. It's not because less logs are being written, but rather because filebeat isn't able to tail properly. We have to restart filebeat service on individual nodes to restore the proper behavior.

  • Any suggestion would be helpful. We're currently unable to identify any symptom which might be causing this failure.

Can you share the filebeat log, filebeat config and the filebeat version?

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.