Filebeat do not see file updates after a while

@ogauchard Thanks for reporting this. It seems like this could be also related to: ERR File reading error. Stopping harvester. Error: EOF

So in your case even though additional lines are added to application.log, filebeat tells you that the file didn't change, correct?

So far I assume the issue could be related to a race condition with fast file rotation, but in your case this does not seem to be the case.

Some question that could help to nail down the problem:

  • Are there any specific characters when it stops reading?
  • Is the rotate file deleted when the reading stops?
  • Are you using a shared drive under windows?
  • What is the total number of events sent to ES when the logging stops?
  • You see the above lines: Start next scan, ... multiple times? Means until you kill filebeat?