Filebeat log.json file

Elastic Stack Beats
1

My application team tried an experiment for filebeat,

They deleted the log file that filebeat was harvesting and each time the log file is deleted, in the directory, a file in the path /data/registry/filebeat/log.json keeps growing in size

Would this be a concern if this log.json keeps growing? How does this log.json work?

2

Have a read of How Filebeat works | Filebeat Reference [7.12] | Elastic and let us know if you have further questions about the registry.

3

this registry/filebeat/log.json is the registry file mentioned in the post? We came across this post but wasn't sure if this is the file it was mentioning

4

Hi, we tried the clean_removed: true option which it was already supposed to be default to true and it doesnt clear the log.json file, we opened up the log.json and saw old logs dated back to 30/4

5

Is it causing an issue?

What version are you using?

6

hi yes, we are afraid to go into production as we are unsure if this file will keep growing and are not able to clear this file properly, we are using filebeat 7.8.1

7

to be exact

filebeat is logging a file:
applicationlog.log

and everyday, we will rename the log to:
applicationlog-dd-mm-yyyy.log

and the application will then recreate the file:
applicationlog.log

We monitor the log.json file which increases everyday which could cause out of space issues, hence keeping us from going live.

We tried methods such as clean_removed etc which doesn't clear the log.json file

8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.