This seems to be a common issue but I would just like some input, we have an issue where filebeats is not removing openFiles
filebeat 54442 root 8r REG 253,2 104857631 51401225 /var/log/grouper/grouper.api/grouper_error.log.2 (deleted)
filebeat 54442 root 9r REG 253,2 104857930 51401222 /var/log/grouper/grouper.api/grouper_error.log.2 (deleted)
filebeat 54442 root 10r REG 253,2 104857642 51401217 /var/log/grouper/grouper.api/grouper_error.log.2 (deleted)
filebeat 54442 root 11r REG 253,2 104857771 51401219 /var/log/grouper/grouper.api/grouper_error.log.2 (deleted)
a total of 94 files 9.4gig of removed/rotated files
Config for Version: filebeat-6.7.2-1.x86_64
Paths that should be crawled and fetched. Glob based paths.
paths:
- /var/log/grouper/grouper.api/*.log
type: log
multiline.pattern: '^(2[0-9][0-9][0-9]-[0-9][0-9]-[0-9][0-9])'
multiline.negate: true
multiline.match: after
tags: ["Grouper-api"]
Number of workers per Logstash host.
worker: 1
bulk_max_size: 2048
#test
close_inactive: 1m
close_renamed: true
close_removed: true
ignore_older: 2m
close_timeout: 2m