1 What's go on?
Filebeat terrible slow to start harvest after I configure the inode clean.
2 My config are as follow:
</>
- type: log
enabled: true
paths:- /data/aaa/aaa/**
tags: ["aaa"]
fields:
public_ip: 14.116.220.177
agent:
name: guangzhou4_10.10.3.207
exclude_lines: ['^\n']
exclude_files: ['.lz4$']
ignore_older: 24h
clean_inactive: 100h
clean_removed: true
</>
3 Why so slow ?
1 I have 30000 file per day. In this configure, data/registry/filebeat/data.json file has nearly 100000 record;
2 Each time When i try to restart , Filebeat check each record in data/registry/filebeat/data.json file. What terrible isfilebeat check each record in sync into a new file ,.What the ......
- /data/aaa/aaa/**