Filebeat registry (inode) clean case restart slow

1 What's go on?
Filebeat terrible slow to start harvest after I configure the inode clean.
2 My config are as follow:

  • type: log
    enabled: true
    • /data/aaa/aaa/**
      tags: ["aaa"]
      name: guangzhou4_10.10.3.207
      exclude_lines: ['^\n']
      exclude_files: ['.lz4$']
      ignore_older: 24h
      clean_inactive: 100h
      clean_removed: true
      3 Why so slow ?
      1 I have 30000 file per day. In this configure, data/registry/filebeat/data.json file has nearly 100000 record;
      2 Each time When i try to restart , Filebeat check each record in data/registry/filebeat/data.json file. What terrible is :blush: filebeat check each record in sync into a new file ,.What the ......
1 Like

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.