Filebeat registry (inode) clean case restart slow

Elastic Stack Beats
1

1 What's go on?
Filebeat terrible slow to start harvest after I configure the inode clean.
2 My config are as follow:
</>

  • type: log
    enabled: true
    paths:
    • /data/aaa/aaa/**
      tags: ["aaa"]
      fields:
      public_ip: 14.116.220.177
      agent:
      name: guangzhou4_10.10.3.207
      exclude_lines: ['^\n']
      exclude_files: ['.lz4$']
      ignore_older: 24h
      clean_inactive: 100h
      clean_removed: true
      </>
      3 Why so slow ?
      1 I have 30000 file per day. In this configure, data/registry/filebeat/data.json file has nearly 100000 record;
      2 Each time When i try to restart , Filebeat check each record in data/registry/filebeat/data.json file. What terrible is :blush: filebeat check each record in sync into a new file ,.What the ......
1 Like
2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.