I am using input as log and output as kafka in filebeat.yml
Is the part that is not published in the inflog taken every 30 seconds a delay?
If the delay is correct, can you tell how much delay is there?
2022-03-02T17:30:14.908+0900 INFO [monitoring] log/log.go:124 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":881300,"time":{"ms":11}},"total":{"ticks":2062840,"time":{"ms":16},"value":2062840},"user":{"ticks":1181540,"time":{"ms":5}}},"info":{"ephemeral_id":"f1g8e7gg-g08g-42g1-a8ga-200866gg510g","uptime":{"ms":4851750021}},"memstats":{"gc_next":9482064,"memory_alloc":6413616,"memory_total":78147157472}},"filebeat":{"events":{"active":4,"added":4},"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"output":{"events":{"active":2,"batches":2,"total":2}},"outputs":{"kafka":{"bytes_write":618}},"pipeline":{"clients":1,"events":{"active":2,"filtered":2,"published":2,"total":4}}},"registrar":{"states":{"current":1}},"system":{"load":{"1":0.19,"15":1.16,"5":0.5,"norm":{"1":0.0119,"15":0.0725,"5":0.0313}}}}}}