iIhave problems Fleet daemonset collect kubernetes container logs

hello i have some problems operating elastic-agent with fleet

i did the settings elastic-agent usging kubernetes daemonset and kubernetes integration in fleet

and that setting works normally without problems

but suddenly resouce(cpu, memory)use increas and kebernetes work node problems due to resource load
when this time look FD for elastic-agent i find this 2000 count FD

lr-x------ 1 root root 64 Jun  5 10:18 220 -> /var/log/containers
lr-x------ 1 root root 64 Jun  3 07:57 221 -> /var/log/containers
lr-x------ 1 root root 64 Jun  3 07:57 222 -> /var/log/containers
lr-x------ 1 root root 64 Jun  3 07:57 223 -> /var/log/containers
lr-x------ 1 root root 64 Jun  5 09:11 224 -> /var/log/containers
lr-x------ 1 root root 64 Jun  5 09:11 225 -> /var/log/containers
lr-x------ 1 root root 64 Jun  3 12:52 226 -> /var/log/containers
lr-x------ 1 root root 64 Jun  5 10:17 227 -> /var/log/containers
lr-x------ 1 root root 64 Jun  3 12:52 228 -> /var/log/containers
lr-x------ 1 root root 64 Jun  4 07:56 229 -> /var/log/containers

and i can see Elastic-agent log as blow

elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:23.560
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:23.560
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:23.560
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:23.560
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:23.560
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:23.560
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:23.560
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:24.562
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:24.562
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:24.562
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:24.562
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:24.563
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:24.563
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:24.563
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:24.563
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:24.563
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:24.564
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' stopped (goroutine)
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Reader was closed. Closing.
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Reader was closed. Closing.
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Reader was closed. Closing.
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Reader was closed. Closing.
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' stopped (runner)
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Reader was closed. Closing.
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' stopped (goroutine)
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' stopped (goroutine)
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' stopped (goroutine)
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' stopped (goroutine)
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' stopped (runner)
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' stopped (goroutine)
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' stopped (runner)
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' stopped (runner)
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' stopped (runner)
10:55:24.714
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' stopped (runner)
10:55:24.737
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' starting
10:55:24.752
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' starting
10:55:24.780
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' starting
10:55:24.802
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' starting
10:55:24.818
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' starting
10:55:24.877
elastic_agent.filebeat
[elastic_agent.filebeat][info] Applying settings for output
10:55:24.877
elastic_agent.filebeat
[elastic_agent.filebeat][info] Input 'filestream' starting
10:55:24.878
elastic_agent.filebeat
[elastic_agent.filebeat][info] elasticsearch url: https://hotnode01:9200
10:55:24.878
elastic_agent.filebeat
[elastic_agent.filebeat][info] Applying settings for filebeat.modules
10:55:25.364
elastic_agent
[elastic_agent][info] Source URI changed from "https://artifacts.elastic.co/downloads/" to "https://artifacts.elastic.co/downloads/"
10:55:25.475
elastic_agent
[elastic_agent][info] New State ID is k1Cbe68Z
10:55:25.475
elastic_agent
[elastic_agent][info] Converging state requires execution of 3 step(s)
10:55:25.563
elastic_agent.filebeat
[elastic_agent.filebeat][info] Connecting to backoff(elasticsearch(https://hotnode01:9200))
10:55:25.564
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:25.564
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:25.564
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:25.564
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:25.564
elastic_agent.filebeat
[elastic_agent.filebeat][error] Error extracting container id - source value does not contain matcher's logs_path '/var/lib/docker/containers/'.
10:55:25.574

and
restart the elastic-agent pod and the problem will be normal.
may be 2 weeks and suddenly same problem occurs.

Please help me

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.