Hello All,
I recently upgraded elasticsearch cluster from 8.12 > 8.19.
Subsequently i also upgraded elastic-agent (fleet-server) to 8.19 which is healthy. But when i try to enroll new agent into it, it is in updating state.
Only one integration is there in the policy where agents are being enrolled which is system
Can you please tell me what is happening, i am not able to debug.
even agents logs are not generating after some time, even though service is running.
Dec 15 18:43:56 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:56.990+0530","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/agent/application/coordinator.logComponentStateChange","file.name":"coordinator/coordinator.go","file.line":764},"message":"Spawned new unit http/metrics-monitoring: Starting: spawned pid '318799'","log":{"source":"elastic-agent"},"component":{"id":"http/metrics-monitoring","state":"STARTING"},"unit":{"id":"http/metrics-monitoring","type":"output","state":"STARTING"},"ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.073+0530","message":"Home path: [/opt/Elastic/Agent/data/elastic-agent-8.19.0-58cc05/components] Config path: [/opt/Elastic/Agent/data/elastic-agent-8.19.0-58cc05/components] Data path: [/opt/Elastic/Agent/data/elastic-agent-8.19.0-58cc05/run/http/metrics-monitoring] Logs path: [/opt/Elastic/Agent/data/elastic-agent-8.19.0-58cc05/components/logs]","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"service.name":"metricbeat","ecs.version":"1.6.0","log.origin":{"file.line":826,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).configure"},"ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.074+0530","message":"Beat ID: af153d9d-9811-4e3c-bc41-9d430c9b6bd2","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.origin":{"file.line":834,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).configure"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.076+0530","message":"Output reload is enabled, the beat will restart as needed on change of output config","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.logger":"centralmgmt","log.origin":{"file.line":204,"file.name":"management/managerV2.go","function":"github.com/elastic/beats/v7/x-pack/libbeat/management.NewV2AgentManagerWithClient"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.076+0530","message":"Set gc percentage to: 100","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.origin":{"file.line":888,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).configure"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.077+0530","message":"running under elastic-agent, per-beat lockfiles disabled","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"ecs.version":"1.6.0","log.origin":{"file.line":432,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).launch"},"service.name":"metricbeat","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.078+0530","message":"Starting stats endpoint","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.logger":"api","log.origin":{"file.line":67,"file.name":"api/server.go","function":"github.com/elastic/beats/v7/libbeat/api.(*Server).Start"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.078+0530","message":"Metrics endpoint listening on: /opt/Elastic/Agent/data/tmp/akSPbdqgaHaTY0_J01-dsfYK6JpMz2zn.sock (configured: unix:///opt/Elastic/Agent/data/tmp/akSPbdqgaHaTY0_J01-dsfYK6JpMz2zn.sock)","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.logger":"api","log.origin":{"file.line":71,"file.name":"api/server.go","function":"github.com/elastic/beats/v7/libbeat/api.(*Server).Start.func1"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.078+0530","message":"Syscall filter successfully installed","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.logger":"seccomp","log.origin":{"file.line":125,"file.name":"seccomp/seccomp.go","function":"github.com/elastic/beats/v7/libbeat/common/seccomp.loadFilter"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.078+0530","message":"Setup Beat: metricbeat; Version: 8.19.0","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"service.name":"metricbeat","ecs.version":"1.6.0","log.logger":"beat","log.origin":{"file.line":331,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).createBeater"},"ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.079+0530","message":"Output is configured through Central Management","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.origin":{"file.line":361,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).createBeater"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.080+0530","message":"Beat name: BdmES005DC","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.logger":"publisher","log.origin":{"file.line":105,"file.name":"pipeline/module.go","function":"github.com/elastic/beats/v7/libbeat/publisher/pipeline.LoadWithSettings"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.093+0530","message":"Starting metrics logging every 30s","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.logger":"monitoring","log.origin":{"file.line":150,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).snapshotLoop"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.093+0530","message":"metricbeat start running.","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"ecs.version":"1.6.0","log.origin":{"file.line":533,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).launch"},"service.name":"metricbeat","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.098+0530","log.logger":"component.runtime.http/metrics-monitoring","log.origin":{"function":"github.com/elastic/elastic-agent/pkg/component/runtime.(*Manager).CheckinV2","file.name":"runtime/manager.go","file.line":693},"message":"control checkin v2 protocol has chunking enabled","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.098+0530","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/agent/application/coordinator.logComponentStateChange","file.name":"coordinator/coordinator.go","file.line":777},"message":"Component state changed http/metrics-monitoring (STARTING->HEALTHY): Healthy: communicating with pid '318799'","log":{"source":"elastic-agent"},"component":{"id":"http/metrics-monitoring","state":"HEALTHY","old_state":"STARTING"},"ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.100+0530","message":"BeatV2Manager.unitListen UnitChanged.ID(http/metrics-monitoring-metrics-monitoring-agent), UnitChanged.Type(added), UnitChanged.Trigger(4): added/feature_change_triggered","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.logger":"centralmgmt.V2-manager","log.origin":{"file.line":508,"file.name":"management/managerV2.go","function":"github.com/elastic/beats/v7/x-pack/libbeat/management.(*BeatV2Manager).unitListen"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.100+0530","message":"BeatV2Manager.unitListen UnitChanged.ID(http/metrics-monitoring), UnitChanged.Type(added), UnitChanged.Trigger(4): added/feature_change_triggered","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.logger":"centralmgmt.V2-manager","log.origin":{"file.line":508,"file.name":"management/managerV2.go","function":"github.com/elastic/beats/v7/x-pack/libbeat/management.(*BeatV2Manager).unitListen"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.180+0530","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/agent/cmd.runElasticAgent","file.name":"cmd/run.go","file.line":372},"message":"reexec shutdown channel triggered","log":{"source":"elastic-agent"},"ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.180+0530","message":"Received signal \"terminated\", stopping","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"beat/metrics-monitoring","type":"beat/metrics"},"log":{"source":"beat/metrics-monitoring"},"service.name":"metricbeat","ecs.version":"1.6.0","log.logger":"service","log.origin":{"file.line":52,"file.name":"service/service.go","function":"github.com/elastic/elastic-agent-libs/service.HandleSignals.func1"},"ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.180+0530","message":"Received signal \"terminated\", stopping","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"ecs.version":"1.6.0","log.logger":"service","log.origin":{"file.line":52,"file.name":"service/service.go","function":"github.com/elastic/elastic-agent-libs/service.HandleSignals.func1"},"service.name":"filebeat","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.180+0530","message":"Received signal \"terminated\", stopping","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"system/metrics-default","type":"system/metrics"},"log":{"source":"system/metrics-default"},"log.logger":"service","log.origin":{"file.line":52,"file.name":"service/service.go","function":"github.com/elastic/elastic-agent-libs/service.HandleSignals.func1"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.180+0530","message":"Stopping filebeat","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"log.origin":{"file.line":533,"file.name":"beater/filebeat.go","function":"github.com/elastic/beats/v7/filebeat/beater.(*Filebeat).Stop"},"service.name":"filebeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.180+0530","message":"Stopping Crawler","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"ecs.version":"1.6.0","log.logger":"crawler","log.origin":{"file.line":152,"file.name":"beater/crawler.go","function":"github.com/elastic/beats/v7/filebeat/beater.(*crawler).Stop"},"service.name":"filebeat","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.180+0530","message":"Stopping 0 inputs","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"ecs.version":"1.6.0","log.logger":"crawler","log.origin":{"file.line":162,"file.name":"beater/crawler.go","function":"github.com/elastic/beats/v7/filebeat/beater.(*crawler).Stop"},"service.name":"filebeat","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.180+0530","message":"Crawler stopped","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"service.name":"filebeat","ecs.version":"1.6.0","log.logger":"crawler","log.origin":{"file.line":182,"file.name":"beater/crawler.go","function":"github.com/elastic/beats/v7/filebeat/beater.(*crawler).Stop"},"ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.180+0530","message":"Stopping Registrar","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"log.logger":"registrar","log.origin":{"file.line":126,"file.name":"registrar/registrar.go","function":"github.com/elastic/beats/v7/filebeat/registrar.(*Registrar).Stop"},"service.name":"filebeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.180+0530","message":"Ending Registrar","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"service.name":"filebeat","ecs.version":"1.6.0","log.logger":"registrar","log.origin":{"file.line":162,"file.name":"registrar/registrar.go","function":"github.com/elastic/beats/v7/filebeat/registrar.(*Registrar).Run"},"ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.180+0530","message":"Received signal \"terminated\", stopping","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.logger":"service","log.origin":{"file.line":52,"file.name":"service/service.go","function":"github.com/elastic/elastic-agent-libs/service.HandleSignals.func1"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.180+0530","message":"Registrar stopped","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"log.logger":"registrar","log.origin":{"file.line":131,"file.name":"registrar/registrar.go","function":"github.com/elastic/beats/v7/filebeat/registrar.(*Registrar).Stop"},"service.name":"filebeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.182+0530","message":"Total metrics","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"beat/metrics-monitoring","type":"beat/metrics"},"log":{"source":"beat/metrics-monitoring"},"monitoring":{"ecs.version":"1.6.0","metrics":{"amqp":{"unmatched_requests":0,"unmatched_responses":0},"auditd":{"kernel_lost":0,"reassembler_seq_gaps":0,"received_msgs":0,"userspace_lost":0},"beat":{"cgroup":{"cpu":{"id":"elastic-agent.service","stats":{"periods":0,"throttled":{"ns":0,"periods":0}}},"memory":{"id":"elastic-agent.service","mem":{"usage":{"bytes":488873984}}}},"cpu":{"system":{"ticks":60,"time":{"ms":60}},"total":{"ticks":130,"time":{"ms":130},"value":130},"user":{"ticks":70,"time":{"ms":70}}},"handles":{"limit":{"hard":524288,"soft":524287},"open":15},"info":{"ephemeral_id":"ad1cc872-45c7-41c1-842d-15502c18664d","name":"metricbeat","uptime":{"ms":281},"version":"8.19.0"},"memstats":{"gc_next":75863370,"memory_alloc":57045352,"memory_sys":74953337,"memory_total":62965880,"rss":234094592},"runtime":{"goroutines":40}},"dhcpv4":{"parse_failures":0,"total_packets":0},"dns":{"unmatched_requests":0,"unmatched_responses":0},"filebeat":{"harvester":{"closed":0,"open_files":0,"running":0,"skipped":0,"started":0},"input":{"log":{"files":{"renamed":0,"truncated":0}}}},"heartbeat":{"browser":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0},"http":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0},"icmp":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0},"tcp":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0}},"http":{"unmatched_requests":0,"unmatched_responses":0},"icmp":{"duplicate_requests":0,"unmatched_requests":0,"unmatched_responses":0},"libbeat":{"config":{"module":{"running":0,"starts":0,"stops":0},"reloads":0,"scans":0},"output":{"batches":{"split":0},"events":{"acked":0,"active":0,"batches":0,"dead_letter":0,"dropped":0,"duplicates":0,"failed":0,"toomany":0,"total":0},"read":{"bytes":0,"errors":0},"type":"","write":{"bytes":0,"errors":0,"latency":{"histogram":{"count":0,"max":0,"mean":0,"median":0,"min":0,"p75":0,"p95":0,"p99":0,"p999":0,"stddev":0}}}}},"memcache":{"unfinished_transactions":0,"unmatched_requests":0,"unmatched_responses":0},"mongodb":{"unmatched_requests":0},"mysql":{"unmatched_requests":0,"unmatched_responses":0},"nfs":{"unmatched_requests":0},"pgsql":{"unmatched_responses":0},"process@quark":{"aggregations":0,"backend":"","insertions":0,"lost":0,"non_aggregations":0,"removals":0},"processor":{"add_host_metadata":{"fqdn_lookup_failed":0}},"redis":{"unmatched_requests":0,"unmatched_responses":0},"registrar":{"states":{"cleanup":0,"current":0,"update":0},"writes":{"fail":0,"success":0,"total":0}},"system":{"cpu":{"cores":32},"load":{"1":0.7,"15":0.31,"5":0.38,"norm":{"1":0.0219,"15":0.0097,"5":0.0119}}},"thrift":{"unmatched_requests":0,"unmatched_responses":0}}},"log.logger":"monitoring","log.origin":{"file.line":200,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).logTotals"},"service.name":"metricbeat","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.182+0530","message":"Uptime: 272.165773ms","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"beat/metrics-monitoring","type":"beat/metrics"},"log":{"source":"beat/metrics-monitoring"},"service.name":"metricbeat","ecs.version":"1.6.0","log.logger":"monitoring","log.origin":{"file.line":201,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).logTotals"},"ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.182+0530","message":"Stopping metrics logging.","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"beat/metrics-monitoring","type":"beat/metrics"},"log":{"source":"beat/metrics-monitoring"},"log.origin":{"file.line":168,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).snapshotLoop"},"service.name":"metricbeat","ecs.version":"1.6.0","log.logger":"monitoring","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.182+0530","message":"Stats endpoint (/opt/Elastic/Agent/data/tmp/Hk6rvk9TDibMPcDvpl0jkLE-qDsHWVYL.sock) finished: accept unix /opt/Elastic/Agent/data/tmp/Hk6rvk9TDibMPcDvpl0jkLE-qDsHWVYL.sock: use of closed network connection","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"beat/metrics-monitoring","type":"beat/metrics"},"log":{"source":"beat/metrics-monitoring"},"log.logger":"api","log.origin":{"file.line":73,"file.name":"api/server.go","function":"github.com/elastic/beats/v7/libbeat/api.(*Server).Start.func1"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.182+0530","message":"metricbeat stopped.","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"beat/metrics-monitoring","type":"beat/metrics"},"log":{"source":"beat/metrics-monitoring"},"log.origin":{"file.line":542,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).launch"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.183+0530","message":"Total metrics","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"service.name":"filebeat","monitoring":{"ecs.version":"1.6.0","metrics":{"amqp":{"unmatched_requests":0,"unmatched_responses":0},"auditd":{"kernel_lost":0,"reassembler_seq_gaps":0,"received_msgs":0,"userspace_lost":0},"beat":{"cgroup":{"cpu":{"id":"elastic-agent.service","stats":{"periods":0,"throttled":{"ns":0,"periods":0}}},"memory":{"id":"elastic-agent.service","mem":{"usage":{"bytes":489136128}}}},"cpu":{"system":{"ticks":40,"time":{"ms":40}},"total":{"ticks":110,"time":{"ms":110},"value":110},"user":{"ticks":70,"time":{"ms":70}}},"handles":{"limit":{"hard":524288,"soft":524287},"open":15},"info":{"ephemeral_id":"5b0730ac-0161-4e5b-a809-af6fdff2b0b3","name":"filebeat","uptime":{"ms":387},"version":"8.19.0"},"memstats":{"gc_next":72863434,"memory_alloc":49517368,"memory_sys":66499193,"memory_total":55438152,"rss":227803136},"runtime":{"goroutines":40}},"dhcpv4":{"parse_failures":0,"total_packets":0},"dns":{"unmatched_requests":0,"unmatched_responses":0},"filebeat":{"events":{"active":0,"added":0,"done":0},"harvester":{"closed":0,"open_files":0,"running":0,"skipped":0,"started":0},"input":{"log":{"files":{"renamed":0,"truncated":0}}}},"heartbeat":{"browser":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0},"http":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0},"icmp":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0},"tcp":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0}},"http":{"unmatched_requests":0,"unmatched_responses":0},"icmp":{"duplicate_requests":0,"unmatched_requests":0,"unmatched_responses":0},"libbeat":{"config":{"module":{"running":0,"starts":0,"stops":0},"reloads":0,"scans":0},"output":{"batches":{"split":0},"events":{"acked":0,"active":0,"batches":0,"dead_letter":0,"dropped":0,"duplicates":0,"failed":0,"toomany":0,"total":0},"read":{"bytes":0,"errors":0},"type":"","write":{"bytes":0,"errors":0,"latency":{"histogram":{"count":0,"max":0,"mean":0,"median":0,"min":0,"p75":0,"p95":0,"p99":0,"p999":0,"stddev":0}}}}},"memcache":{"unfinished_transactions":0,"unmatched_requests":0,"unmatched_responses":0},"mongodb":{"unmatched_requests":0},"mysql":{"unmatched_requests":0,"unmatched_responses":0},"nfs":{"unmatched_requests":0},"pgsql":{"unmatched_responses":0},"process@quark":{"aggregations":0,"backend":"","insertions":0,"lost":0,"non_aggregations":0,"removals":0},"processor":{"add_host_metadata":{"fqdn_lookup_failed":0}},"redis":{"unmatched_requests":0,"unmatched_responses":0},"registrar":{"states":{"cleanup":0,"current":0,"update":0},"writes":{"fail":0,"success":0,"total":0}},"system":{"cpu":{"cores":32},"load":{"1":0.7,"15":0.31,"5":0.38,"norm":{"1":0.0219,"15":0.0097,"5":0.0119}}},"thrift":{"unmatched_requests":0,"unmatched_responses":0}}},"log.logger":"monitoring","log.origin":{"file.line":200,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).logTotals"},"ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.183+0530","message":"Uptime: 378.783139ms","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"log.logger":"monitoring","log.origin":{"file.line":201,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).logTotals"},"service.name":"filebeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.183+0530","message":"Stopping metrics logging.","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"log.logger":"monitoring","log.origin":{"file.line":168,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).snapshotLoop"},"service.name":"filebeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.183+0530","message":"Stats endpoint (/opt/Elastic/Agent/data/tmp/xTEtpJ7117ppc6OYvJCaYHbDW8mLjXGe.sock) finished: accept unix /opt/Elastic/Agent/data/tmp/xTEtpJ7117ppc6OYvJCaYHbDW8mLjXGe.sock: use of closed network connection","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"log.logger":"api","log.origin":{"file.line":73,"file.name":"api/server.go","function":"github.com/elastic/beats/v7/libbeat/api.(*Server).Start.func1"},"service.name":"filebeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.182+0530","message":"Total metrics","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.logger":"monitoring","log.origin":{"file.line":200,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).logTotals"},"service.name":"metricbeat","monitoring":{"ecs.version":"1.6.0","metrics":{"amqp":{"unmatched_requests":0,"unmatched_responses":0},"auditd":{"kernel_lost":0,"reassembler_seq_gaps":0,"received_msgs":0,"userspace_lost":0},"beat":{"cgroup":{"cpu":{"id":"elastic-agent.service","stats":{"periods":0,"throttled":{"ns":0,"periods":0}}},"memory":{"id":"elastic-agent.service","mem":{"usage":{"bytes":489066496}}}},"cpu":{"system":{"ticks":80,"time":{"ms":80}},"total":{"ticks":130,"time":{"ms":130},"value":130},"user":{"ticks":50,"time":{"ms":50}}},"handles":{"limit":{"hard":524288,"soft":524287},"open":16},"info":{"ephemeral_id":"2c33b3f3-5594-4eed-ba9a-1c69ee3e73cb","name":"metricbeat","uptime":{"ms":129},"version":"8.19.0"},"memstats":{"gc_next":70955226,"memory_alloc":57175288,"memory_sys":75149945,"memory_total":63158304,"rss":234094592},"runtime":{"goroutines":44}},"dhcpv4":{"parse_failures":0,"total_packets":0},"dns":{"unmatched_requests":0,"unmatched_responses":0},"filebeat":{"harvester":{"closed":0,"open_files":0,"running":0,"skipped":0,"started":0},"input":{"log":{"files":{"renamed":0,"truncated":0}}}},"heartbeat":{"browser":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0},"http":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0},"icmp":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0},"tcp":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0}},"http":{"unmatched_requests":0,"unmatched_responses":0},"icmp":{"duplicate_requests":0,"unmatched_requests":0,"unmatched_responses":0},"libbeat":{"config":{"module":{"running":0,"starts":0,"stops":0},"reloads":0,"scans":0},"output":{"batches":{"split":0},"events":{"acked":0,"active":0,"batches":0,"dead_letter":0,"dropped":0,"duplicates":0,"failed":0,"toomany":0,"total":0},"read":{"bytes":0,"errors":0},"type":"","write":{"bytes":0,"errors":0,"latency":{"histogram":{"count":0,"max":0,"mean":0,"median":0,"min":0,"p75":0,"p95":0,"p99":0,"p999":0,"stddev":0}}}}},"memcache":{"unfinished_transactions":0,"unmatched_requests":0,"unmatched_responses":0},"mongodb":{"unmatched_requests":0},"mysql":{"unmatched_requests":0,"unmatched_responses":0},"nfs":{"unmatched_requests":0},"pgsql":{"unmatched_responses":0},"process@quark":{"aggregations":0,"backend":"","insertions":0,"lost":0,"non_aggregations":0,"removals":0},"processor":{"add_host_metadata":{"fqdn_lookup_failed":0}},"redis":{"unmatched_requests":0,"unmatched_responses":0},"registrar":{"states":{"cleanup":0,"current":0,"update":0},"writes":{"fail":0,"success":0,"total":0}},"system":{"cpu":{"cores":32},"load":{"1":0.7,"15":0.31,"5":0.38,"norm":{"1":0.0219,"15":0.0097,"5":0.0119}}},"thrift":{"unmatched_requests":0,"unmatched_responses":0}}},"ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.183+0530","message":"filebeat stopped.","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"log.origin":{"file.line":542,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).launch"},"service.name":"filebeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.183+0530","message":"Uptime: 122.208862ms","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.logger":"monitoring","log.origin":{"file.line":201,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).logTotals"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.183+0530","message":"Stopping metrics logging.","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"ecs.version":"1.6.0","log.logger":"monitoring","log.origin":{"file.line":168,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).snapshotLoop"},"service.name":"metricbeat","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.183+0530","message":"Stats endpoint (/opt/Elastic/Agent/data/tmp/akSPbdqgaHaTY0_J01-dsfYK6JpMz2zn.sock) finished: accept unix /opt/Elastic/Agent/data/tmp/akSPbdqgaHaTY0_J01-dsfYK6JpMz2zn.sock: use of closed network connection","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"service.name":"metricbeat","ecs.version":"1.6.0","log.logger":"api","log.origin":{"file.line":73,"file.name":"api/server.go","function":"github.com/elastic/beats/v7/libbeat/api.(*Server).Start.func1"},"ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.182+0530","message":"Total metrics","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"system/metrics-default","type":"system/metrics"},"log":{"source":"system/metrics-default"},"log.logger":"monitoring","log.origin":{"file.line":200,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).logTotals"},"service.name":"metricbeat","monitoring":{"ecs.version":"1.6.0","metrics":{"amqp":{"unmatched_requests":0,"unmatched_responses":0},"auditd":{"kernel_lost":0,"reassembler_seq_gaps":0,"received_msgs":0,"userspace_lost":0},"beat":{"cgroup":{"cpu":{"id":"elastic-agent.service","stats":{"periods":0,"throttled":{"ns":0,"periods":0}}},"memory":{"id":"elastic-agent.service","mem":{"usage":{"bytes":488873984}}}},"cpu":{"system":{"ticks":60,"time":{"ms":60}},"total":{"ticks":130,"time":{"ms":130},"value":130},"user":{"ticks":70,"time":{"ms":70}}},"handles":{"limit":{"hard":524288,"soft":524287},"open":14},"info":{"ephemeral_id":"f91524de-0063-4800-8543-b5e586de0f0c","name":"metricbeat","uptime":{"ms":589},"version":"8.19.0"},"memstats":{"gc_next":70284418,"memory_alloc":56913664,"memory_sys":75149945,"memory_total":62825824,"rss":235405312},"runtime":{"goroutines":37}},"dhcpv4":{"parse_failures":0,"total_packets":0},"dns":{"unmatched_requests":0,"unmatched_responses":0},"filebeat":{"harvester":{"closed":0,"open_files":0,"running":0,"skipped":0,"started":0},"input":{"log":{"files":{"renamed":0,"truncated":0}}}},"heartbeat":{"browser":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0},"http":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0},"icmp":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0},"tcp":{"endpoint_starts":0,"endpoint_stops":0,"monitor_starts":0,"monitor_stops":0}},"http":{"unmatched_requests":0,"unmatched_responses":0},"icmp":{"duplicate_requests":0,"unmatched_requests":0,"unmatched_responses":0},"libbeat":{"config":{"module":{"running":0,"starts":0,"stops":0},"reloads":0,"scans":0},"output":{"batches":{"split":0},"events":{"acked":0,"active":0,"batches":0,"dead_letter":0,"dropped":0,"duplicates":0,"failed":0,"toomany":0,"total":0},"read":{"bytes":0,"errors":0},"type":"","write":{"bytes":0,"errors":0,"latency":{"histogram":{"count":0,"max":0,"mean":0,"median":0,"min":0,"p75":0,"p95":0,"p99":0,"p999":0,"stddev":0}}}}},"memcache":{"unfinished_transactions":0,"unmatched_requests":0,"unmatched_responses":0},"mongodb":{"unmatched_requests":0},"mysql":{"unmatched_requests":0,"unmatched_responses":0},"nfs":{"unmatched_requests":0},"pgsql":{"unmatched_responses":0},"process@quark":{"aggregations":0,"backend":"","insertions":0,"lost":0,"non_aggregations":0,"removals":0},"processor":{"add_host_metadata":{"fqdn_lookup_failed":0}},"redis":{"unmatched_requests":0,"unmatched_responses":0},"registrar":{"states":{"cleanup":0,"current":0,"update":0},"writes":{"fail":0,"success":0,"total":0}},"system":{"cpu":{"cores":32},"load":{"1":0.7,"15":0.31,"5":0.38,"norm":{"1":0.0219,"15":0.0097,"5":0.0119}}},"thrift":{"unmatched_requests":0,"unmatched_responses":0}}},"ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.183+0530","message":"metricbeat stopped.","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"service.name":"metricbeat","ecs.version":"1.6.0","log.origin":{"file.line":542,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).launch"},"ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.182+0530","message":"Uptime: 581.136797ms","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"system/metrics-default","type":"system/metrics"},"log":{"source":"system/metrics-default"},"log.logger":"monitoring","log.origin":{"file.line":201,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).logTotals"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.182+0530","message":"Stopping metrics logging.","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"system/metrics-default","type":"system/metrics"},"log":{"source":"system/metrics-default"},"ecs.version":"1.6.0","log.logger":"monitoring","log.origin":{"file.line":168,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).snapshotLoop"},"service.name":"metricbeat","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.182+0530","message":"Stats endpoint (/opt/Elastic/Agent/data/tmp/iThI_df0cBKC6YUNGGlKscMkOfz3FBH3.sock) finished: accept unix /opt/Elastic/Agent/data/tmp/iThI_df0cBKC6YUNGGlKscMkOfz3FBH3.sock: use of closed network connection","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"system/metrics-default","type":"system/metrics"},"log":{"source":"system/metrics-default"},"log.logger":"api","log.origin":{"file.line":73,"file.name":"api/server.go","function":"github.com/elastic/beats/v7/libbeat/api.(*Server).Start.func1"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Dec 15 18:43:57 BdmES005DC elastic-agent[318683]: {"log.level":"info","@timestamp":"2025-12-15T18:43:57.182+0530","message":"metricbeat stopped.","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"system/metrics-default","type":"system/metrics"},"log":{"source":"system/metrics-default"},"log.origin":{"file.line":542,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).launch"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
Anyone please help me how to resolve this issue.
Note : agent machine is able to make connection to elasticsearch and fleet server .