I want to perform monitoring for Elasticsearch and Kibana based on the following article How to activate APM in Kibana and Elasticsearch to gain next-level alerting insights | Elastic Blog. After trying it out, the metrics from Elasticsearch do not appear in the APM menu in Kibana. Here is the docker-compose file I am using docker-compose.yml
Here are the logs from the APM server:
{"log.level":"info","@timestamp":"2023-11-22T06:12:10.561Z","log.logger":"request","log.origin":{"file.name":"middleware/log_middleware.go","file.line":61},"message":"request accepted","service.name":"apm-server","url.original":"/intake/v2/events","http.request.method":"POST","user_agent.original":"apm-agent-java/1.36.0 (elasticsearch 8.10.4)","source.address":"172.18.0.2","http.request.id":"81213d86-18ba-451a-bfc1-67091c37a0f5","event.duration":10010595416,"http.response.status_code":202,"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-22T06:14:10.551Z","log.logger":"request","log.origin":{"file.name":"middleware/log_middleware.go","file.line":61},"message":"request accepted","service.name":"apm-server","url.original":"/intake/v2/events","http.request.method":"POST","user_agent.original":"apm-agent-java/1.36.0 (elasticsearch 8.10.4)","source.address":"172.18.0.2","http.request.id":"797f6118-05dd-4d55-9801-84da9b609ca0","event.duration":10010702538,"http.response.status_code":202,"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-22T06:16:10.549Z","log.logger":"request","log.origin":{"file.name":"middleware/log_middleware.go","file.line":61},"message":"request accepted","service.name":"apm-server","url.original":"/intake/v2/events","http.request.method":"POST","user_agent.original":"apm-agent-java/1.36.0 (elasticsearch 8.10.4)","source.address":"172.18.0.2","http.request.id":"e793f672-b74a-48bc-82c2-f9cea4209a49","event.duration":10009004178,"http.response.status_code":202,"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-22T06:18:10.560Z","log.logger":"request","log.origin":{"file.name":"middleware/log_middleware.go","file.line":61},"message":"request accepted","service.name":"apm-server","url.original":"/intake/v2/events","http.request.method":"POST","user_agent.original":"apm-agent-java/1.36.0 (elasticsearch 8.10.4)","source.address":"172.18.0.2","http.request.id":"72e862c4-9ff1-4d30-a134-758180c94866","event.duration":10004352682,"http.response.status_code":202,"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-11-22T06:20:10.546Z","log.logger":"request","log.origin":{"file.name":"middleware/log_middleware.go","file.line":61},"message":"request accepted","service.name":"apm-server","url.original":"/intake/v2/events","http.request.method":"POST","user_agent.original":"apm-agent-java/1.36.0 (elasticsearch 8.10.4)","source.address":"172.18.0.2","http.request.id":"3c816d25-afe5-40eb-b2a3-f39acf1d39d5","event.duration":10005678861,"http.response.status_code":202,"ecs.version":"1.6.0"}
And here are the logs from the Elasticsearch server:
opedSettings","elasticsearch.cluster.uuid":"0Vy7RCtoQw-k9-zQEDIkaw","elasticsearch.node.id":"xF3BNGMiRuyHXst6ckOfFw","elasticsearch.node.name":"44dfb26988f3","elasticsearch.cluster.name":"docker-cluster","tags":[" [.ds-metrics-elastic_agent.filebeat-default-2023.11.19-000001]"]}
{"@timestamp":"2023-11-22T06:16:46.325Z", "log.level": "INFO", "message":"updating [index.time_series.end_time] from [2023-11-22T08:16:46.000Z] to [2023-11-22T08:21:46.000Z]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[44dfb26988f3][clusterApplierService#updateTask][T#1]","log.logger":"org.elasticsearch.common.settings.IndexScopedSettings","elasticsearch.cluster.uuid":"0Vy7RCtoQw-k9-zQEDIkaw","elasticsearch.node.id":"xF3BNGMiRuyHXst6ckOfFw","elasticsearch.node.name":"44dfb26988f3","elasticsearch.cluster.name":"docker-cluster","tags":[" [.ds-metrics-system.network-default-2023.11.19-000001]"]}
{"@timestamp":"2023-11-22T06:21:46.320Z", "log.level": "INFO", "message":"updating [index.time_series.end_time] from [2023-11-22T08:21:46.000Z] to [2023-11-22T08:26:46.000Z]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[44dfb26988f3][clusterApplierService#updateTask][T#1]","log.logger":"org.elasticsearch.common.settings.IndexScopedSettings","elasticsearch.cluster.uuid":"0Vy7RCtoQw-k9-zQEDIkaw","elasticsearch.node.id":"xF3BNGMiRuyHXst6ckOfFw","elasticsearch.node.name":"44dfb26988f3","elasticsearch.cluster.name":"docker-cluster","tags":[" [.ds-metrics-system.cpu-default-2023.11.19-000001]"]}
{"@timestamp":"2023-11-22T06:21:46.321Z", "log.level": "INFO", "message":"updating [index.time_series.end_time] from [2023-11-22T08:21:46.000Z] to [2023-11-22T08:26:46.000Z]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[44dfb26988f3][clusterApplierService#updateTask][T#1]","log.logger":"org.elasticsearch.common.settings.IndexScopedSettings","elasticsearch.cluster.uuid":"0Vy7RCtoQw-k9-zQEDIkaw","elasticsearch.node.id":"xF3BNGMiRuyHXst6ckOfFw","elasticsearch.node.name":"44dfb26988f3","elasticsearch.cluster.name":"docker-cluster","tags":[" [.ds-metrics-system.memory-default-2023.11.19-000001]"]}
{"@timestamp":"2023-11-22T06:21:46.322Z", "log.level": "INFO", "message":"updating [index.time_series.end_time] from [2023-11-22T08:21:46.000Z] to [2023-11-22T08:26:46.000Z]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[44dfb26988f3][clusterApplierService#updateTask][T#1]","log.logger":"org.elasticsearch.common.settings.IndexScopedSettings","elasticsearch.cluster.uuid":"0Vy7RCtoQw-k9-zQEDIkaw","elasticsearch.node.id":"xF3BNGMiRuyHXst6ckOfFw","elasticsearch.node.name":"44dfb26988f3","elasticsearch.cluster.name":"docker-cluster","tags":[" [.ds-metrics-elastic_agent.metricbeat-default-2023.11.19-000001]"]}
This is a screenshot of the display in the APM menu on my Kibana
Based on my configuration above, what is wrong or what is missing?
