TransportNodesStatsAction

Elastic Stack Elasticsearch
1

Hi, everyone. I hava a cluster with seven nodes, four of them are used to store data, and the others are node.master. The elasticsearch version is 5.6.8.
Recently, we find an exception in log file of node.master. When the exception occurred, the health status of elasticsearch cluster turned to yellow.
After a period, health status changed to green automically and we did nothing.
The exception is caused by network connections or other reasons, can anyone help find the reason. Thanks.

log files show the belowing error:
[DEBUG][o.e.a.a.c.n.s.TransportNodesStatsAction] [node-es1] failed to execute on node [-hY6GENLR32KD-1mIkXgog]
org.elasticsearch.transport.ReceiveTimeoutTransportException: [node-es1][10.12.10.19:9300][cluster:monitor/nodes/stats[n]] request_id [41150994] timed out after [15001ms]
at org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:961) [elasticsearch-5.6.8.jar:5.6.8]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:575) [elasticsearch-5.6.8.jar:5.6.8]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_161]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_161]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]
[2018-12-26T00:26:56,426][DEBUG][o.e.a.a.c.n.s.TransportNodesStatsAction] [node-es1] failed to execute on node [-hY6GENLR32KD-1mIkXgog]
org.elasticsearch.transport.ReceiveTimeoutTransportException: [node-es1][10.12.10.19:9300][cluster:monitor/nodes/stats[n]] request_id [41151002] timed out after [15000ms]
at org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:961) [elasticsearch-5.6.8.jar:5.6.8]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:575) [elasticsearch-5.6.8.jar:5.6.8]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_161]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_161]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]

2

This exception could be caused by a transient problem like a connectivity failure or perhaps a long GC pause. In either case the cluster would return to green once the problem went away.

3

Thank you, we will check the network connection and jvm.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.