Elasticsearch not create heap dump file when outofmemory

Elastic Stack Elasticsearch
1

my elasticsearch encounterd outofmemory exception, but it not create heap dump file

the log:

[2019-12-09T20:33:16,878][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-xxx] fatal error in thread [elasticsearch[node-xxx-][search][T#24]], exiting
java.lang.OutOfMemoryError: Java heap space
[2019-12-09T20:33:07,980][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-xxx] fatal error in thread [elasticsearch[node-xxx-][search][T#25]], exiting
java.lang.OutOfMemoryError: Java heap space
[2019-12-09T20:33:16,895][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-xxx-] fatal error in thread [elasticsearch[node-xxx-][search][T#5]], exiting
java.lang.OutOfMemoryError: Java heap space
[2019-12-09T20:33:16,902][DEBUG][o.e.a.a.c.n.i.TransportNodesInfoAction] [node-xxx-] failed to execute on node [x7X4V64oS8CEzGfkpmUgeA]
org.elasticsearch.transport.ReceiveTimeoutTransportException: [node-xxx-][xxx:9300][cluster:monitor/nodes/info[n]] request_id [1040257164] timed out after [168842ms]
        at org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:908) [elasticsearch-5.2.0.jar:5.2.0]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:527) [elasticsearch-5.2.0.jar:5.2.0]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_102]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_102]
        at java.lang.Thread.run(Thread.java:745) [?:1.8.0_102]
[2019-12-09T20:33:16,902][DEBUG][o.e.a.a.c.n.i.TransportNodesInfoAction] [node-xxx-] failed to execute on node [pC6DBL4IQ6Ka3FCRj-bAoA]
org.elasticsearch.transport.ReceiveTimeoutTransportException: [node-xxx-][xxx:9300][cluster:monitor/nodes/info[n]] request_id [1040257111] timed out after [186442ms]
        at org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:908) [elasticsearch-5.2.0.jar:5.2.0]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:527) [elasticsearch-5.2.0.jar:5.2.0]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_102]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_102]
        at java.lang.Thread.run(Thread.java:745) [?:1.8.0_102]
[2019-12-09T20:33:16,909][DEBUG][o.e.a.a.c.n.i.TransportNodesInfoAction] [node-xxx-] failed to execute on node [oQa8EB3CRJuWJt7Jy8rmYQ]
org.elasticsearch.transport.ReceiveTimeoutTransportException: [node-xxx-][xxx:9300][cluster:monitor/nodes/info[n]] request_id [1040256994] timed out after [186525ms]
        at org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:908) [elasticsearch-5.2.0.jar:5.2.0]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:527) [elasticsearch-5.2.0.jar:5.2.0]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_102]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_102]
        at java.lang.Thread.run(Thread.java:745) [?:1.8.0_102]

jvm config:

-XX:+HeapDumpOnOutOfMemoryError

-XX:HeapDumpPath=/data/home/search

the /data/home/search path exist, and elasticsearch has access permission

1 Like
2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.