Elasticsearch in dead state


(Mac Fan4000) #1

I am using Elasticsearch 5 and when I restart it it works fine. But it eventually goes into a dead state. How can this be fixed?


(Thiago Souza) #2

What do you mean by "dead state"? It stops responding to API calls?

It will also help if you can attach some logs.


(Mac Fan4000) #3

The below is the contents of the elastic search log.

[2017-07-19T12:58:25,102][WARN ][o.e.c.l.LogConfigurator ] ignoring unsupported logging configuration file [/etc/elasticsearch/logging.yml], logging is configured via [/etc/elasticsearch/log4j2.properties]
[2017-07-19T12:58:25,218][WARN ][o.e.b.JNANatives ] unable to install syscall filter:
java.lang.UnsupportedOperationException: seccomp unavailable: CONFIG_SECCOMP not compiled into kernel, CONFIG_SECCOMP and CONFIG_SECCOMP_FILTER are needed
at org.elasticsearch.bootstrap.SystemCallFilter.linuxImpl(SystemCallFilter.java:363) ~[elasticsearch-5.5.0.jar:5.5.0]
at org.elasticsearch.bootstrap.SystemCallFilter.init(SystemCallFilter.java:638) ~[elasticsearch-5.5.0.jar:5.5.0]
at org.elasticsearch.bootstrap.JNANatives.tryInstallSystemCallFilter(JNANatives.java:215) [elasticsearch-5.5.0.jar:5.5.0]
at org.elasticsearch.bootstrap.Natives.tryInstallSystemCallFilter(Natives.java:99) [elasticsearch-5.5.0.jar:5.5.0]
at org.elasticsearch.bootstrap.Bootstrap.initializeNatives(Bootstrap.java:111) [elasticsearch-5.5.0.jar:5.5.0]
at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:194) [elasticsearch-5.5.0.jar:5.5.0]
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:351) [elasticsearch-5.5.0.jar:5.5.0]
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:123) [elasticsearch-5.5.0.jar:5.5.0]
at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:114) [elasticsearch-5.5.0.jar:5.5.0]
at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:67) [elasticsearch-5.5.0.jar:5.5.0]
at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:122) [elasticsearch-5.5.0.jar:5.5.0]
at org.elasticsearch.cli.Command.main(Command.java:88) [elasticsearch-5.5.0.jar:5.5.0]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) [elasticsearch-5.5.0.jar:5.5.0]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) [elasticsearch-5.5.0.jar:5.5.0]
[2017-07-19T12:58:25,457][INFO ][o.e.n.Node ] [] initializing ...
[2017-07-19T12:58:25,607][INFO ][o.e.e.NodeEnvironment ] [I7r3PI2] using [1] data paths, mounts [[/ (/dev/simfs)]], net usable_space [69.3gb], net total_space [80gb], spins? [possibly], types [reiserfs]
[2017-07-19T12:58:25,607][INFO ][o.e.e.NodeEnvironment ] [I7r3PI2] heap size [1.9gb], compressed ordinary object pointers [true]
[2017-07-19T12:58:25,645][INFO ][o.e.n.Node ] node name [I7r3PI2] derived from node ID [I7r3PI2RQ7GWhPSAHflZvg]; set [node.name] to override
[2017-07-19T12:58:25,645][INFO ][o.e.n.Node ] version[5.5.0], pid[23175], build[260387d/2017-06-30T23:16:05.735Z], OS[Linux/2.6.32-042stab120.16/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_131/25.131-b11]
[2017-07-19T12:58:25,646][INFO ][o.e.n.Node ] JVM arguments [-Xms2g, -Xmx2g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+DisableExplicitGC, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headles$
[2017-07-19T12:58:27,309][INFO ][o.e.p.PluginsService ] [I7r3PI2] loaded module [aggs-matrix-stats]
[2017-07-19T12:58:27,309][INFO ][o.e.p.PluginsService ] [I7r3PI2] loaded module [ingest-common]
[2017-07-19T12:58:27,310][INFO ][o.e.p.PluginsService ] [I7r3PI2] loaded module [lang-expression]
[2017-07-19T12:58:27,310][INFO ][o.e.p.PluginsService ] [I7r3PI2] loaded module [lang-groovy]
[2017-07-19T12:58:27,310][INFO ][o.e.p.PluginsService ] [I7r3PI2] loaded module [lang-mustache]
[2017-07-19T12:58:27,310][INFO ][o.e.p.PluginsService ] [I7r3PI2] loaded module [lang-painless]
[2017-07-19T12:58:27,310][INFO ][o.e.p.PluginsService ] [I7r3PI2] loaded module [parent-join]
[2017-07-19T12:58:27,310][INFO ][o.e.p.PluginsService ] [I7r3PI2] loaded module [percolator]
[2017-07-19T12:58:27,310][INFO ][o.e.p.PluginsService ] [I7r3PI2] loaded module [reindex]
[2017-07-19T12:58:27,310][INFO ][o.e.p.PluginsService ] [I7r3PI2] loaded module [transport-netty3]
[2017-07-19T12:58:27,311][INFO ][o.e.p.PluginsService ] [I7r3PI2] loaded module [transport-netty4]
[2017-07-19T12:58:27,311][INFO ][o.e.p.PluginsService ] [I7r3PI2] no plugins loaded
[2017-07-19T12:58:29,956][INFO ][o.e.d.DiscoveryModule ] [I7r3PI2] using discovery type [zen]
[2017-07-19T12:58:30,689][INFO ][o.e.n.Node ] initialized
[2017-07-19T12:58:30,690][INFO ][o.e.n.Node ] [I7r3PI2] starting ...
[2017-07-19T12:58:30,901][WARN ][i.n.u.i.MacAddressUtil ] Failed to find a usable hardware address from the network interfaces; using random bytes: 1b:94:44:da:e0:61:77:4e
[2017-07-19T12:58:30,980][INFO ][o.e.t.TransportService ] [I7r3PI2] publish_address {127.0.0.1:9300}, bound_addresses {[::1]:9300}, {127.0.0.1:9300}, {127.0.0.2:9300}
[2017-07-19T12:58:30,997][WARN ][o.e.b.BootstrapChecks ] [I7r3PI2] max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
[2017-07-19T12:58:30,998][WARN ][o.e.b.BootstrapChecks ] [I7r3PI2] system call filters failed to install; check the logs and fix your configuration or disable system call filters at your own risk
[2017-07-19T12:58:34,068][INFO ][o.e.c.s.ClusterService ] [I7r3PI2] new_master {I7r3PI2}{I7r3PI2RQ7GWhPSAHflZvg}{yfyORny8T0i659tb1eT4bw}{127.0.0.1}{127.0.0.1:9300}, reason: zen-disco-elected-as-master ([0] nodes joined)
[2017-07-19T12:58:34,107][INFO ][o.e.h.n.Netty4HttpServerTransport] [I7r3PI2] publish_address {127.0.0.1:9200}, bound_addresses {[::1]:9200}, {127.0.0.1:9200}, {127.0.0.2:9200}
[2017-07-19T12:58:34,107][INFO ][o.e.n.Node ] [I7r3PI2] started
[2017-07-19T12:58:34,403][INFO ][o.e.g.GatewayService ] [I7r3PI2] recovered [3] indices into cluster_state
[2017-07-19T12:58:34,860][INFO ][o.e.c.r.a.AllocationService] [I7r3PI2] Cluster health status changed from [RED] to [GREEN] (reason: [shards started [[wiki-mw__content_first][2], [wiki-mw__content_first][0], [mw_cirrus_metastore_first][0]] ...]).
[2017-07-19T14:18:54,807][INFO ][o.e.n.Node ] [I7r3PI2] stopping ...
[2017-07-19T14:18:54,942][INFO ][o.e.n.Node ] [I7r3PI2] stopped
[2017-07-19T14:18:54,942][INFO ][o.e.n.Node ] [I7r3PI2] closing ...
[2017-07-19T14:18:54,954][INFO ][o.e.n.Node ] [I7r3PI2] closed

What I mean by dead state is that when I run service elastic search status i get this.

‚óŹ elasticsearch.service - Elasticsearch
Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; disabled)
Active: inactive (dead)
Docs: http://www.elastic.co

This is with elasticsearch 5 on debian 8.


(Mac Fan4000) #4

It only goes into this state when I reboot the server it seems. It seems to be hogging RAM.


(system) #5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.