Elasticsearch 7.0 recent installed stop after 1min 5s

luisjoelqs · April 30, 2019, 4:16pm

I have installed elasticsearch 7.0 in a VM dedicated for test of the version and after start the service I have the next status after 1 min 5 sec.

test@elasticsearch:~ service elasticsearch status ● elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; disabled; vendor preset: enabled) Active: failed (Result: exit-code) since Tue 2019-04-30 16:09:07 UTC; 1s ago Docs: http://www.elastic.co Process: 5124 ExecStart=/usr/share/elasticsearch/bin/elasticsearch -p {PID_DIR}/elasticsearch.pid --quiet (code=exited, status=1/FAILURE)
Main PID: 5124 (code=exited, status=1/FAILURE)

Apr 30 16:08:00 elasticsearch systemd[1]: Started Elasticsearch.
Apr 30 16:08:03 elasticsearch elasticsearch[5124]: OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 a
Apr 30 16:09:07 elasticsearch systemd[1]: elasticsearch.service: Main process exited, code=exited, status=1/FAILURE
Apr 30 16:09:07 elasticsearch systemd[1]: elasticsearch.service: Failed with result 'exit-code'.

Can some one help me with this?

dbakti7 · April 30, 2019, 5:08pm

Could you please check the logs file and paste it here? there should be more information there.

luisjoelqs · April 30, 2019, 6:59pm

Here is the file /var/log/elasticsearch/elasticsearch.log

the file is too big, i cannot post all charaters

[2019-04-26T16:57:10,957][INFO ][o.e.e.NodeEnvironment [2019-04-26T16:57:10,968][INFO ][o.e.e.NodeEnvironment [2019-04-26T16:57:10,976][INFO ][o.e.n.Node [2019-04-26T16:57:10,977][INFO ][o.e.n.Node [2019-04-26T16:57:10,978][INFO ][o.e.n.Node [2019-04-26T16:57:10,978][INFO ][o.e.n.Node [2019-04-26T16:57:15,915][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,919][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,920][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,921][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,922][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,922][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,923][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,923][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,924][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,924][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,924][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,925][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,927][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,927][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,927][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,928][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,928][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,928][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,929][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,929][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,930][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,930][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,931][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,931][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,931][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,932][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,932][INFO ][o.e.p.PluginsService [2019-04-26T16:57:15,934][INFO ][o.e.p.PluginsService [2019-04-26T16:57:27,549][INFO ][o.e.x.s.a.s.FileRolesStore] [2019-04-26T16:57:39,520][ERROR][o.e.b.Bootstrap org.elasticsearch.ElasticsearchException: Failed at org.elasticsearch.xpack.ml.MachineLearning.createC at org.elasticsearch.node.Node.lambda$new$9(Node.java:438) at java.util.stream.ReferencePipeline$7$1.accept(Refe at java.util.ArrayList$ArrayListSpliterator.forEachRe at java.util.stream.AbstractPipeline.copyInto(Abstrac at java.util.stream.AbstractPipeline.wrapAndCopyInto( at java.util.stream.ReduceOps$ReduceOp.evaluateSequen at java.util.stream.AbstractPipeline.evaluate(Abstrac at java.util.stream.ReferencePipeline.collect(Referen ] [elasticsearch] using [1] data paths, mounts [[/ (/dev/vda2)]], net usable_space [67.3gb], net total_space [78.2gb], types [ext4]
] [elasticsearch] heap size [990.7mb], compressed ordinary object pointers [true]
] [elasticsearch] node name [elasticsearch], node ID [zO9bT0cPRge2IlKzzRWLpg]
] [elasticsearch] version[7.0.0], pid[20343], build[default/deb/b7e28a7/2019-04-05T22:55:32.697037Z], OS[Linux/4.15.0-48-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/12/12+33]
] [elasticsearch] JVM home [/usr/share/elasticsearch/jdk]
] [elasticsearch] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-5110676073795515784, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/elasticsearch/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -Dio.netty.allocator.type=unpooled, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=deb, -Des.bundled_jdk=true]
] [elasticsearch] loaded module [aggs-matrix-stats]
] [elasticsearch] loaded module [analysis-common]
] [elasticsearch] loaded module [ingest-common]
] [elasticsearch] loaded module [ingest-geoip]
] [elasticsearch] loaded module [ingest-user-agent]
] [elasticsearch] loaded module [lang-expression]
] [elasticsearch] loaded module [lang-mustache]
] [elasticsearch] loaded module [lang-painless]
] [elasticsearch] loaded module [mapper-extras]
] [elasticsearch] loaded module [parent-join]
] [elasticsearch] loaded module [percolator]
] [elasticsearch] loaded module [rank-eval]
] [elasticsearch] loaded module [reindex]
] [elasticsearch] loaded module [repository-url]
] [elasticsearch] loaded module [transport-netty4]
] [elasticsearch] loaded module [x-pack-ccr]
] [elasticsearch] loaded module [x-pack-core]
] [elasticsearch] loaded module [x-pack-deprecation]
] [elasticsearch] loaded module [x-pack-graph]
] [elasticsearch] loaded module [x-pack-ilm]
] [elasticsearch] loaded module [x-pack-logstash]
] [elasticsearch] loaded module [x-pack-ml]
] [elasticsearch] loaded module [x-pack-monitoring]
] [elasticsearch] loaded module [x-pack-rollup]
] [elasticsearch] loaded module [x-pack-security]
] [elasticsearch] loaded module [x-pack-sql]
] [elasticsearch] loaded module [x-pack-watcher]
] [elasticsearch] no plugins loaded
[elasticsearch] parsed [0] roles from file [/etc/elasticsearch/roles.yml]
] [elasticsearch] Exception
to create native process factories for Machine Learning
omponents(MachineLearning.java:427) ~[?:?]
~[elasticsearch-7.0.0.jar:7.0.0]
rencePipeline.java:271) ~[?:?]
maining(ArrayList.java:1654) ~[?:?]
tPipeline.java:484) ~[?:?]
AbstractPipeline.java:474) ~[?:?]
tial(ReduceOps.java:913) ~[?:?]
tPipeline.java:234) ~[?:?]
cePipeline.java:578) ~[?:?]

luisjoelqs · April 30, 2019, 7:01pm

Here the end of the file

Caused by: java.io.FileNotFoundException: /tmp/elasticsearch-5110676073795515784/controller_log_20343 (No such file or directory)
at java.io.FileInputStream.open0(Native Method) ~[?:?]
at java.io.FileInputStream.open(FileInputStream.java:213) ~[?:?]
at java.io.FileInputStream.(FileInputStream.java:155) ~[?:?]
at java.io.FileInputStream.(FileInputStream.java:110) ~[?:?]
at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:288) ~[?:?]
at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:277) ~[?:?]
at java.security.AccessController.doPrivileged(AccessController.java:310) ~[?:?]
at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:130) ~[?:?]
at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:97) ~[?:?]
at org.elasticsearch.xpack.ml.process.ProcessPipes.connectStreams(ProcessPipes.java:131) ~[?:?]
at org.elasticsearch.xpack.ml.process.NativeController.(NativeController.java:61) ~[?:?]
at org.elasticsearch.xpack.ml.process.NativeControllerHolder.getNativeController(NativeControllerHolder.java:40) ~[?:?]
at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:412) ~[?:?]
... 20 more
[2019-04-26T16:57:39,561][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [elasticsearch] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: ElasticsearchException[Failed to create native process factories for Machine Learning]; nested: FileNotFoundException[/tmp/elasticsearch-5110676073795515784/controller_log_20343 (No such file or directory)];
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.0.0.jar:7.0.0]
at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.0.0.jar:7.0.0]
at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.0.0.jar:7.0.0]
at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-7.0.0.jar:7.0.0]
at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.0.0.jar:7.0.0]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.0.0.jar:7.0.0]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.0.0.jar:7.0.0]
Caused by: org.elasticsearch.ElasticsearchException: Failed to create native process factories for Machine Learning
at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:427) ~[?:?]
at org.elasticsearch.node.Node.lambda$new$9(Node.java:438) ~[elasticsearch-7.0.0.jar:7.0.0]
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) ~[?:?]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
at org.elasticsearch.node.Node.(Node.java:441) ~[elasticsearch-7.0.0.jar:7.0.0]
at org.elasticsearch.node.Node.(Node.java:251) ~[elasticsearch-7.0.0.jar:7.0.0]
at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211) ~[elasticsearch-7.0.0.jar:7.0.0]
at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.0.0.jar:7.0.0]
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.0.0.jar:7.0.0]
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.0.0.jar:7.0.0]
... 6 more
Caused by: java.io.FileNotFoundException: /tmp/elasticsearch-5110676073795515784/controller_log_20343 (No such file or directory)
at java.io.FileInputStream.open0(Native Method) ~[?:?]
at java.io.FileInputStream.open(FileInputStream.java:213) ~[?:?]
at java.io.FileInputStream.(FileInputStream.java:155) ~[?:?]
at java.io.FileInputStream.(FileInputStream.java:110) ~[?:?]
at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:288) ~[?:?]
at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:277) ~[?:?]
at java.security.AccessController.doPrivileged(AccessController.java:310) ~[?:?]
at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:130) ~[?:?]
at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:97) ~[?:?]
at org.elasticsearch.xpack.ml.process.ProcessPipes.connectStreams(ProcessPipes.java:131) ~[?:?]
at org.elasticsearch.xpack.ml.process.NativeController.(NativeController.java:61) ~[?:?]
at org.elasticsearch.xpack.ml.process.NativeControllerHolder.getNativeController(NativeControllerHolder.java:40) ~[?:?]
at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:412) ~[?:?]
at org.elasticsearch.node.Node.lambda$new$9(Node.java:438) ~[elasticsearch-7.0.0.jar:7.0.0]
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) ~[?:?]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
at org.elasticsearch.node.Node.(Node.java:441) ~[elasticsearch-7.0.0.jar:7.0.0]
at org.elasticsearch.node.Node.(Node.java:251) ~[elasticsearch-7.0.0.jar:7.0.0]
at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211) ~[elasticsearch-7.0.0.jar:7.0.0]
at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.0.0.jar:7.0.0]
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.0.0.jar:7.0.0]
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.0.0.jar:7.0.0]

dbakti7 · May 1, 2019, 2:05pm

Seems similar with Linux OS : Failed to create native process factories for Machine Learning
Please check if you have the right directory for x-pack, or you can follow the instruction in that thread to disable x-pack ML in config file (do you need them?)

luisjoelqs · May 1, 2019, 2:38pm

X-pack is disabled in yml config file.

dbakti7 · May 1, 2019, 3:17pm

From your logs seems like somehow ES is loading x-pack related plugins, especially the ML module.

I assume here you already added the line xpack.ml.enabled: false to config file and try to restart the service. Problem still persists?

or you can also try to remove x-pack plugin:
bin\elasticsearch-plugin remove x-pack
and restart Elasticsearch after that..

system · May 29, 2019, 3:17pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.