Elasticsearch service won't start

Lukasz1 · June 15, 2022, 2:26pm

Elasticsearch (7.17.0) service won't start

The config file is so simple that I can't find any error there.

My config is:

cluster.name: elkos
node.name: elkos-1

path.data: /mnt/elasticsearch/data
path.logs: /mnt/elasticsearch/logs

network.host: a.b.c.d
http.port: 9200
discovery.type: single-node

Logs:

[2022-06-12T00:00:31,289][INFO ][o.e.n.Node               ] [elkos-1] version[7.17.0], pid[14558], build[default/rpm/bee86328705acaa9a6daede7140defd4d9ec56bd/2022-01-28T08:36:04.875279988Z], OS[Linux/4.14.35-2047.500.10.el7uek.x86_64/amd64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.1/17.0.1+12]
[2022-06-12T00:00:31,293][INFO ][o.e.n.Node               ] [elkos-1] JVM home [/usr/share/elasticsearch/jdk], using bundled JDK [true]
[2022-06-12T00:00:31,294][INFO ][o.e.n.Node               ] [elkos-1] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -Xms2g, -Xmx2g, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-13025150590075498264, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/elasticsearch/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -XX:MaxDirectMemorySize=1073741824, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=rpm, -Des.bundled_jdk=true]
[2022-06-12T00:00:33,684][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [aggs-matrix-stats]
[2022-06-12T00:00:33,685][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [analysis-common]
[2022-06-12T00:00:33,685][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [constant-keyword]
[2022-06-12T00:00:33,685][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [frozen-indices]
[2022-06-12T00:00:33,685][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [ingest-common]
[2022-06-12T00:00:33,686][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [ingest-geoip]
[2022-06-12T00:00:33,686][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [ingest-user-agent]
[2022-06-12T00:00:33,686][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [kibana]
[2022-06-12T00:00:33,686][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [lang-expression]
[2022-06-12T00:00:33,686][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [lang-mustache]
[2022-06-12T00:00:33,687][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [lang-painless]
[2022-06-12T00:00:33,687][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [legacy-geo]
[2022-06-12T00:00:33,687][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [mapper-extras]
[2022-06-12T00:00:33,687][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [mapper-version]
[2022-06-12T00:00:33,687][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [parent-join]
[2022-06-12T00:00:33,687][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [percolator]
[2022-06-12T00:00:33,688][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [rank-eval]
[2022-06-12T00:00:33,688][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [reindex]
[2022-06-12T00:00:33,688][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [repositories-metering-api]
[2022-06-12T00:00:33,688][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [repository-encrypted]
[2022-06-12T00:00:33,688][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [repository-url]
[2022-06-12T00:00:33,688][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [runtime-fields-common]
[2022-06-12T00:00:33,689][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [search-business-rules]
[2022-06-12T00:00:33,689][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [searchable-snapshots]
[2022-06-12T00:00:33,689][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [snapshot-repo-test-kit]
[2022-06-12T00:00:33,689][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [spatial]
[2022-06-12T00:00:33,689][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [systemd]
[2022-06-12T00:00:33,690][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [transform]
[2022-06-12T00:00:33,690][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [transport-netty4]
[2022-06-12T00:00:33,690][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [unsigned-long]
[2022-06-12T00:00:33,690][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [vector-tile]
[2022-06-12T00:00:33,690][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [vectors]
[2022-06-12T00:00:33,690][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [wildcard]
[2022-06-12T00:00:33,691][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-aggregate-metric]
[2022-06-12T00:00:33,691][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-analytics]
[2022-06-12T00:00:33,691][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-async]
[2022-06-12T00:00:33,691][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-async-search]
[2022-06-12T00:00:33,691][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-autoscaling]
[2022-06-12T00:00:33,691][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-ccr]
[2022-06-12T00:00:33,692][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-core]
[2022-06-12T00:00:33,692][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-data-streams]
[2022-06-12T00:00:33,692][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-deprecation]
[2022-06-12T00:00:33,692][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-enrich]
[2022-06-12T00:00:33,692][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-eql]
[2022-06-12T00:00:33,692][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-fleet]
[2022-06-12T00:00:33,693][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-graph]
[2022-06-12T00:00:33,693][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-identity-provider]
[2022-06-12T00:00:33,693][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-ilm]
[2022-06-12T00:00:33,693][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-logstash]
[2022-06-12T00:00:33,693][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-ml]
[2022-06-12T00:00:33,693][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-monitoring]
[2022-06-12T00:00:33,693][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-ql]
[2022-06-12T00:00:33,694][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-rollup]
[2022-06-12T00:00:33,694][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-security]
[2022-06-12T00:00:33,694][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-shutdown]
[2022-06-12T00:00:33,694][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-sql]
[2022-06-12T00:00:33,694][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-stack]
[2022-06-12T00:00:33,694][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-text-structure]
[2022-06-12T00:00:33,695][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-voting-only-node]
[2022-06-12T00:00:33,695][INFO ][o.e.p.PluginsService     ] [elkos-1] loaded module [x-pack-watcher]
[2022-06-12T00:00:33,695][INFO ][o.e.p.PluginsService     ] [elkos-1] no plugins loaded
[2022-06-12T00:00:33,732][INFO ][o.e.e.NodeEnvironment    ] [elkos-1] using [1] data paths, mounts [[/mnt/elasticsearch (/dev/sdb1)]], net usable_space [560.3gb], net total_space [590.4gb], types [ext4]
[2022-06-12T00:00:33,733][INFO ][o.e.e.NodeEnvironment    ] [elkos-1] heap size [2gb], compressed ordinary object pointers [true]
[2022-06-12T00:00:33,873][INFO ][o.e.n.Node               ] [elkos-1] node name [elkos-1], node ID [aPhYy1CGSaie8nvGcD4t3g], cluster name [elkos], roles [transform, data_frozen, master, remote_cluster_client, data, ml, data_content, data_hot, data_warm, data_cold, ingest]
[2022-06-12T00:00:36,411][ERROR][o.e.b.Bootstrap          ] [elkos-1] Exception
java.lang.IllegalArgumentException: unknown secure setting [conf] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:561) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:507) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:477) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:447) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:137) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.node.Node.<init>(Node.java:502) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.node.Node.<init>(Node.java:309) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) [elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) [elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157) [elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77) [elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112) [elasticsearch-cli-7.17.0.jar:7.17.0]
        at org.elasticsearch.cli.Command.main(Command.java:77) [elasticsearch-cli-7.17.0.jar:7.17.0]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122) [elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80) [elasticsearch-7.17.0.jar:7.17.0]
[2022-06-12T00:00:36,429][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [elkos-1] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: java.lang.IllegalArgumentException: unknown secure setting [conf] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112) ~[elasticsearch-cli-7.17.0.jar:7.17.0]
        at org.elasticsearch.cli.Command.main(Command.java:77) ~[elasticsearch-cli-7.17.0.jar:7.17.0]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80) ~[elasticsearch-7.17.0.jar:7.17.0]
Caused by: java.lang.IllegalArgumentException: unknown secure setting [conf] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:561) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:507) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:477) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:447) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:137) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.node.Node.<init>(Node.java:502) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.node.Node.<init>(Node.java:309) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) ~[elasticsearch-7.17.0.jar:7.17.0]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) ~[elasticsearch-7.17.0.jar:7.17.0]
        ... 6 more

dadoonet · June 15, 2022, 5:36pm

I think you tried to create a secure setting named conf.

unknown secure setting [conf]

You need to remove it.

Also use the latest 7.17 instead of 7.17.0

Lukasz1 · June 15, 2022, 8:40pm

I can't find this entry.

[root@elkos elasticsearch]# cat elasticsearch.yml |grep -v "#" | grep conf
[root@elkos elasticsearch]# cat log4j2.properties |grep -v "#" | grep conf
[root@elkos elasticsearch]# cat jvm.options |grep -v "#" | grep conf

Where should I look for this setting

dadoonet · June 16, 2022, 12:32pm

Secure settings are managed by this tool: elasticsearch-keystore | Elasticsearch Guide [8.2] | Elastic

Lukasz1 · June 16, 2022, 8:45pm

This is it. Thanks

system · July 14, 2022, 8:46pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Elasticsearch service won't start Elasticsearch	2	1714	July 9, 2020
Elasticsearch 7.13.2 linux(centos) service - Custom JVM - Doesn't start Elasticsearch	3	599	July 31, 2021
Unable to start Elasticsearch as a service Elasticsearch elastic-stack-security	6	1340	June 9, 2021
Unable to start elasticsearch when configuring SSL Elastic Security	7	636	August 22, 2023
Elasticsearch not starting Elasticsearch	3	452	July 21, 2022

Elasticsearch service won't start

Related Topics