Failed to start Elasticsearch 7.11.2

Nik1 · June 2, 2023, 10:50am

@dadoonet Below is the Elasticsearch logs taken now

[2023-06-02T09:31:07,518][INFO ][o.e.n.Node               ] [elasticsearch] version[7.11.2], pid[19380], build[default/deb/3e5a16cfec50876d20ea77b075070932c6464c7d/2021-03-06T05:54:38.141101Z], OS[Linux/5.4.0-1057-aws/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/15.0.1/15.0.1+9]
[2023-06-02T09:31:07,581][INFO ][o.e.n.Node               ] [elasticsearch] JVM home [/usr/share/elasticsearch/jdk], using bundled JDK [true]
[2023-06-02T09:31:07,584][INFO ][o.e.n.Node               ] [elasticsearch] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms2g, -Xmx2g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/var/log/elasticsearch, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/elasticsearch/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -XX:MaxDirectMemorySize=1073741824, -XX:G1HeapRegionSize=4m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=deb, -Des.bundled_jdk=true]
[2023-06-02T09:31:16,134][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [aggs-matrix-stats]
[2023-06-02T09:31:16,135][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [analysis-common]
[2023-06-02T09:31:16,135][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [constant-keyword]
[2023-06-02T09:31:16,136][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [flattened]
[2023-06-02T09:31:16,137][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [frozen-indices]
[2023-06-02T09:31:16,138][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [ingest-common]
[2023-06-02T09:31:16,138][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [ingest-geoip]
[2023-06-02T09:31:16,138][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [ingest-user-agent]
[2023-06-02T09:31:16,139][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [kibana]
[2023-06-02T09:31:16,139][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [lang-expression]
[2023-06-02T09:31:16,141][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [lang-mustache]
[2023-06-02T09:31:16,142][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [lang-painless]
[2023-06-02T09:31:16,142][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [mapper-extras]
[2023-06-02T09:31:16,143][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [mapper-version]
[2023-06-02T09:31:16,144][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [parent-join]
[2023-06-02T09:31:16,144][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [percolator]
[2023-06-02T09:31:16,144][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [rank-eval]
[2023-06-02T09:31:16,145][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [reindex]
[2023-06-02T09:31:16,145][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [repositories-metering-api]
[2023-06-02T09:31:16,146][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [repository-url]
[2023-06-02T09:31:16,146][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [search-business-rules]
[2023-06-02T09:31:16,147][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [searchable-snapshots]
[2023-06-02T09:31:16,150][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [spatial]
[2023-06-02T09:31:16,151][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [systemd]
[2023-06-02T09:31:16,151][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [transform]
[2023-06-02T09:31:16,152][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [transport-netty4]
[2023-06-02T09:31:16,153][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [unsigned-long]
[2023-06-02T09:31:16,154][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [vectors]
[2023-06-02T09:31:16,154][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [wildcard]
[2023-06-02T09:31:16,154][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-aggregate-metric]
[2023-06-02T09:31:16,155][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-analytics]
[2023-06-02T09:31:16,155][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-async]
[2023-06-02T09:31:16,156][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-async-search]
[2023-06-02T09:31:16,156][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-autoscaling]
[2023-06-02T09:31:16,156][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ccr]
[2023-06-02T09:31:16,157][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-core]
[2023-06-02T09:31:16,157][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-data-streams]
[2023-06-02T09:31:16,157][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-deprecation]
[2023-06-02T09:31:16,158][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-enrich]
[2023-06-02T09:31:16,158][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-eql]
[2023-06-02T09:31:16,159][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-fleet]
[2023-06-02T09:31:16,160][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-graph]
[2023-06-02T09:31:16,160][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-identity-provider]
[2023-06-02T09:31:16,160][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ilm]
[2023-06-02T09:31:16,160][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ingest]
[2023-06-02T09:31:16,161][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-logstash]
[2023-06-02T09:31:16,161][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ml]
[2023-06-02T09:31:16,161][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-monitoring]
[2023-06-02T09:31:16,162][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ql]
[2023-06-02T09:31:16,162][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-rollup]
[2023-06-02T09:31:16,162][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-runtime-fields]
[2023-06-02T09:31:16,162][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-security]
[2023-06-02T09:31:16,163][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-sql]
[2023-06-02T09:31:16,163][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-stack]
[2023-06-02T09:31:16,163][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-voting-only-node]
[2023-06-02T09:31:16,163][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-watcher]
[2023-06-02T09:31:16,164][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded plugin [repository-s3]
[2023-06-02T09:31:16,242][INFO ][o.e.e.NodeEnvironment    ] [elasticsearch] using [1] data paths, mounts [[/ (/dev/nvme0n1p1)]], net usable_space [205.6gb], net total_space [387.7gb], types [ext4]
[2023-06-02T09:31:16,243][INFO ][o.e.e.NodeEnvironment    ] [elasticsearch] heap size [2gb], compressed ordinary object pointers [true]
[2023-06-02T09:31:18,187][INFO ][o.e.n.Node               ] [elasticsearch] node name [elasticsearch], node ID [BVzpIFi0QcCX3pgcTFdZew], cluster name [elasticsearch], roles [transform, master, remote_cluster_client, data, ml, data_content, data_hot, data_warm, data_cold, ingest]
[2023-06-02T09:31:23,525][ERROR][o.e.b.Bootstrap          ] [elasticsearch] Exception
java.lang.IllegalArgumentException: unknown secure setting [AKIA2OEL6HUQHLHZRQ57] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:533) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:478) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:449) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:420) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:138) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.node.Node.<init>(Node.java:395) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.node.Node.<init>(Node.java:278) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:216) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:216) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:387) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:75) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:116) [elasticsearch-cli-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.Command.main(Command.java:79) [elasticsearch-cli-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:81) [elasticsearch-7.11.2.jar:7.11.2]
[2023-06-02T09:31:23,534][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [elasticsearch] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: java.lang.IllegalArgumentException: unknown secure setting [AKIA2OEL6HUQHLHZRQ57] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:75) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:116) ~[elasticsearch-cli-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.Command.main(Command.java:79) ~[elasticsearch-cli-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:81) ~[elasticsearch-7.11.2.jar:7.11.2]
Caused by: java.lang.IllegalArgumentException: unknown secure setting [AKIA2OEL6HUQHLHZRQ57] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:533) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:478) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:449) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:420) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:138) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.node.Node.<init>(Node.java:395) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.node.Node.<init>(Node.java:278) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:216) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:216) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:387) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.11.2.jar:7.11.2]
        ... 6 more
[2023-06-02T09:53:52,271][INFO ][o.e.n.Node               ] [elasticsearch] version[7.11.2], pid[20808], build[default/deb/3e5a16cfec50876d20ea77b075070932c6464c7d/2021-03-06T05:54:38.141101Z], OS[Linux/5.4.0-1057-aws/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/15.0.1/15.0.1+9]
[2023-06-02T09:53:52,277][INFO ][o.e.n.Node               ] [elasticsearch] JVM home [/usr/share/elasticsearch/jdk], using bundled JDK [true]
[2023-06-02T09:53:52,278][INFO ][o.e.n.Node               ] [elasticsearch] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms2g, -Xmx2g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/var/log/elasticsearch, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/elasticsearch/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -XX:MaxDirectMemorySize=1073741824, -XX:G1HeapRegionSize=4m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=deb, -Des.bundled_jdk=true]
[2023-06-02T09:53:57,144][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [aggs-matrix-stats]
[2023-06-02T09:53:57,145][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [analysis-common]
[2023-06-02T09:53:57,146][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [constant-keyword]
[2023-06-02T09:53:57,147][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [flattened]
[2023-06-02T09:53:57,147][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [frozen-indices]
[2023-06-02T09:53:57,148][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [ingest-common]
[2023-06-02T09:53:57,149][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [ingest-geoip]
[2023-06-02T09:53:57,149][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [ingest-user-agent]
[2023-06-02T09:53:57,149][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [kibana]
[2023-06-02T09:53:57,149][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [lang-expression]
[2023-06-02T09:53:57,150][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [lang-mustache]
[2023-06-02T09:53:57,150][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [lang-painless]
[2023-06-02T09:53:57,151][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [mapper-extras]
[2023-06-02T09:53:57,152][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [mapper-version]
[2023-06-02T09:53:57,152][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [parent-join]
[2023-06-02T09:53:57,152][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [percolator]
[2023-06-02T09:53:57,153][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [rank-eval]
[2023-06-02T09:53:57,153][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [reindex]
[2023-06-02T09:53:57,154][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [repositories-metering-api]
[2023-06-02T09:53:57,155][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [repository-url]
[2023-06-02T09:53:57,155][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [search-business-rules]
[2023-06-02T09:53:57,156][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [searchable-snapshots]
[2023-06-02T09:53:57,157][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [spatial]
[2023-06-02T09:53:57,159][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [systemd]
[2023-06-02T09:53:57,159][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [transform]
[2023-06-02T09:53:57,160][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [transport-netty4]
[2023-06-02T09:53:57,161][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [unsigned-long]
[2023-06-02T09:53:57,161][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [vectors]
[2023-06-02T09:53:57,161][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [wildcard]
[2023-06-02T09:53:57,162][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-aggregate-metric]
[2023-06-02T09:53:57,162][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-analytics]
[2023-06-02T09:53:57,163][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-async]
[2023-06-02T09:53:57,163][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-async-search]
[2023-06-02T09:53:57,164][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-autoscaling]
[2023-06-02T09:53:57,164][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ccr]
[2023-06-02T09:53:57,165][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-core]
[2023-06-02T09:53:57,165][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-data-streams]
[2023-06-02T09:53:57,165][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-deprecation]
[2023-06-02T09:53:57,166][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-enrich]
[2023-06-02T09:53:57,167][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-eql]
[2023-06-02T09:53:57,169][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-fleet]
[2023-06-02T09:53:57,170][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-graph]
[2023-06-02T09:53:57,171][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-identity-provider]
[2023-06-02T09:53:57,171][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ilm]
[2023-06-02T09:53:57,171][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ingest]
[2023-06-02T09:53:57,171][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-logstash]
[2023-06-02T09:53:57,172][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ml]
[2023-06-02T09:53:57,172][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-monitoring]
[2023-06-02T09:53:57,172][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ql]
[2023-06-02T09:53:57,173][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-rollup]
[2023-06-02T09:53:57,174][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-runtime-fields]
[2023-06-02T09:53:57,174][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-security]
[2023-06-02T09:53:57,174][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-sql]
[2023-06-02T09:53:57,175][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-stack]
[2023-06-02T09:53:57,175][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-voting-only-node]
[2023-06-02T09:53:57,176][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-watcher]
[2023-06-02T09:53:57,177][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded plugin [repository-s3]
[2023-06-02T09:53:57,291][INFO ][o.e.e.NodeEnvironment    ] [elasticsearch] using [1] data paths, mounts [[/ (/dev/nvme0n1p1)]], net usable_space [205.5gb], net total_space [387.7gb], types [ext4]
[2023-06-02T09:53:57,294][INFO ][o.e.e.NodeEnvironment    ] [elasticsearch] heap size [2gb], compressed ordinary object pointers [true]
[2023-06-02T09:53:59,196][INFO ][o.e.n.Node               ] [elasticsearch] node name [elasticsearch], node ID [BVzpIFi0QcCX3pgcTFdZew], cluster name [elasticsearch], roles [transform, master, remote_cluster_client, data, ml, data_content, data_hot, data_warm, data_cold, ingest]

Nik1 · June 2, 2023, 10:51am

[2023-06-02T09:54:04,289][ERROR][o.e.b.Bootstrap          ] [elasticsearch] Exception
java.lang.IllegalArgumentException: unknown secure setting [AKIA2OEL6HUQHLHZRQ57] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:533) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:478) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:449) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:420) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:138) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.node.Node.<init>(Node.java:395) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.node.Node.<init>(Node.java:278) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:216) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:216) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:387) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:75) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:116) [elasticsearch-cli-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.Command.main(Command.java:79) [elasticsearch-cli-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:81) [elasticsearch-7.11.2.jar:7.11.2]
[2023-06-02T09:54:04,296][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [elasticsearch] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: java.lang.IllegalArgumentException: unknown secure setting [AKIA2OEL6HUQHLHZRQ57] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:75) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:116) ~[elasticsearch-cli-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.Command.main(Command.java:79) ~[elasticsearch-cli-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:81) ~[elasticsearch-7.11.2.jar:7.11.2]
Caused by: java.lang.IllegalArgumentException: unknown secure setting [AKIA2OEL6HUQHLHZRQ57] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:533) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:478) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:449) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:420) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:138) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.node.Node.<init>(Node.java:395) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.node.Node.<init>(Node.java:278) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:216) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:216) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:387) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.11.2.jar:7.11.2]
        ... 6 more
[2023-06-02T10:34:20,808][INFO ][o.e.n.Node               ] [elasticsearch] version[7.11.2], pid[907], build[default/deb/3e5a16cfec50876d20ea77b075070932c6464c7d/2021-03-06T05:54:38.141101Z], OS[Linux/5.4.0-1057-aws/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/15.0.1/15.0.1+9]
[2023-06-02T10:34:20,843][INFO ][o.e.n.Node               ] [elasticsearch] JVM home [/usr/share/elasticsearch/jdk], using bundled JDK [true]
[2023-06-02T10:34:20,844][INFO ][o.e.n.Node               ] [elasticsearch] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms2g, -Xmx2g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/var/log/elasticsearch, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/elasticsearch/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -XX:MaxDirectMemorySize=1073741824, -XX:G1HeapRegionSize=4m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=deb, -Des.bundled_jdk=true]
[2023-06-02T10:34:44,823][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [aggs-matrix-stats]
[2023-06-02T10:34:44,824][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [analysis-common]
[2023-06-02T10:34:44,824][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [constant-keyword]
[2023-06-02T10:34:44,825][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [flattened]
[2023-06-02T10:34:44,830][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [frozen-indices]
[2023-06-02T10:34:44,831][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [ingest-common]
[2023-06-02T10:34:44,832][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [ingest-geoip]
[2023-06-02T10:34:44,832][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [ingest-user-agent]
[2023-06-02T10:34:44,832][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [kibana]
[2023-06-02T10:34:44,842][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [lang-expression]
[2023-06-02T10:34:44,843][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [lang-mustache]
[2023-06-02T10:34:44,843][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [lang-painless]
[2023-06-02T10:34:44,844][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [mapper-extras]
[2023-06-02T10:34:44,845][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [mapper-version]
[2023-06-02T10:34:44,845][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [parent-join]
[2023-06-02T10:34:44,845][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [percolator]
[2023-06-02T10:34:44,854][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [rank-eval]
[2023-06-02T10:34:44,855][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [reindex]
[2023-06-02T10:34:44,855][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [repositories-metering-api]
[2023-06-02T10:34:44,856][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [repository-url]
[2023-06-02T10:34:44,856][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [search-business-rules]
[2023-06-02T10:34:44,856][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [searchable-snapshots]
[2023-06-02T10:34:44,870][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [spatial]
[2023-06-02T10:34:44,871][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [systemd]
[2023-06-02T10:34:44,871][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [transform]
[2023-06-02T10:34:44,872][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [transport-netty4]
[2023-06-02T10:34:44,873][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [unsigned-long]
[2023-06-02T10:34:44,873][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [vectors]
[2023-06-02T10:34:44,873][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [wildcard]
[2023-06-02T10:34:44,886][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-aggregate-metric]
[2023-06-02T10:34:44,886][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-analytics]
[2023-06-02T10:34:44,887][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-async]
[2023-06-02T10:34:44,887][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-async-search]
[2023-06-02T10:34:44,888][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-autoscaling]
[2023-06-02T10:34:44,888][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ccr]
[2023-06-02T10:34:44,898][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-core]
[2023-06-02T10:34:44,898][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-data-streams]
[2023-06-02T10:34:44,899][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-deprecation]
[2023-06-02T10:34:44,899][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-enrich]
[2023-06-02T10:34:44,900][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-eql]
[2023-06-02T10:34:44,901][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-fleet]
[2023-06-02T10:34:44,907][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-graph]
[2023-06-02T10:34:44,908][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-identity-provider]
[2023-06-02T10:34:44,908][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ilm]
[2023-06-02T10:34:44,908][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ingest]
[2023-06-02T10:34:44,908][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-logstash]
[2023-06-02T10:34:44,908][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ml]
[2023-06-02T10:34:44,909][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-monitoring]
[2023-06-02T10:34:44,909][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-ql]
[2023-06-02T10:34:44,919][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-rollup]
[2023-06-02T10:34:44,919][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-runtime-fields]
[2023-06-02T10:34:44,919][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-security]
[2023-06-02T10:34:44,920][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-sql]
[2023-06-02T10:34:44,922][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-stack]
[2023-06-02T10:34:44,923][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-voting-only-node]
[2023-06-02T10:34:44,934][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded module [x-pack-watcher]
[2023-06-02T10:34:44,936][INFO ][o.e.p.PluginsService     ] [elasticsearch] loaded plugin [repository-s3]
[2023-06-02T10:34:45,301][INFO ][o.e.e.NodeEnvironment    ] [elasticsearch] using [1] data paths, mounts [[/ (/dev/nvme0n1p1)]], net usable_space [206gb], net total_space [387.7gb], types [ext4]
[2023-06-02T10:34:45,301][INFO ][o.e.e.NodeEnvironment    ] [elasticsearch] heap size [2gb], compressed ordinary object pointers [true]
[2023-06-02T10:34:55,312][INFO ][o.e.n.Node               ] [elasticsearch] node name [elasticsearch], node ID [BVzpIFi0QcCX3pgcTFdZew], cluster name [elasticsearch], roles [transform, master, remote_cluster_client, data, ml, data_content, data_hot, data_warm, data_cold, ingest]
[2023-06-02T10:35:16,202][ERROR][o.e.b.Bootstrap          ] [elasticsearch] Exception
java.lang.IllegalArgumentException: unknown secure setting [AKIA2OEL6HUQHLHZRQ57] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:533) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:478) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:449) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:420) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:138) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.node.Node.<init>(Node.java:395) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.node.Node.<init>(Node.java:278) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:216) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:216) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:387) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:75) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:116) [elasticsearch-cli-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.Command.main(Command.java:79) [elasticsearch-cli-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) [elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:81) [elasticsearch-7.11.2.jar:7.11.2]
[2023-06-02T10:35:16,243][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [elasticsearch] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: java.lang.IllegalArgumentException: unknown secure setting [AKIA2OEL6HUQHLHZRQ57] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:75) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:116) ~[elasticsearch-cli-7.11.2.jar:7.11.2]
        at org.elasticsearch.cli.Command.main(Command.java:79) ~[elasticsearch-cli-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:81) ~[elasticsearch-7.11.2.jar:7.11.2]
Caused by: java.lang.IllegalArgumentException: unknown secure setting [AKIA2OEL6HUQHLHZRQ57] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:533) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:478) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:449) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:420) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:138) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.node.Node.<init>(Node.java:395) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.node.Node.<init>(Node.java:278) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:216) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:216) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:387) ~[elasticsearch-7.11.2.jar:7.11.2]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.11.2.jar:7.11.2]

Christian_Dahlqvist · June 2, 2023, 11:09am

Nik1:

[2023-06-02T10:35:16,202][ERROR][o.e.b.Bootstrap          ] [elasticsearch] Exception
java.lang.IllegalArgumentException: unknown secure setting [AKIA2OEL6HUQHLHZRQ57] please check that any required plugins are installed, or check the breaking changes documentation for removed settings

As you can see there is a new unknown setting Elasticsearch complains about. Are you sure you have shown us the complete configuration file?

Nik1 · June 2, 2023, 11:18am

@Christian_Dahlqvist [AKIA2OEL6HUQHLHZRQ57] this key is s3 bucket access key

Christian_Dahlqvist · June 2, 2023, 11:20am

Is that in the config file? Elasticsearch thinks there is something wrong about it.

Nik1 · June 2, 2023, 11:23am

No this key is not in the elasticsearch.yml config file

These are the commands used to integrate the s3 bucket keys.

/usr/share/elasticsearch/bin/elasticsearch-keystore add s3.client.default.access_key

/usr/share/elasticsearch/bin/elasticsearch-keystore add s3.client.default.secret_key

Christian_Dahlqvist · June 2, 2023, 11:24am

Do you have the S3 repository plugin installed?

Nik1 · June 2, 2023, 11:32am

@Christian_Dahlqvist I can see a "repository-s3" is available in "/etc/elasticsearch" and "/usr/share/elasticsearch/plugins" path . Is that the correct one? any idea?

:/etc/elasticsearch# ls
1                       elasticsearch.yml         elasticsearch.yml.bak.3.13  elasticsearch1.yml  jvm.options.backup20230601  jvm.options.dpkg-dist  role_mapping.yml  users_roles
certs                   elasticsearch.yml.back    elasticsearch.yml.save      jvm.options         jvm.options.bak             log4j2.properties      roles.yml
elasticsearch.keystore  elasticsearch.yml.backup  elasticsearch.yml_backup    jvm.options.backup  jvm.options.d               repository-s3          users

:/usr/share/elasticsearch/plugins# ls
repository-s3

dadoonet · June 2, 2023, 12:39pm

You wrongly entered the secured setting.

You need to remove AKIA2OEL6HUQHLHZRQ57 as this is the value and not the setting name.

Nik1 · June 2, 2023, 12:48pm

@dadoonet I used the below commands for it, it has asked for entering the value after entering these commands

/usr/share/elasticsearch/bin/elasticsearch-keystore add s3.client.default.access_key

/usr/share/elasticsearch/bin/elasticsearch-keystore add s3.client.default.secret_key

Nik1 · June 2, 2023, 12:49pm

@dadoonet
You need to remove AKIA2OEL6HUQHLHZRQ57 as this is the value and not the setting name. >> any idea how to remove it now?

leandrojmp · June 2, 2023, 12:51pm

It is in the documentation.

You need to run elasticsearch-keystore remove SETTING-TO-REMOVE

In this case:

elasticsearch-keystore remove AKIA2OEL6HUQHLHZRQ57

Nik1 · June 7, 2023, 6:08am

@leandrojmp

I used the below command to remove it. Elasticsearch service is starting now

/usr/share/elasticsearch/bin/elasticsearch-keystore remove AKIA2OEL6HUQHLHZRQ57

@Christian_Dahlqvist @leandrojmp @dadoonet Thank you so much guys for the quick turnaround.

Nik1 · June 7, 2023, 12:31pm

Now I am encountering another issue. It says "Kibana server is not ready yet" frequently even though Kibana, elasticsearch, logstash, filebeat all are active. I end up rebooting the machine then the Kibana URL comes up and I am able to login, but after few minutes it again says "Kibana server is not ready yet"

dadoonet · June 7, 2023, 2:58pm

I'd suggest that you open a new discussion as this one is solved.

You can add your discussion to #elastic-stack:kibana

Nik1 · June 8, 2023, 5:43am

@dadoonet The issue is resolved. Thank you

system · July 6, 2023, 5:44am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.