Set up minimal security elasticsearch failed

Elastic Stack Elasticsearch
1

i try setup minimal security in here Set up minimal security for Elasticsearch | Elasticsearch Guide [7.12] | Elastic but still failed,

and this the complete log i had. i will separate in 7 parts. please help why?

[2021-04-16T15:35:19,816][INFO ][o.e.n.Node               ] [node-1] version[7.10.1], pid[27062], build[default/rpm/1c34507e66d7db1211f66f3513706fdf548736aa/2020-12-05T01:00:33.671820Z], OS[Linux/3.10.0-1127.el7.x86_64/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/15.0.1/15.0.1+9]
[2021-04-16T15:35:19,819][INFO ][o.e.n.Node               ] [node-1] JVM home [/usr/share/elasticsearch/jdk], using bundled JDK [true]
[2021-04-16T15:35:19,820][INFO ][o.e.n.Node               ] [node-1] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/elasticsearch-9017935533718663971, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/elasticsearch/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -XX:MaxDirectMemorySize=536870912, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=rpm, -Des.bundled_jdk=true]
[2021-04-16T15:35:21,843][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [aggs-matrix-stats]
[2021-04-16T15:35:21,844][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [analysis-common]
[2021-04-16T15:35:21,844][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [constant-keyword]
[2021-04-16T15:35:21,844][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [flattened]
[2021-04-16T15:35:21,845][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [frozen-indices]
[2021-04-16T15:35:21,845][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [ingest-common]
[2021-04-16T15:35:21,845][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [ingest-geoip]
[2021-04-16T15:35:21,845][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [ingest-user-agent]
[2021-04-16T15:35:21,845][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [kibana]
[2021-04-16T15:35:21,846][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [lang-expression]
[2021-04-16T15:35:21,846][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [lang-mustache]
[2021-04-16T15:35:21,846][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [lang-painless]
[2021-04-16T15:35:21,846][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [mapper-extras]
[2021-04-16T15:35:21,846][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [mapper-version]
[2021-04-16T15:35:21,847][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [parent-join]
[2021-04-16T15:35:21,847][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [percolator]
[2021-04-16T15:35:21,847][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [rank-eval]
[2021-04-16T15:35:21,847][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [reindex]
[2021-04-16T15:35:21,847][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [repositories-metering-api]
[2021-04-16T15:35:21,847][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [repository-url]
[2021-04-16T15:35:21,848][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [search-business-rules]
[2021-04-16T15:35:21,848][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [searchable-snapshots]
[2021-04-16T15:35:21,848][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [spatial]
[2021-04-16T15:35:21,848][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [systemd]
[2021-04-16T15:35:21,848][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [transform]
[2021-04-16T15:35:21,848][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [transport-netty4]
[2021-04-16T15:35:21,848][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [unsigned-long]
[2021-04-16T15:35:21,849][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [vectors]
[2021-04-16T15:35:21,849][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [wildcard]
[2021-04-16T15:35:21,849][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-analytics]
[2021-04-16T15:35:21,849][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-async]
[2021-04-16T15:35:21,849][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-async-search]
[2021-04-16T15:35:21,849][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-autoscaling]
[2021-04-16T15:35:21,849][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-ccr]
[2021-04-16T15:35:21,849][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-core]
[2021-04-16T15:35:21,850][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-data-streams]
[2021-04-16T15:35:21,850][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-deprecation]
[2021-04-16T15:35:21,850][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-enrich]
[2021-04-16T15:35:21,850][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-eql]
[2021-04-16T15:35:21,850][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-graph]
[2021-04-16T15:35:21,850][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-identity-provider]
[2021-04-16T15:35:21,850][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-ilm]
[2021-04-16T15:35:21,850][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-logstash]
[2021-04-16T15:35:21,851][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-ml]
[2021-04-16T15:35:21,851][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-monitoring]
[2021-04-16T15:35:21,851][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-ql]
[2021-04-16T15:35:21,851][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-rollup]
[2021-04-16T15:35:21,851][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-security]
[2021-04-16T15:35:21,851][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-sql]
[2021-04-16T15:35:21,851][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-stack]
[2021-04-16T15:35:21,851][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-voting-only-node]
[2021-04-16T15:35:21,852][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-watcher]
[2021-04-16T15:35:21,852][INFO ][o.e.p.PluginsService     ] [node-1] no plugins loaded
[2021-04-16T15:35:21,895][INFO ][o.e.e.NodeEnvironment    ] [node-1] using [1] data paths, mounts [[/var (/dev/mapper/rhel-var)]], net usable_space [13gb], net total_space [19.9gb], types [xfs]
[2021-04-16T15:35:21,895][INFO ][o.e.e.NodeEnvironment    ] [node-1] heap size [1gb], compressed ordinary object pointers [true]
[2021-04-16T15:35:21,997][INFO ][o.e.n.Node               ] [node-1] node name [node-1], node ID [Xu3toSe1QuCfHghvSMnTuw], cluster name [my-cluster], roles [transform, master, remote_cluster_client, data, ml, data_content, data_hot, data_warm, data_cold, ingest]
[2021-04-16T15:35:24,993][ERROR][o.e.b.Bootstrap          ] [node-1] Exception
org.elasticsearch.ElasticsearchSecurityException: failed to load SSL configuration
2

part 2

[xpack.security.transport.ssl]
at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:528) ~[?:?]
at java.util.HashMap.forEach(HashMap.java:1425) ~[?:?]
at java.util.Collections$UnmodifiableMap.forEach(Collections.java:1521) ~[?:?]
at org.elasticsearch.xpack.core.ssl.SSLService.loadSSLConfigurations(SSLService.java:524) ~[?:?]
at org.elasticsearch.xpack.core.ssl.SSLService.(SSLService.java:142) ~[?:?]
at org.elasticsearch.xpack.core.XPackPlugin.createSSLService(XPackPlugin.java:455) ~[?:?]
at org.elasticsearch.xpack.core.XPackPlugin.createComponents(XPackPlugin.java:288) ~[?:?]
at org.elasticsearch.node.Node.lambda$new$15(Node.java:553) ~[elasticsearch-7.10.1.jar:7.10.1]
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
at org.elasticsearch.node.Node.(Node.java:557) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.node.Node.(Node.java:289) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:393) [elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) [elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:161) [elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) [elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:127) [elasticsearch-cli-7.10.1.jar:7.10.1]
at org.elasticsearch.cli.Command.main(Command.java:90) [elasticsearch-cli-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:126) [elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) [elasticsearch-7.10.1.jar:7.10.1]
Caused by: org.elasticsearch.ElasticsearchException: failed to initialize SSL TrustManager - truststore file [/etc/elasticsearch/node-1.p12] does not exist
at org.elasticsearch.xpack.core.ssl.TrustConfig.missingTrustConfigFile(TrustConfig.java:113) ~[?:?]
at org.elasticsearch.xpack.core.ssl.StoreTrustConfig.createTrustManager(StoreTrustConfig.java:68) ~[?:?]
at org.elasticsearch.xpack.core.ssl.SSLService.createSslContext(SSLService.java:437) ~[?:?]
at java.util.HashMap.computeIfAbsent(HashMap.java:1224) ~[?:?]
at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:526) ~[?:?]
... 26 more
Caused by: java.nio.file.NoSuchFileException: /etc/elasticsearch/node-1.p12
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:92) ~[?:?]
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106) ~[?:?]
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) ~[?:?]
at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:218) ~[?:?]
at java.nio.file.Files.newByteChannel(Files.java:375) ~[?:?]
at java.nio.file.Files.newByteChannel(Files.java:426) ~[?:?]
at java.nio.file.spi.FileSystemProvider.newInputStream(FileSystemProvider.java:420) ~[?:?]
at java.nio.file.Files.newInputStream(Files.java:160) ~[?:?]
at org.elasticsearch.xpack.core.ssl.TrustConfig.getStore(TrustConfig.java:95) ~[?:?]
at org.elasticsearch.xpack.core.ssl.StoreTrustConfig.createTrustManager(StoreTrustConfig.java:65) ~[?:?]
at org.elasticsearch.xpack.core.ssl.SSLService.createSslContext(SSLService.java:437) ~[?:?]
at java.util.HashMap.computeIfAbsent(HashMap.java:1224) ~[?:?]
at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:526) ~[?:?]
... 26 more
[2021-04-16T15:35:24,999][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-1] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: ElasticsearchSecurityException[failed to load SSL configuration [xpack.security.transport.ssl]]; nested: ElasticsearchException[failed to initialize SSL TrustManager - truststore file [/etc/elasticsearch/node-1.p12] does not exist]; nested: NoSuchFileException[/etc/elasticsearch/node-1.p12];
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:174) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:161) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:127) ~[elasticsearch-cli-7.10.1.jar:7.10.1]
at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:126) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.10.1.jar:7.10.1]
Caused by: org.elasticsearch.ElasticsearchSecurityException: failed to load SSL configuration [xpack.security.transport.ssl]
at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:528) ~[?:?]
at java.util.HashMap.forEach(HashMap.java:1425) ~[?:?]
at java.util.Collections$UnmodifiableMap.forEach(Collections.java:1521) ~[?:?]
at org.elasticsearch.xpack.core.ssl.SSLService.loadSSLConfigurations(SSLService.java:524) ~[?:?]
at org.elasticsearch.xpack.core.ssl.SSLService.(SSLService.java:142) ~[?:?]
at org.elasticsearch.xpack.core.XPackPlugin.createSSLService(XPackPlugin.java:455) ~[?:?]
at org.elasticsearch.xpack.core.XPackPlugin.createComponents(XPackPlugin.java:288) ~[?:?]
at org.elasticsearch.node.Node.lambda$new$15(Node.java:553) ~[elasticsearch-7.10.1.jar:7.10.1]
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
at org.elasticsearch.node.Node.(Node.java:557) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.node.Node.(Node.java:289) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:393) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.10.1.jar:7.10.1]
... 6 more
Caused by: org.elasticsearch.ElasticsearchException: failed to initialize SSL TrustManager - truststore file [/etc/elasticsearch/node-1.p12] does not exist
at org.elasticsearch.xpack.core.ssl.TrustConfig.missingTrustConfigFile(TrustConfig.java:113) ~[?:?]
at org.elasticsearch.xpack.core.ssl.StoreTrustConfig.createTrustManager(StoreTrustConfig.java:68) ~[?:?]
at org.elasticsearch.xpack.core.ssl.SSLService.createSslContext(SSLService.java:437) ~[?:?]
at java.util.HashMap.computeIfAbsent(HashMap.java:1224) ~[?:?]
at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:526) ~[?:?]
at java.util.HashMap.forEach(HashMap.java:1425) ~[?:?]
at java.util.Collections$UnmodifiableMap.forEach(Collections.java:1521) ~[?:?]
at org.elasticsearch.xpack.core.ssl.SSLService.loadSSLConfigurations(SSLService.java:524) ~[?:?]
at org.elasticsearch.xpack.core.ssl.SSLService.(SSLService.java:142) ~[?:?]
at org.elasticsearch.xpack.core.XPackPlugin.createSSLService(XPackPlugin.java:455) ~[?:?]
at org.elasticsearch.xpack.core.XPackPlugin.createComponents(XPackPlugin.java:288) ~[?:?]
at org.elasticsearch.node.Node.lambda$new$15(Node.java:553) ~[elasticsearch-7.10.1.jar:7.10.1]
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
at org.elasticsearch.node.Node.(Node.java:557) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.node.Node.(Node.java:289) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:393) ~[elasticsearch-7.10.1.jar:7.10.1]
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.10.1.jar:7.10.1]
... 6 more
Caused by: java.nio.file.NoSuchFileException: /etc/elasticsearch/node-1.p12
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:92) ~[?:?]
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106) ~[?:?]
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) ~[?:?]
at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:218) ~[?:?]
at java.nio.file.Files.newByteChannel(Files.java:375) ~[?:?]
at java.nio.file.Files.newByteChannel(Files.java:426) ~[?:?]
at java.nio.file.spi.FileSystemProvider.newInputStream(FileSystemProvider.java:420) ~[?:?]
at java.nio.file.Files.newInputStream(Files.java:160) ~[?:?]
at org.elasticsearch.xpack.core.ssl.TrustConfig.getStore(TrustConfig.java:95) ~[?:?]
at

3 
org.elasticsearch.xpack.core.ssl.StoreTrustConfig.createTrustManager(StoreTrustConfig.java:65) ~[?:?]
                at org.elasticsearch.xpack.core.ssl.SSLService.createSslContext(SSLService.java:437) ~[?:?]
                at java.util.HashMap.computeIfAbsent(HashMap.java:1224) ~[?:?]
                at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:526) ~[?:?]
                at java.util.HashMap.forEach(HashMap.java:1425) ~[?:?]
                at java.util.Collections$UnmodifiableMap.forEach(Collections.java:1521) ~[?:?]
                at org.elasticsearch.xpack.core.ssl.SSLService.loadSSLConfigurations(SSLService.java:524) ~[?:?]
                at org.elasticsearch.xpack.core.ssl.SSLService.<init>(SSLService.java:142) ~[?:?]
                at org.elasticsearch.xpack.core.XPackPlugin.createSSLService(XPackPlugin.java:455) ~[?:?]
                at org.elasticsearch.xpack.core.XPackPlugin.createComponents(XPackPlugin.java:288) ~[?:?]
                at org.elasticsearch.node.Node.lambda$new$15(Node.java:553) ~[elasticsearch-7.10.1.jar:7.10.1]
                at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
                at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]
                at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
                at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
                at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
                at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
                at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
                at org.elasticsearch.node.Node.<init>(Node.java:557) ~[elasticsearch-7.10.1.jar:7.10.1]
                at org.elasticsearch.node.Node.<init>(Node.java:289) ~[elasticsearch-7.10.1.jar:7.10.1]
                at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
                at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
                at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:393) ~[elasticsearch-7.10.1.jar:7.10.1]
                at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.10.1.jar:7.10.1]
                ... 6 more
        [2021-04-16T15:40:01,884][INFO ][o.e.n.Node               ] [node-1] version[7.10.1], pid[27279], build[default/rpm/1c34507e66d7db1211f66f3513706fdf548736aa/2020-12-05T01:00:33.671820Z], OS[Linux/3.10.0-1127.el7.x86_64/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/15.0.1/15.0.1+9]
        [2021-04-16T15:40:01,887][INFO ][o.e.n.Node               ] [node-1] JVM home [/usr/share/elasticsearch/jdk], using bundled JDK [true]
        [2021-04-16T15:40:01,887][INFO ][o.e.n.Node               ] [node-1] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/elasticsearch-15848491951040717174, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/elasticsearch/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -XX:MaxDirectMemorySize=536870912, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=rpm, -Des.bundled_jdk=true]
4 
 [2021-04-16T15:40:03,953][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [aggs-matrix-stats]
            [2021-04-16T15:40:03,953][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [analysis-common]
            [2021-04-16T15:40:03,953][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [constant-keyword]
            [2021-04-16T15:40:03,954][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [flattened]
            [2021-04-16T15:40:03,954][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [frozen-indices]
            [2021-04-16T15:40:03,954][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [ingest-common]
            [2021-04-16T15:40:03,954][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [ingest-geoip]
            [2021-04-16T15:40:03,954][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [ingest-user-agent]
            [2021-04-16T15:40:03,954][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [kibana]
            [2021-04-16T15:40:03,954][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [lang-expression]
            [2021-04-16T15:40:03,955][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [lang-mustache]
            [2021-04-16T15:40:03,955][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [lang-painless]
            [2021-04-16T15:40:03,955][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [mapper-extras]
            [2021-04-16T15:40:03,955][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [mapper-version]
            [2021-04-16T15:40:03,955][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [parent-join]
            [2021-04-16T15:40:03,955][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [percolator]
            [2021-04-16T15:40:03,955][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [rank-eval]
            [2021-04-16T15:40:03,955][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [reindex]
            [2021-04-16T15:40:03,956][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [repositories-metering-api]
            [2021-04-16T15:40:03,956][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [repository-url]
            [2021-04-16T15:40:03,956][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [search-business-rules]
            [2021-04-16T15:40:03,956][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [searchable-snapshots]
            [2021-04-16T15:40:03,956][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [spatial]
            [2021-04-16T15:40:03,956][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [systemd]
            [2021-04-16T15:40:03,956][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [transform]
            [2021-04-16T15:40:03,956][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [transport-netty4]
            [2021-04-16T15:40:03,957][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [unsigned-long]
            [2021-04-16T15:40:03,957][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [vectors]
            [2021-04-16T15:40:03,957][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [wildcard]
            [2021-04-16T15:40:03,957][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-analytics]
            [2021-04-16T15:40:03,957][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-async]
            [2021-04-16T15:40:03,957][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-async-search]
            [2021-04-16T15:40:03,958][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-autoscaling]
            [2021-04-16T15:40:03,958][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-ccr]
            [2021-04-16T15:40:03,958][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-core]
            [2021-04-16T15:40:03,958][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-data-streams]
            [2021-04-16T15:40:03,958][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-deprecation]
            [2021-04-16T15:40:03,958][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-enrich]
            [2021-04-16T15:40:03,958][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-eql]
            [2021-04-16T15:40:03,958][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-graph]
            [2021-04-16T15:40:03,959][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-identity-provider]
            [2021-04-16T15:40:03,959][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-ilm]
            [2021-04-16T15:40:03,959][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-logstash]
            [2021-04-16T15:40:03,959][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-ml]
            [2021-04-16T15:40:03,959][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-monitoring]
            [2021-04-16T15:40:03,959][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-ql]
            [2021-04-16T15:40:03,959][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-rollup]
            [2021-04-16T15:40:03,959][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-security]
            [2021-04-16T15:40:03,960][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-sql]
            [2021-04-16T15:40:03,960][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-stack]
            [2021-04-16T15:40:03,960][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-voting-only-node]
            [2021-04-16T15:40:03,960][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-watcher]
            [2021-04-16T15:40:03,961][INFO ][o.e.p.PluginsService     ] [node-1] no plugins loaded
     [2021-04-16T15:40:04,003][INFO ][o.e.e.NodeEnvironment    ] [node-1] using [1] data paths, mounts [[/var (/dev/mapper/rhel-var)]], net usable_space [13gb], net total_space [19.9gb], types [xfs]
            [2021-04-16T15:40:04,004][INFO ][o.e.e.NodeEnvironment    ] [node-1] heap size [1gb], compressed ordinary object pointers [true]
            [2021-04-16T15:40:04,100][INFO ][o.e.n.Node               ] [node-1] node name [node-1], node ID [Xu3toSe1QuCfHghvSMnTuw], cluster name [my-cluster], roles [transform, master, remote_cluster_client, data, ml, data_content, data_hot, data_warm, data_cold, ingest]
            [2021-04-16T15:40:07,264][ERROR][o.e.b.Bootstrap          ] [node-1] Exception
            org.elasticsearch.ElasticsearchSecurityException: failed to load SSL configuration [xpack.security.transport.ssl]
                    at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:528) ~[?:?]
                    at java.util.HashMap.forEach(HashMap.java:1425) ~[?:?]
                    at java.util.Collections$UnmodifiableMap.forEach(Collections.java:1521) ~[?:?]
                    at org.elasticsearch.xpack.core.ssl.SSLService.loadSSLConfigurations(SSLService.java:524) ~[?:?]
                    at org.elasticsearch.xpack.core.ssl.SSLService.<init>(SSLService.java:142) ~[?:?]
                    at org.elasticsearch.xpack.core.XPackPlugin.createSSLService(XPackPlugin.java:455) ~[?:?]
                    at org.elasticsearch.xpack.core.XPackPlugin.createComponents(XPackPlugin.java:288) ~[?:?]
                    at org.elasticsearch.node.Node.lambda$new$15(Node.java:553) ~[elasticsearch-7.10.1.jar:7.10.1]
                    at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
                    at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]
                    at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
                    at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
                    at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
                    at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
                    at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
                    at org.elasticsearch.node.Node.<init>(Node.java:557) ~[elasticsearch-7.10.1.jar:7.10.1]
                    at org.elasticsearch.node.Node.<init>(Node.java:289) ~[elasticsearch-7.10.1.jar:7.10.1]
                    at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
                    at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
                    at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:393) [elasticsearch-7.10.1.jar:7.10.1]
                    at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) [elasticsearch-7.10.1.jar:7.10.1]
                    at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:161) [elasticsearch-7.10.1.jar:7.10.1]
                    at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) [elasticsearch-7.10.1.jar:7.10.1]
                    at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:127) [elasticsearch-cli-7.10.1.jar:7.10.1]
                    at org.elasticsearch.cli.Command.main(Command.java:90) [elasticsearch-cli-7.10.1.jar:7.10.1]
                    at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:126) [elasticsearch-7.10.1.jar:7.10.1]
                    at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) [elasticsearch-7.10.1.jar:7.10.1]
            Caused by: org.elasticsearch.ElasticsearchException: failed to initialize SSL TrustManager
                    at
5 
org.elasticsearch.xpack.core.ssl.StoreTrustConfig.createTrustManager(StoreTrustConfig.java:74) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.createSslContext(SSLService.java:437) ~[?:?]
                        at java.util.HashMap.computeIfAbsent(HashMap.java:1224) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:526) ~[?:?]
                        ... 26 more
                Caused by: java.io.IOException: keystore password was incorrect
                        at sun.security.pkcs12.PKCS12KeyStore.engineLoad(PKCS12KeyStore.java:2103) ~[?:?]
                        at sun.security.util.KeyStoreDelegator.engineLoad(KeyStoreDelegator.java:220) ~[?:?]
                        at java.security.KeyStore.load(KeyStore.java:1472) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.TrustConfig.getStore(TrustConfig.java:97) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.StoreTrustConfig.createTrustManager(StoreTrustConfig.java:65) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.createSslContext(SSLService.java:437) ~[?:?]
                        at java.util.HashMap.computeIfAbsent(HashMap.java:1224) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:526) ~[?:?]
                        ... 26 more
                Caused by: java.security.UnrecoverableKeyException: failed to decrypt safe contents entry: javax.crypto.BadPaddingException: Given final block not properly padded. Such issues can arise if a bad key is used during decryption.
                        at sun.security.pkcs12.PKCS12KeyStore.engineLoad(PKCS12KeyStore.java:2103) ~[?:?]
                        at sun.security.util.KeyStoreDelegator.engineLoad(KeyStoreDelegator.java:220) ~[?:?]
                        at java.security.KeyStore.load(KeyStore.java:1472) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.TrustConfig.getStore(TrustConfig.java:97) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.StoreTrustConfig.createTrustManager(StoreTrustConfig.java:65) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.createSslContext(SSLService.java:437) ~[?:?]
                        at java.util.HashMap.computeIfAbsent(HashMap.java:1224) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:526) ~[?:?]
                        ... 26 more
                [2021-04-16T15:40:07,271][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-1] uncaught exception in thread [main]
                org.elasticsearch.bootstrap.StartupException: ElasticsearchSecurityException[failed to load SSL configuration [xpack.security.transport.ssl]]; nested: ElasticsearchException[failed to initialize SSL TrustManager]; nested: IOException[keystore password was incorrect]; nested: UnrecoverableKeyException[failed to decrypt safe contents entry: javax.crypto.BadPaddingException: Given final block not properly padded. Such issues can arise if a bad key is used during decryption.];
                        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:174) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:161) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:127) ~[elasticsearch-cli-7.10.1.jar:7.10.1]
                        at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:126) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.10.1.jar:7.10.1]
                Caused by: org.elasticsearch.ElasticsearchSecurityException: failed to load SSL configuration [xpack.security.transport.ssl]
                        at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:528) ~[?:?]
                        at java.util.HashMap.forEach(HashMap.java:1425) ~[?:?]
                        at java.util.Collections$UnmodifiableMap.forEach(Collections.java:1521) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.loadSSLConfigurations(SSLService.java:524) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.<init>(SSLService.java:142) ~[?:?]
                        at org.elasticsearch.xpack.core.XPackPlugin.createSSLService(XPackPlugin.java:455) ~[?:?]
                        at org.elasticsearch.xpack.core.XPackPlugin.createComponents(XPackPlugin.java:288) ~[?:?]
                        at org.elasticsearch.node.Node.lambda$new$15(Node.java:553) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
                        at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]
                        at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
                        at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
                        at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
                        at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
                        at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
                        at org.elasticsearch.node.Node.<init>(Node.java:557) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.node.Node.<init>(Node.java:289) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:393) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.10.1.jar:7.10.1]
                        ... 6 more
                Caused by: org.elasticsearch.ElasticsearchException: failed to initialize SSL TrustManager
                        at org.elasticsearch.xpack.core.ssl.StoreTrustConfig.createTrustManager(StoreTrustConfig.java:74) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.createSslContext(SSLService.java:437) ~[?:?]
                        at java.util.HashMap.computeIfAbsent(HashMap.java:1224) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:526) ~[?:?]
                        at java.util.HashMap.forEach(HashMap.java:1425) ~[?:?]
                        at java.util.Collections$UnmodifiableMap.forEach(Collections.java:1521) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.loadSSLConfigurations(SSLService.java:524) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.<init>(SSLService.java:142) ~[?:?]
                        at org.elasticsearch.xpack.core.XPackPlugin.createSSLService(XPackPlugin.java:455) ~[?:?]
                        at org.elasticsearch.xpack.core.XPackPlugin.createComponents(XPackPlugin.java:288) ~[?:?]
                        at org.elasticsearch.node.Node.lambda$new$15(Node.java:553) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
                        at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]
                        at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
                        at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
                        at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
                        at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
                        at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
                        at org.elasticsearch.node.Node.<init>(Node.java:557) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.node.Node.<init>(Node.java:289) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:393) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.10.1.jar:7.10.1]
                        ... 6 more
                Caused by: java.io.IOException: keystore password was incorrect
                        at sun.security.pkcs12.PKCS12KeyStore.engineLoad(PKCS12KeyStore.java:2103) ~[?:?]
                        at sun.security.util.KeyStoreDelegator.engineLoad(KeyStoreDelegator.java:220) ~[?:?]
                        at java.security.KeyStore.load(KeyStore.java:1472) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.TrustConfig.getStore(TrustConfig.java:97) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.StoreTrustConfig.createTrustManager(StoreTrustConfig.java:65) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.createSslContext(SSLService.java:437) ~[?:?]
                        at java.util.HashMap.computeIfAbsent(HashMap.java:1224) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:526) ~[?:?]
                        at java.util.HashMap.forEach(HashMap.java:1425) ~[?:?]
                        at java.util.Collections$UnmodifiableMap.forEach(Collections.java:1521) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.loadSSLConfigurations(SSLService.java:524) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.<init>(SSLService.java:142) ~[?:?]
                        at org.elasticsearch.xpack.core.XPackPlugin.createSSLService(XPackPlugin.java:455) ~[?:?]
                        at org.elasticsearch.xpack.core.XPackPlugin.createComponents(XPackPlugin.java:288) ~[?:?]
                        at org.elasticsearch.node.Node.lambda$new$15(Node.java:553) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
                        at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]
                        at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
                        at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
                        at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
                        at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
                        at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
                        at org.elasticsearch.node.Node.<init>(Node.java:557) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.node.Node.<init>(Node.java:289) ~[elasticsearch-7.10.1.jar:7.10.1]
6 
                        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:393) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.10.1.jar:7.10.1]
                        ... 6 more
                Caused by: java.security.UnrecoverableKeyException: failed to decrypt safe contents entry: javax.crypto.BadPaddingException: Given final block not properly padded. Such issues can arise if a bad key is used during decryption.
                        at sun.security.pkcs12.PKCS12KeyStore.engineLoad(PKCS12KeyStore.java:2103) ~[?:?]
                        at sun.security.util.KeyStoreDelegator.engineLoad(KeyStoreDelegator.java:220) ~[?:?]
                        at java.security.KeyStore.load(KeyStore.java:1472) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.TrustConfig.getStore(TrustConfig.java:97) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.StoreTrustConfig.createTrustManager(StoreTrustConfig.java:65) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.createSslContext(SSLService.java:437) ~[?:?]
                        at java.util.HashMap.computeIfAbsent(HashMap.java:1224) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:526) ~[?:?]
                        at java.util.HashMap.forEach(HashMap.java:1425) ~[?:?]
                        at java.util.Collections$UnmodifiableMap.forEach(Collections.java:1521) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.loadSSLConfigurations(SSLService.java:524) ~[?:?]
                        at org.elasticsearch.xpack.core.ssl.SSLService.<init>(SSLService.java:142) ~[?:?]
                        at org.elasticsearch.xpack.core.XPackPlugin.createSSLService(XPackPlugin.java:455) ~[?:?]
                        at org.elasticsearch.xpack.core.XPackPlugin.createComponents(XPackPlugin.java:288) ~[?:?]
                        at org.elasticsearch.node.Node.lambda$new$15(Node.java:553) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
                        at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]
                        at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
                        at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
                        at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
                        at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
                        at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
                        at org.elasticsearch.node.Node.<init>(Node.java:557) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.node.Node.<init>(Node.java:289) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:393) ~[elasticsearch-7.10.1.jar:7.10.1]
                        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.10.1.jar:7.10.1]
                        ... 6 more
                [2021-04-16T15:49:17,416][INFO ][o.e.n.Node               ] [node-1] version[7.10.1], pid[27496], build[default/rpm/1c34507e66d7db1211f66f3513706fdf548736aa/2020-12-05T01:00:33.671820Z], OS[Linux/3.10.0-1127.el7.x86_64/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/15.0.1/15.0.1+9]
                [2021-04-16T15:49:17,419][INFO ][o.e.n.Node               ] [node-1] JVM home [/usr/share/elasticsearch/jdk], using bundled JDK [true]
                [2021-04-16T15:49:17,420][INFO ][o.e.n.Node               ] [node-1] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/elasticsearch-1527299952351519095, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/elasticsearch/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -XX:MaxDirectMemorySize=536870912, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=rpm, -Des.bundled_jdk=true]
7 
              [2021-04-16T15:49:19,404][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [aggs-matrix-stats]
                [2021-04-16T15:49:19,404][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [analysis-common]
                [2021-04-16T15:49:19,405][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [constant-keyword]
                [2021-04-16T15:49:19,405][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [flattened]
                [2021-04-16T15:49:19,405][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [frozen-indices]
                [2021-04-16T15:49:19,405][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [ingest-common]
                [2021-04-16T15:49:19,405][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [ingest-geoip]
                [2021-04-16T15:49:19,405][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [ingest-user-agent]
                [2021-04-16T15:49:19,406][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [kibana]
                [2021-04-16T15:49:19,406][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [lang-expression]
                [2021-04-16T15:49:19,406][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [lang-mustache]
                [2021-04-16T15:49:19,406][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [lang-painless]
                [2021-04-16T15:49:19,406][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [mapper-extras]
                [2021-04-16T15:49:19,406][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [mapper-version]
                [2021-04-16T15:49:19,407][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [parent-join]
                [2021-04-16T15:49:19,407][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [percolator]
                [2021-04-16T15:49:19,407][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [rank-eval]
                [2021-04-16T15:49:19,407][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [reindex]
                [2021-04-16T15:49:19,407][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [repositories-metering-api]
                [2021-04-16T15:49:19,407][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [repository-url]
                [2021-04-16T15:49:19,407][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [search-business-rules]
                [2021-04-16T15:49:19,408][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [searchable-snapshots]
                [2021-04-16T15:49:19,408][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [spatial]
                [2021-04-16T15:49:19,408][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [systemd]
                [2021-04-16T15:49:19,408][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [transform]
                [2021-04-16T15:49:19,408][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [transport-netty4]
                [2021-04-16T15:49:19,408][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [unsigned-long]
                [2021-04-16T15:49:19,409][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [vectors]
                [2021-04-16T15:49:19,409][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [wildcard]
                [2021-04-16T15:49:19,409][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-analytics]
                [2021-04-16T15:49:19,409][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-async]
                [2021-04-16T15:49:19,409][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-async-search]
                [2021-04-16T15:49:19,409][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-autoscaling]
                [2021-04-16T15:49:19,409][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-ccr]
                [2021-04-16T15:49:19,409][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-core]
                [2021-04-16T15:49:19,410][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-data-streams]
                [2021-04-16T15:49:19,410][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-deprecation]
                [2021-04-16T15:49:19,410][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-enrich]
                [2021-04-16T15:49:19,410][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-eql]
                [2021-04-16T15:49:19,410][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-graph]
                [2021-04-16T15:49:19,410][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-identity-provider]
                [2021-04-16T15:49:19,410][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-ilm]
                [2021-04-16T15:49:19,411][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-logstash]
                [2021-04-16T15:49:19,411][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-ml]
                [2021-04-16T15:49:19,411][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-monitoring]
                [2021-04-16T15:49:19,411][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-ql]
                [2021-04-16T15:49:19,411][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-rollup]
                [2021-04-16T15:49:19,411][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-security]
                [2021-04-16T15:49:19,411][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-sql]
                [2021-04-16T15:49:19,411][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-stack]
                [2021-04-16T15:49:19,412][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-voting-only-node]
                [2021-04-16T15:49:19,412][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [x-pack-watcher]
                [2021-04-16T15:49:19,412][INFO ][o.e.p.PluginsService     ] [node-1] no plugins loaded
                [2021-04-16T15:49:19,450][INFO ][o.e.e.NodeEnvironment    ] [node-1] using [1] data paths, mounts [[/var (/dev/mapper/rhel-var)]], net usable_space [13gb], net total_space [19.9gb], types [xfs]
                [2021-04-16T15:49:19,451][INFO ][o.e.e.NodeEnvironment    ] [node-1] heap size [1gb], compressed ordinary object pointers [true]
                [2021-04-16T15:49:19,545][INFO ][o.e.n.Node               ] [node-1] node name [node-1], node ID [Xu3toSe1QuCfHghvSMnTuw], cluster name [my-cluster], roles [transform, master, remote_cluster_client, data, ml, data_content, data_hot, data_warm, data_cold, ingest]
                [2021-04-16T15:49:22,844][INFO ][o.e.x.m.p.l.CppLogMessageHandler] [node-1] [controller/27684] [Main.cc@114] controller (64 bit): Version 7.10.1 (Build 11e1ac84105757) Copyright (c) 2020 Elasticsearch BV
                [2021-04-16T15:49:23,389][INFO ][o.e.x.s.a.s.FileRolesStore] [node-1] parsed [0] roles from file [/etc/elasticsearch/roles.yml]
                [2021-04-16T15:49:24,312][INFO ][o.e.t.NettyAllocator     ] [node-1] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=256kb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=1mb, heap_size=1gb}]
                [2021-04-16T15:49:24,374][INFO ][o.e.d.DiscoveryModule    ] [node-1] using discovery type [zen] and seed hosts providers [settings]
                [2021-04-16T15:49:24,771][WARN ][o.e.g.DanglingIndicesState] [node-1] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
                [2021-04-16T15:49:25,137][INFO ][o.e.n.Node               ] [node-1] initialized
                [2021-04-16T15:49:25,137][INFO ][o.e.n.Node               ] [node-1] starting ...
                [2021-04-16T15:49:25,245][INFO ][o.e.t.TransportService   ] [node-1] publish_address {10.194.11.67:9300}, bound_addresses {10.194.11.67:9300}
                [2021-04-16T15:49:25,763][INFO ][o.e.b.BootstrapChecks    ] [node-1] bound or publishing to a non-loopback address, enforcing bootstrap checks
                [2021-04-16T15:49:25,782][ERROR][o.e.b.Bootstrap          ] [node-1] node validation exception
                [1] bootstrap checks failed
                [1]: Transport SSL must be enabled if security is enabled on a [basic] license. Please set [xpack.security.transport.ssl.enabled] to [true] or disable security by setting [xpack.security.enabled] to [false]
                [2021-04-16T15:49:25,787][INFO ][o.e.n.Node               ] [node-1] stopping ...
                [2021-04-16T15:49:25,798][INFO ][o.e.n.Node               ] [node-1] stopped
                [2021-04-16T15:49:25,798][INFO ][o.e.n.Node               ] [node-1] closing ...
                [2021-04-16T15:49:25,810][INFO ][o.e.n.Node               ] [node-1] closed
                [2021-04-16T15:49:25,812][INFO ][o.e.x.m.p.NativeController] [node-1] Native controller process has stopped - no new native processes can be started
8

When you try different things please tell us what you tried and don't put all the logs from all the attempts together as it is really hard for us to figure out what goes on and how to help you

First you had a configuration pointing to a file in disk that didn't exist

Caused by: java.nio.file.NoSuchFileException: /etc/elasticsearch/node-1.p12

Then you probably fixed that but had the wrong password for your node-1.p12 file :

org.elasticsearch.bootstrap.StartupException: ElasticsearchSecurityException[failed to load SSL configuration [xpack.security.transport.ssl]]; 
nested: ElasticsearchException[failed to initialize SSL TrustManager]; 
nested: IOException[keystore password was incorrect]; 
nested: UnrecoverableKeyException[failed to decrypt safe contents entry: javax.crypto.BadPaddingException: Given final block not properly padded. 
Such issues can arise if a bad key is used during decryption.];

then you set

xpack.security.transport.ssl.enabled: false

or you removed it from your configuration altogether and you get

[1]: Transport SSL must be enabled if security is enabled on a [basic] license. Please set [xpack.security.transport.ssl.enabled] to [true] or disable security by setting [xpack.security.enabled] to [false]

A few things :

Hope this helps!

1 Like
9

i try to Enable the TLS Encryption and HTTPS Communication

and still failed. here's the complete log

[2021-04-22T14:15:08,963][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-1] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: ElasticsearchSecurityException[failed to load SSL configuration [xpack.security.http.ssl]]; nested: ElasticsearchException[failed to create trust manager]; nested: ElasticsearchException[failed to initialize SSL TrustManager]; nested: IOException[keystore password was incorrect]; nested: UnrecoverableKeyException[failed to decrypt safe contents entry: javax.crypto.BadPaddingException: Given final block not properly padded. Such issues can arise if a bad key is used during decryption.];
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:174) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:161) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:127) ~[elasticsearch-cli-7.10.1.jar:7.10.1]
        at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:126) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.10.1.jar:7.10.1]
Caused by: org.elasticsearch.ElasticsearchSecurityException: failed to load SSL configuration [xpack.security.http.ssl]
        at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:528) ~[?:?]
        at java.util.HashMap.forEach(HashMap.java:1425) ~[?:?]
        at java.util.Collections$UnmodifiableMap.forEach(Collections.java:1521) ~[?:?]
        at org.elasticsearch.xpack.core.ssl.SSLService.loadSSLConfigurations(SSLService.java:524) ~[?:?]
        at org.elasticsearch.xpack.core.ssl.SSLService.<init>(SSLService.java:142) ~[?:?]
        at org.elasticsearch.xpack.core.XPackPlugin.createSSLService(XPackPlugin.java:455) ~[?:?]
        at org.elasticsearch.xpack.core.XPackPlugin.createComponents(XPackPlugin.java:288) ~[?:?]
        at org.elasticsearch.node.Node.lambda$new$15(Node.java:553) ~[elasticsearch-7.10.1.jar:7.10.1]
        at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
        at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]
        at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
        at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
        at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
        at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
        at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
        at org.elasticsearch.node.Node.<init>(Node.java:557) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.node.Node.<init>(Node.java:289) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:393) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.10.1.jar:7.10.1]
        ... 6 more
Caused by: org.elasticsearch.ElasticsearchException: failed to create trust manager
        at org.elasticsearch.xpack.core.ssl.TrustConfig$CombiningTrustConfig.createTrustManager(TrustConfig.java:172) ~[?:?]
        at org.elasticsearch.xpack.core.ssl.SSLService.createSslContext(SSLService.java:437) ~[?:?]
        at java.util.HashMap.computeIfAbsent(HashMap.java:1224) ~[?:?]
        at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSSLConfigurations$5(SSLService.java:526) ~[?:?]
        at java.util.HashMap.forEach(HashMap.java:1425) ~[?:?]
        at java.util.Collections$UnmodifiableMap.forEach(Collections.java:1521) ~[?:?]
        at org.elasticsearch.xpack.core.ssl.SSLService.loadSSLConfigurations(SSLService.java:524) ~[?:?]
        at org.elasticsearch.xpack.core.ssl.SSLService.<init>(SSLService.java:142) ~[?:?]
        at org.elasticsearch.xpack.core.XPackPlugin.createSSLService(XPackPlugin.java:455) ~[?:?]
        at org.elasticsearch.xpack.core.XPackPlugin.createComponents(XPackPlugin.java:288) ~[?:?]
        at org.elasticsearch.node.Node.lambda$new$15(Node.java:553) ~[elasticsearch-7.10.1.jar:7.10.1]
        at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
        at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]
        at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
        at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
        at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
        at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
        at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
        at org.elasticsearch.node.Node.<init>(Node.java:557) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.node.Node.<init>(Node.java:289) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:393) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.10.1.jar:7.10.1]
        ... 6 more
Caused by: org.elasticsearch.ElasticsearchException: failed to initialize SSL TrustManager
        at org.elasticsearch.xpack.core.ssl.StoreKeyConfig.createTrustManager(StoreKeyConfig.java:103) ~[?:?]
        at org.elasticsearch.xpack.core.ssl.TrustConfig$CombiningTrustConfig.lambda$createTrustManager$0(TrustConfig.java:168) ~[?:?]
        at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
        at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:?]
        at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
        at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
        at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
        at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
        at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
        at
10

One of your keystore passwords seems wrong. Can you verify your configuration?
You didn't share your configuration so we can't be sure what might be wrong, if you do share it, we might be able to give some suggestions.

11

i make all the password same, btw what configuration you need? elasticsearch.yml?

12

yes, plus to tell us if you have added any secure settings too.

13

this

# ======================== Elasticsearch Configuration =========================
#
# NOTE: Elasticsearch comes with reasonable defaults for most settings.
#       Before you set out to tweak and tune the configuration, make sure you
#       understand what are you trying to accomplish and the consequences.
#
# The primary way of configuring a node is via this file. This template lists
# the most important settings you may want to configure for a production cluster.
#
# Please consult the documentation for further information on configuration options:
# https://www.elastic.co/guide/en/elasticsearch/reference/index.html
#
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: my-cluster
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: bdi-uat-els
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
path.data: /var/lib/elasticsearch
#
# Path to log files:
#
path.logs: /var/log/elasticsearch
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# Set the bind address to a specific IP (IPv4 or IPv6):
#
#network.host: 192.168.0.1
network.host: 10.194.11.67

#
# Set a custom port for HTTP:
#
#http.port: 9200
http.port: 9200

##
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
#
#discovery.seed_hosts: ["host1", "host2"]
discovery.seed_hosts: ["10.194.11.67", "[::1]"]
#
#
# Bootstrap the cluster using an initial set of master-eligible nodes:
#
cluster.initial_master_nodes: [10.194.11.67]
#
# For more information, consult the discovery and cluster formation module documentation.
#
# ---------------------------------- Gateway -----------------------------------
#
# Block initial recovery after a full cluster restart until N nodes are started:
#
#gateway.recover_after_nodes: 3
#
# For more information, consult the gateway module documentation.
#
# ---------------------------------- Various -----------------------------------
#
# Require explicit names when deleting indices:
#
#action.destructive_requires_name: true

#xpack
xpack.security.enabled: true
xpack.security.transport.ssl.enabled: true
xpack.security.transport.ssl.verification_mode: certificate
#xpack.security.transport.ssl.client_authentication: required
xpack.security.transport.ssl.keystore.path: elastic-certificates.p12
xpack.security.transport.ssl.truststore.path: elastic-certificates.p12
xpack.security.http.ssl.enabled: true
xpack.security.http.ssl.keystore.path: "/etc/elasticsearch/http.p12"
14

And how/where did you configure the password for your keystores?

15

first i use this command

/usr/share/elasticsearch/bin/elasticsearch-certutil ca

This tool assists you in the generation of X.509 certificates and certificate
signing requests for use with SSL/TLS in the Elastic stack.

The 'ca' mode generates a new 'certificate authority'
This will create a new X.509 certificate and private key that can be used
to sign certificate when running in 'cert' mode.

Use the 'ca-dn' option if you wish to configure the 'distinguished name'
of the certificate authority

By default the 'ca' mode produces a single PKCS#12 output file which holds:
    * The CA certificate
    * The CA's private key

If you elect to generate PEM format certificates (the -pem option), then the output will
be a zip file containing individual files for the CA certificate and private key

Please enter the desired output file [elastic-stack-ca.p12]:
Enter password for elastic-stack-ca.p12 :

then

/usr/share/elasticsearch/bin/elasticsearch-certutil cert --ca elastic-stack-ca.p12

This tool assists you in the generation of X.509 certificates and certificate
signing requests for use with SSL/TLS in the Elastic stack.

The 'cert' mode generates X.509 certificate and private keys.
    * By default, this generates a single certificate and key for use
       on a single instance.
    * The '-multiple' option will prompt you to enter details for multiple
       instances and will generate a certificate and key for each one
    * The '-in' option allows for the certificate generation to be automated by describing
       the details of each instance in a YAML file

    * An instance is any piece of the Elastic Stack that requires an SSL certificate.
      Depending on your configuration, Elasticsearch, Logstash, Kibana, and Beats
      may all require a certificate and private key.
    * The minimum required value for each instance is a name. This can simply be the
      hostname, which will be used as the Common Name of the certificate. A full
      distinguished name may also be used.
    * A filename value may be required for each instance. This is necessary when the
      name would result in an invalid file or directory name. The name provided here
      is used as the directory name (within the zip) and the prefix for the key and
      certificate files. The filename is required if you are prompted and the name
      is not displayed in the prompt.
    * IP addresses and DNS names are optional. Multiple values can be specified as a
      comma separated string. If no IP addresses or DNS names are provided, you may
      disable hostname verification in your SSL configuration.

    * All certificates generated by this tool will be signed by a certificate authority (CA).
    * The tool can automatically generate a new CA for you, or you can provide your own with the
         -ca or -ca-cert command line options.

By default the 'cert' mode produces a single PKCS#12 output file which holds:
    * The instance certificate
    * The private key for the instance certificate
    * The CA certificate

If you specify any of the following options:
    * -pem (PEM formatted output)
    * -keep-ca-key (retain generated CA key)
    * -multiple (generate multiple certificates)
    * -in (generate certificates from an input file)
then the output will be be a zip file containing individual certificate/key files

Enter password for CA (elastic-stack-ca.p12) :
Please enter the desired output file [elastic-certificates.p12]:
Enter password for elastic-certificates.p12 :

Certificates written to /usr/share/elasticsearch/elastic-certificates.p12

This file should be properly secured as it contains the private key for
your instance.

This file is a self contained file and can be copied and used 'as is'
For each Elastic product that you wish to configure, you should copy
this '.p12' file to the relevant configuration directory
and then follow the SSL configuration instructions in the product guide.

For client applications, you may only need to copy the CA certificate and
configure the client to trust this certificate.
16

/usr/share/elasticsearch/bin/elasticsearch-certutil http

## Elasticsearch HTTP Certificate Utility

The 'http' command guides you through the process of generating certificates
for use on the HTTP (Rest) interface for Elasticsearch.

This tool will ask you a number of questions in order to generate the right
set of files for your needs.

## Do you wish to generate a Certificate Signing Request (CSR)?

A CSR is used when you want your certificate to be created by an existing
Certificate Authority (CA) that you do not control (that is, you don't have
access to the keys for that CA).

If you are in a corporate environment with a central security team, then you
may have an existing Corporate CA that can generate your certificate for you.
Infrastructure within your organisation may already be configured to trust this
CA, so it may be easier for clients to connect to Elasticsearch if you use a
CSR and send that request to the team that controls your CA.

If you choose not to generate a CSR, this tool will generate a new certificate
for you. That certificate will be signed by a CA under your control. This is a
quick and easy way to secure your cluster with TLS, but you will need to
configure all your clients to trust that custom CA.

Generate a CSR? [y/N]^C^Croot@elasticsearch:/etc/elasticsearch# ^C
root@elasticsearch:/etc/elasticsearch# vi /usr/share/elasticsearch/bin/elasticsearch-certutil
root@elasticsearch:/etc/elasticsearch# /usr/share/elasticsearch/bin/elasticsearch-certutil  http

## Elasticsearch HTTP Certificate Utility

The 'http' command guides you through the process of generating certificates
for use on the HTTP (Rest) interface for Elasticsearch.

This tool will ask you a number of questions in order to generate the right
set of files for your needs.

## Do you wish to generate a Certificate Signing Request (CSR)?

A CSR is used when you want your certificate to be created by an existing
Certificate Authority (CA) that you do not control (that is, you don't have
access to the keys for that CA).

If you are in a corporate environment with a central security team, then you
may have an existing Corporate CA that can generate your certificate for you.
Infrastructure within your organisation may already be configured to trust this
CA, so it may be easier for clients to connect to Elasticsearch if you use a
CSR and send that request to the team that controls your CA.

If you choose not to generate a CSR, this tool will generate a new certificate
for you. That certificate will be signed by a CA under your control. This is a
quick and easy way to secure your cluster with TLS, but you will need to
configure all your clients to trust that custom CA.

Generate a CSR? [y/N]

## Do you have an existing Certificate Authority (CA) key-pair that you wish to use to sign your certificate?

If you have an existing CA certificate and key, then you can use that CA to
sign your new http certificate. This allows you to use the same CA across
multiple Elasticsearch clusters which can make it easier to configure clients,
and may be easier for you to manage.

If you do not have an existing CA, one will be generated for you.

Use an existing CA? [y/N]y

What is the path to your CA?

Please enter the full pathname to the Certificate Authority that you wish to
use for signing your new http certificate. This can be in PKCS#12 (.p12), JKS
(.jks) or PEM (.crt, .key, .pem) format.
CA Path: /usr/share/elasticsearch/elastic-stack-ca.p12
Reading a PKCS12 keystore requires a password.
It is possible for the keystore's password to be blank,
in which case you can simply press <ENTER> at the prompt
Password for elastic-stack-ca.p12:

## How long should your certificates be valid?

Every certificate has an expiry date. When the expiry date is reached clients
will stop trusting your certificate and TLS connections will fail.

Best practice suggests that you should either:
(a) set this to a short duration (90 - 120 days) and have automatic processes
to generate a new certificate before the old one expires, or
(b) set it to a longer duration (3 - 5 years) and then perform a manual update
a few months before it expires.

You may enter the validity period in years (e.g. 3Y), months (e.g. 18M), or days (e.g. 90D)

For how long should your certificate be valid? [5y]

Do you wish to generate one certificate per node?

If you have multiple nodes in your cluster, then you may choose to generate a
separate certificate for each of these nodes. Each certificate will have its
own private key, and will be issued for a specific hostname or IP address.

Alternatively, you may wish to generate a single certificate that is valid
across all the hostnames or addresses in your cluster.

If all of your nodes will be accessed through a single domain
(e.g. node01.es.example.com, node02.es.example.com, etc) then you may find it
simpler to generate one certificate with a wildcard hostname (*.es.example.com)
and use that across all of your nodes.

However, if you do not have a common domain name, and you expect to add
additional nodes to your cluster in the future, then you should generate a
certificate per node so that you can more easily generate new certificates when
you provision new nodes.

Generate a certificate per node? [y/N]

Which hostnames will be used to connect to your nodes?

These hostnames will be added as "DNS" names in the "Subject Alternative Name"
(SAN) field in your certificate.

You should list every hostname and variant that people will use to connect to
your cluster over http.
Do not list IP addresses here, you will be asked to enter them later.

If you wish to use a wildcard certificate (for example *.es.example.com) you
can enter that here.

Enter all the hostnames that you need, one per line.
When you are done, press <ENTER> once more to move on to the next step.


You did not enter any hostnames.
Clients are likely to encounter TLS hostname verification errors if they
connect to your cluster using a DNS name.

Is this correct [Y/n]

## Which IP addresses will be used to connect to your nodes?

If your clients will ever connect to your nodes by numeric IP address, then you
can list these as valid IP "Subject Alternative Name" (SAN) fields in your
certificate.

If you do not have fixed IP addresses, or not wish to support direct IP access
to your cluster then you can just press <ENTER> to skip this step.

Enter all the IP addresses that you need, one per line.
When you are done, press <ENTER> once more to move on to the next step.


You did not enter any IP addresses.

Is this correct [Y/n]

## Other certificate options

The generated certificate will have the following additional configuration
values. These values have been selected based on a combination of the
information you have provided above and secure defaults. You should not need to
change these values unless you have specific requirements.

Key Name: elasticsearch
Subject DN: CN=elasticsearch
Key Size: 2048

Do you wish to change any of these options? [y/N]

## What password do you want for your private key(s)?

Your private key(s) will be stored in a PKCS#12 keystore file named "http.p12".
This type of keystore is always password protected, but it is possible to use a
blank password.

If you wish to use a blank password, simply press <enter> at the prompt below.
Provide a password for the "http.p12" file:  [<ENTER> for none]

Where should we save the generated files?

A number of files will be generated including your private key(s),
public certificate(s), and sample configuration options for Elastic Stack products.

These files will be included in a single zip archive.

What filename should be used for the output zip file? [/usr/share/elasticsearch/elasticsearch-ssl-http.zip]

Zip file written to /usr/share/elasticsearch/elasticsearch-ssl-http.zip

that's it the configuration i use to make a password

17

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.