Third nodes doesn't work

Elastic Stack Elasticsearch
1

Hi,

I wanted to add a third node to my cluster, but it doesn't work :

[root@frghcslnetv11 elasticsearch]# tail -40 network-logs.log
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-6.3.1.jar:6.3.1]
        at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-6.3.1.jar:6.3.1]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:93) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:86) ~[elasticsearch-6.3.1.jar:6.3.1]
Caused by: java.lang.IllegalStateException: Failed to create node environment
        at org.elasticsearch.node.Node.<init>(Node.java:273) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.node.Node.<init>(Node.java:252) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:213) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:213) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:326) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-6.3.1.jar:6.3.1]
        ... 6 more
Caused by: java.io.IOException: failed to test writes in data directory [/data/elasticsearch/nodes/0/indices/zbybtLYVTFOnh5U6b4sDgg/_state] write permission is required
        at org.elasticsearch.env.NodeEnvironment.tryWriteTempFile(NodeEnvironment.java:1054) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.env.NodeEnvironment.assertCanWrite(NodeEnvironment.java:1022) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:260) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.node.Node.<init>(Node.java:270) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.node.Node.<init>(Node.java:252) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:213) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:213) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:326) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-6.3.1.jar:6.3.1]
        ... 6 more
Caused by: java.nio.file.AccessDeniedException: /data/elasticsearch/nodes/0/indices/zbybtLYVTFOnh5U6b4sDgg/_state/.es_temp_file
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) ~[?:?]
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
        at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214) ~[?:?]
        at java.nio.file.Files.newByteChannel(Files.java:361) ~[?:1.8.0_181]
        at java.nio.file.Files.createFile(Files.java:632) ~[?:1.8.0_181]
        at org.elasticsearch.env.NodeEnvironment.tryWriteTempFile(NodeEnvironment.java:1051) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.env.NodeEnvironment.assertCanWrite(NodeEnvironment.java:1022) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:260) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.node.Node.<init>(Node.java:270) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.node.Node.<init>(Node.java:252) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:213) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:213) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:326) ~[elasticsearch-6.3.1.jar:6.3.1]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-6.3.1.jar:6.3.1]
        ... 6 more

[root@frghcslnetv11 elasticsearch]# curl -XGET 'http://localhost:9200/_cluster/state?pretty'
curl: (7) Failed connect to localhost:9200; Connection refused
2

I resolve the problem, but now I have this warn :

[root@frghcslnetv11 elasticsearch]# tail -40 network-logs.log
[2018-08-01T11:30:56,140][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [analysis-common]
[2018-08-01T11:30:56,140][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [ingest-common]
[2018-08-01T11:30:56,140][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [lang-expression]
[2018-08-01T11:30:56,140][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [lang-mustache]
[2018-08-01T11:30:56,140][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [lang-painless]
[2018-08-01T11:30:56,140][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [mapper-extras]
[2018-08-01T11:30:56,141][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [parent-join]
[2018-08-01T11:30:56,141][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [percolator]
[2018-08-01T11:30:56,141][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [rank-eval]
[2018-08-01T11:30:56,141][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [reindex]
[2018-08-01T11:30:56,141][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [repository-url]
[2018-08-01T11:30:56,141][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [transport-netty4]
[2018-08-01T11:30:56,141][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [tribe]
[2018-08-01T11:30:56,141][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [x-pack-core]
[2018-08-01T11:30:56,141][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [x-pack-deprecation]
[2018-08-01T11:30:56,141][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [x-pack-graph]
[2018-08-01T11:30:56,141][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [x-pack-logstash]
[2018-08-01T11:30:56,142][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [x-pack-ml]
[2018-08-01T11:30:56,142][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [x-pack-monitoring]
[2018-08-01T11:30:56,142][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [x-pack-rollup]
[2018-08-01T11:30:56,142][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [x-pack-security]
[2018-08-01T11:30:56,142][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [x-pack-sql]
[2018-08-01T11:30:56,142][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [x-pack-upgrade]
[2018-08-01T11:30:56,142][INFO ][o.e.p.PluginsService     ] [network-3] loaded module [x-pack-watcher]
[2018-08-01T11:30:56,143][INFO ][o.e.p.PluginsService     ] [network-3] no plugins loaded
[2018-08-01T11:31:01,321][INFO ][o.e.x.s.a.s.FileRolesStore] [network-3] parsed [0] roles from file [/etc/elasticsearch/roles.yml]
[2018-08-01T11:31:01,955][INFO ][o.e.x.m.j.p.l.CppLogMessageHandler] [controller/57815] [Main.cc@109] controller (64 bit): Version 6.3.1 (Build 4d0b8f0a0ef401) Copyright (c) 2018 Elasticsearch BV
[2018-08-01T11:31:02,444][DEBUG][o.e.a.ActionModule       ] Using REST wrapper from plugin org.elasticsearch.xpack.security.Security
[2018-08-01T11:31:02,963][INFO ][o.e.d.DiscoveryModule    ] [network-3] using discovery type [zen]
[2018-08-01T11:31:04,223][INFO ][o.e.n.Node               ] [network-3] initialized
[2018-08-01T11:31:04,224][INFO ][o.e.n.Node               ] [network-3] starting ...
[2018-08-01T11:31:04,522][INFO ][o.e.t.TransportService   ] [network-3] publish_address {172.16.250.19:9300}, bound_addresses {[::]:9300}
[2018-08-01T11:31:04,579][INFO ][o.e.b.BootstrapChecks    ] [network-3] bound or publishing to a non-loopback address, enforcing bootstrap checks
[2018-08-01T11:31:07,917][INFO ][o.e.c.s.ClusterApplierService] [network-3] detected_master {network-2}{ZvV7OKKYQBOSnq6l3oEbcg}{QNE_O009RyaiKYK3fvgdHQ}{172.16.250.30}{172.16.250.30:9300}{ml.machine_memory=8186175488, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true}, added {{network-2}{ZvV7OKKYQBOSnq6l3oEbcg}{QNE_O009RyaiKYK3fvgdHQ}{172.16.250.30}{172.16.250.30:9300}{ml.machine_memory=8186175488, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},{network-1}{M3r-tbp1QuqOQSj5UM6Ehw}{Se5v0sThTOONlnj-v2Hk-Q}{172.16.250.29}{172.16.250.29:9300}{ml.machine_memory=8184815616, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},}, reason: apply cluster state (from master [master {network-2}{ZvV7OKKYQBOSnq6l3oEbcg}{QNE_O009RyaiKYK3fvgdHQ}{172.16.250.30}{172.16.250.30:9300}{ml.machine_memory=8186175488, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true} committed version [194]])
[2018-08-01T11:31:08,707][WARN ][o.e.x.s.a.s.m.NativeRoleMappingStore] [network-3] Failed to clear cache for realms [[]]
[2018-08-01T11:31:08,710][INFO ][o.e.x.s.a.TokenService   ] [network-3] refresh keys
[2018-08-01T11:31:09,440][INFO ][o.e.x.s.a.TokenService   ] [network-3] refreshed keys
[2018-08-01T11:31:09,471][INFO ][o.e.l.LicenseService     ] [network-3] license [5b493318-d76c-4d13-85e2-770b8c355630] mode [basic] - valid
[2018-08-01T11:31:09,516][INFO ][o.e.x.s.t.n.SecurityNetty4HttpServerTransport] [network-3] publish_address {172.16.250.19:9200}, bound_addresses {[::]:9200}
[2018-08-01T11:31:09,516][INFO ][o.e.n.Node               ] [network-3] started
3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.