# Elasticsearch cluster - 7.6 Error start

**URL:** <https://discuss.elastic.co/t/elasticsearch-cluster-7-6-error-start/221137>\
**Category:** Elasticsearch\
**Created:** [February 27, 2020, 3:38am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-7-6-error-start/221137 "2020-02-27T03:38:15Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![bruno\_aleixo](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bruno_aleixo/32/68834_2.png) [@bruno\_aleixo](https://discuss.elastic.co/u/bruno_aleixo)\
**Post date:** [February 27, 2020, 3:38am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-7-6-error-start/221137/1 "2020-02-27T03:38:15Z")

</div>

Hi, first sorry my english not be good, but i have a doubt, i am creating a cluster of elasticsearch,where I have 3 nodes,  
but there is an error in the climb

**Conf Master node:**  
cluster.name: elk\_lab  
node.master: true  
node.data: false  
node.name: node-3  
path.data: /var/lib/elasticsearch  
path.logs: /var/log/elasticsearch  
#path.data: /opt/elk/data  
network.host: IP1  
http.port: 9200  
discovery.zen.ping.unicast.hosts: ["IP1", "IP2", "IP3"]  
discovery.zen.minimum\_master\_nodes: 1

**conf Node Data 1:**  
cluster.name: elk\_lab  
node.master: false  
node.data: true  
node.name: node-2  
path.data: /var/lib/elasticsearch  
path.logs: /var/log/elasticsearch  
network.host: IP2  
http.port: 9200  
discovery.zen.ping.unicast.hosts: ["IP1", "IP2", "IP3"]  
discovery.zen.minimum\_master\_nodes: 1  
cluster.initial\_master\_nodes: ["IP1"]

**conf Node Data 2:**  
cluster.name: elk\_lab  
node.master: false  
node.data: true  
node.name: node-1  
path.data: /var/lib/elasticsearch  
path.logs: /var/log/elasticsearch  
network.host: IP3  
http.port: 9200  
discovery.zen.ping.unicast.hosts: ["IP1", "IP2", "IP3"]  
discovery.zen.minimum\_master\_nodes: 1  
cluster.initial\_master\_nodes: ["IP1"]

Logs Master:  
[2020-02-26T23:17:41,008][WARN][o.e.c.c.ClusterFormationFailureHelper] [node-3] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial\_master\_nodes] is empty on this node: have discovered [{node-3}{k1BO077zSLm9Iqff1nLqMg}{tEK5LrK9SE2E-s\_nO4D3aQ}{192.168.99.10}{192.168.99.10:9300}{ilm}{ml.machine\_memory=3897933824, xpack.installed=true, ml.max\_open\_jobs=20}]; discovery will continue using

Log Node 1  
[2020-02-27T02:17:07,339][WARN][r.suppressed] [node-2] path: /\_bulk, params: {}  
org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE\_UNAVAILABLE/1/state not recovered / initialized, SERVICE\_UNAVAILABLE/2/no master];  
at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:189) ~[elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.action.bulk.TransportBulkAction$BulkOperation.handleBlockExceptions(TransportBulkAction.java:535) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.action.bulk.TransportBulkAction$BulkOperation.doRun(TransportBulkAction.java:415) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.action.bulk.TransportBulkAction$BulkOperation$2.onTimeout(TransportBulkAction.java:569) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.cluster.ClusterStateObserver$ContextPreservingListener.onTimeout(ClusterStateObserver.java:325) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.cluster.ClusterStateObserver$ObserverClusterStateListener.onTimeout(ClusterStateObserver.java:252) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.cluster.service.ClusterApplierService$NotifyTimeout.run(ClusterApplierService.java:598) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.0.jar:7.6.0]  
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]  
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]  
at java.lang.Thread.run(Thread.java:830) [?:?]  
Suppressed: org.elasticsearch.discovery.MasterNotDiscoveredException  
at org.elasticsearch.action.support.master.TransportMasterNodeAction$AsyncSingleAction$2.onTimeout(TransportMasterNodeAction.java:220) ~[elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.cluster.ClusterStateObserver$ContextPreservingListener.onTimeout(ClusterStateObserver.java:325) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.cluster.ClusterStateObserver$ObserverClusterStateListener.onTimeout(ClusterStateObserver.java:252) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.cluster.service.ClusterApplierService$NotifyTimeout.run(ClusterApplierService.java:598) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.0.jar:7.6.0]  
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]  
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]  
at java.lang.Thread.run(Thread.java:830) [?:?]  
[2020-02-27T02:17:12,389][DEBUG][o.e.a.s.m.TransportMasterNodeAction] [node-2] no known master node, scheduling a retry  
[2020-02-27T02:17:14,960][WARN][o.e.c.c.ClusterFormationFailureHelper] [node-2] master not discovered yet: have discovered [{node-2}{3YbiaxxFQhSyv066zU4-nw}{daDu-6gmQzG0MPRaBAZCgA}{192.168.99.40}{192.168.99.40:9300}{dil}{ml.machine\_memory=2933784576, xpack.installed=true, ml.max\_open\_jobs=20}, {node-3}{k1BO077zSLm9Iqff1nLqMg}{tEK5LrK9SE2E-s\_nO4D3aQ}{192.168.99.10}{192.168.99.10:9300}{ilm}{ml.machine\_memory=3897933824, ml.max\_open\_jobs=20, xpack.installed=true}]; discovery will continue using [192.168.99.10:9300, 192.168.99.50:9300] from hosts providers and from last-known cluster state; node term 22, last-accepted version 799 in term 22

Log Node 2  
[2020-02-27T03:34:03,162][WARN][r.suppressed] [node-1] path: /\_bulk, params: {}  
org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE\_UNAVAILABLE/1/state not recovered / initialized, SERVICE\_UNAVAILABLE/2/no master];  
at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:189) ~[elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.action.bulk.TransportBulkAction$BulkOperation.handleBlockExceptions(TransportBulkAction.java:535) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.action.bulk.TransportBulkAction$BulkOperation.doRun(TransportBulkAction.java:415) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.action.bulk.TransportBulkAction$BulkOperation$2.onTimeout(TransportBulkAction.java:569) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.cluster.ClusterStateObserver$ContextPreservingListener.onTimeout(ClusterStateObserver.java:325) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.cluster.ClusterStateObserver$ObserverClusterStateListener.onTimeout(ClusterStateObserver.java:252) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.cluster.service.ClusterApplierService$NotifyTimeout.run(ClusterApplierService.java:598) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.0.jar:7.6.0]  
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]  
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]  
at java.lang.Thread.run(Thread.java:830) [?:?]  
Suppressed: org.elasticsearch.discovery.MasterNotDiscoveredException  
at org.elasticsearch.action.support.master.TransportMasterNodeAction$AsyncSingleAction$2.onTimeout(TransportMasterNodeAction.java:220) ~[elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.cluster.ClusterStateObserver$ContextPreservingListener.onTimeout(ClusterStateObserver.java:325) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.cluster.ClusterStateObserver$ObserverClusterStateListener.onTimeout(ClusterStateObserver.java:252) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.cluster.service.ClusterApplierService$NotifyTimeout.run(ClusterApplierService.java:598) [elasticsearch-7.6.0.jar:7.6.0]  
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.0.jar:7.6.0]  
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]  
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]  
at java.lang.Thread.run(Thread.java:830) [?:?]  
[2020-02-27T03:34:08,779][WARN][o.e.c.c.ClusterFormationFailureHelper] [node-1] master not discovered yet: have discovered [{node-1}{LHO5p-BKRlmnl4Wfa8Ar7g}{Sub\_jW1xSIe2VgYyUVcfaA}{192.168.99.50}{192.168.99.50:9300}{dil}{ml.machine\_memory=2933948416, xpack.installed=true, ml.max\_open\_jobs=20}, {node-3}{k1BO077zSLm9Iqff1nLqMg}{tEK5LrK9SE2E-s\_nO4D3aQ}{192.168.99.10}{192.168.99.10:9300}{ilm}{ml.machine\_memory=3897933824, ml.max\_open\_jobs=20, xpack.installed=true}]; discovery will continue using [192.168.99.10:9300, 192.168.99.40:9300] from hosts providers and from last-known cluster state; node term 0, last-accepted version 0 in term 0

Log Logstash:  
[2020-02-26T23:18:51,096][WARN][logstash.outputs.elasticsearch][Chamados] DEPRECATION WARNING: Connecting to an OSS distribution of Elasticsearch using the default distribution of Logstash will stop working in Logstash 8.0.0. Please upgrade to the default distribution of Elasticsearch, or use the OSS distribution of Logstash {:url=\>"[http://192.168.99.50:9200/](http://192.168.99.50:9200/)"}  
[2020-02-26T23:18:51,105][WARN][logstash.outputs.elasticsearch][Chamados] Marking url as dead. Last error: [LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError] Elasticsearch Unreachable: [[http://192.168.99.40:9200/](http://192.168.99.40:9200/)][Manticore::SocketTimeout] Read timed out {:url=\>[http://192.168.99.40:9200/](http://192.168.99.40:9200/), :error\_message=\>"Elasticsearch Unreachable: [[http://192.168.99.40:9200/](http://192.168.99.40:9200/)][Manticore::SocketTimeout] Read timed out", :error\_class=\>"LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError"}  
[2020-02-26T23:18:51,116][ERROR][logstash.outputs.elasticsearch][Chamados] Attempted to send a bulk request to elasticsearch' but Elasticsearch appears to be unreachable or down! {:error\_message=\>"Elasticsearch Unreachable: [[http://192.168.99.40:9200/](http://192.168.99.40:9200/)][Manticore::SocketTimeout] Read timed out", :class=\>"LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError", :will\_retry\_in\_seconds=\>64}  
[2020-02-26T23:18:52,131][WARN][logstash.outputs.elasticsearch][Chamados] Restored connection to ES instance {:url=\>"[http://192.168.99.40:9200/](http://192.168.99.40:9200/)"}  
[2020-02-26T23:19:00,331][INFO][logstash.inputs.jdbc][Chamados] (0.003611s) select \* from Chamados

Broadcast message from root@elk (Wed 2020-02-26 23:19:05 -03):

The system is going down for power-off at Wed 2020-02-26 23:20:05 -03!

[2020-02-26T23:19:22,221][WARN][logstash.outputs.elasticsearch][Chamados] DEPRECATION WARNING: Connecting to an OSS distribution of Elasticsearch using the default distribution of Logstash will stop working in Logstash 8.0.0. Please upgrade to the default distribution of Elasticsearch, or use the OSS distribution of Logstash {:url=\>"[http://192.168.99.40:9200/](http://192.168.99.40:9200/)"}  
[2020-02-26T23:20:00,380][INFO][logstash.inputs.jdbc][Chamados] (0.003266s) select \* from Chamados

Log Kibana:

{"type":"log","@timestamp":"2020-02-27T02:13:41Z","tags":["warning","plugins","licensing"],"pid":2611,"message":"License information could not be obtained from Elasticsearch for the [data] cluster. TypeError: Cannot use 'in' operator to search for 'type' in null"}  
{"type":"log","@timestamp":"2020-02-27T02:14:11Z","tags":["warning","plugins","licensing"],"pid":2611,"message":"License information could not be obtained from Elasticsearch for the [data] cluster. TypeError: Cannot use 'in' operator to search for 'type' in null"}

[http://192.168.99.40:9200/\_cat/health](http://192.168.99.40:9200/_cat/health)

{"error":{"root\_cause":[{"type":"master\_not\_discovered\_exception","reason":null}],"type":"master\_not\_discovered\_exception","reason":null},"status":503}

[http://192.168.99.10:9200/\_cat/indices](http://192.168.99.10:9200/_cat/indices)  
{"error":{"root\_cause":[{"type":"master\_not\_discovered\_exception","reason":null}],"type":"master\_not\_discovered\_exception","reason":null},"status":503}

[http://192.168.99.50:9200/\_cat/health](http://192.168.99.50:9200/_cat/health)  
{"error":{"root\_cause":[{"type":"master\_not\_discovered\_exception","reason":null}],"type":"master\_not\_discovered\_exception","reason":null},"status":503}

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [February 27, 2020, 7:20am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-7-6-error-start/221137/2 "2020-02-27T07:20:06Z")

</div>

The master logs are giving you a big hint:

> [@bruno\_aleixo](#):
>
> [node-3] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and **[cluster.initial\_master\_nodes] is empty on this node**

You have set `cluster.initial_master_nodes` on the two non-master nodes (where it is ignored) but not on the master node (where it is required the first time the cluster starts).

Also you should set it to the `node.name` property not an IP address:

```auto
cluster.initial_master_nodes: ["node-3"]

```

---

<div class="post-metadata">

**Author:** ![bruno\_aleixo](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bruno_aleixo/32/68834_2.png) [@bruno\_aleixo](https://discuss.elastic.co/u/bruno_aleixo)\
**Post date:** [February 28, 2020, 1:42am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-7-6-error-start/221137/3 "2020-02-28T01:42:54Z")

</div>

Very thanks @DavidTurner, but i add the config **[cluster.initial\_master\_nodes]**  
in the nodes too, would have a problem? again very thanks

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [February 28, 2020, 8:05am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-7-6-error-start/221137/4 "2020-02-28T08:05:10Z")

</div>

Sorry, I don't really understand what you're asking here. Does [the documentation](https://www.elastic.co/guide/en/elasticsearch/reference/current/discovery-settings.html#initial_master_nodes) help at all?

---

<div class="post-metadata">

**Author:** ![bruno\_aleixo](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bruno_aleixo/32/68834_2.png) [@bruno\_aleixo](https://discuss.elastic.co/u/bruno_aleixo)\
**Post date:** [February 28, 2020, 3:31pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-7-6-error-start/221137/5 "2020-02-28T15:31:24Z")

</div>

@DavidTurner, the first solution solved the problem

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 27, 2020, 3:31pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-7-6-error-start/221137/6 "2020-03-27T15:31:24Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
