# When add new node in elasticsearch 5.4 old node deleted

**URL:** <https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436>\
**Category:** Elasticsearch\
**Created:** [May 19, 2017, 1:52pm UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436 "2017-05-19T13:52:06Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![pjayramkumar](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pjayramkumar](https://discuss.elastic.co/u/pjayramkumar)\
**Post date:** [May 19, 2017, 1:52pm UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/1 "2017-05-19T13:52:06Z")

</div>

Hello

I created a node via command as elasticsearch user in server

here is command

bin/elasticsearch -Epath.data=/usr/share/elasticsearch/data/node\_3 -Epath.logs=/var/log/elasticsearch/node\_3 -Enode.name=fan

then it's showing fine

then i add another via command

bin/elasticsearch -Epath.data=/usr/share/elasticsearch/data/node\_4 -Epath.logs=/var/log/elasticsearch/node\_4 -Enode.name=fan\_1

then fan is remove when i fire query like this

curl -XGET '[http://localhost:9200/\_cluster/state?pretty](http://localhost:9200/_cluster/state?pretty)'

what is missing please guide me

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [May 19, 2017, 2:28pm UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/2 "2017-05-19T14:28:47Z")

</div>

Please format your code using `</>` icon as explained in [this guide](https://discuss.elastic.co/t/about-the-elasticsearch-category/21). It will make your post more readable.

Or use markdown style like:

````
```
CODE
```

````

If you share logs of both nodes that might help to answer.

---

<div class="post-metadata">

**Author:** ![pjayramkumar](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pjayramkumar](https://discuss.elastic.co/u/pjayramkumar)\
**Post date:** [May 19, 2017, 3:30pm UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/3 "2017-05-19T15:30:35Z")

</div>

```
[2017-05-19T13:20:27,612][INFO][o.e.n.Node] [paresh] initializing ...
[2017-05-19T13:20:27,715][INFO][o.e.e.NodeEnvironment] [paresh] using [1] data paths, mounts [[/ (rootfs)]], net usable_space [52.9gb], net total_space [59gb], spins? [unknown], types [rootfs]
[2017-05-19T13:20:27,715][INFO][o.e.e.NodeEnvironment] [paresh] heap size [247.5mb], compressed ordinary object pointers [true]
[2017-05-19T13:20:27,718][INFO][o.e.n.Node] [paresh] node name [paresh], node ID [oDsesoB-QwCcKEAlWbytzw]
[2017-05-19T13:20:27,719][INFO][o.e.n.Node] [paresh] version[5.4.0], pid[21524], build[780f8c4/2017-04-28T17:43:27.229Z], OS[Linux/3.10.0-514.16.1.el7.x86_64/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_131/25.131-b11]
[2017-05-19T13:20:29,029][INFO][o.e.p.PluginsService] [paresh] loaded module [aggs-matrix-stats]
[2017-05-19T13:20:29,029][INFO][o.e.p.PluginsService] [paresh] loaded module [ingest-common]
[2017-05-19T13:20:29,029][INFO][o.e.p.PluginsService] [paresh] loaded module [lang-expression]
[2017-05-19T13:20:29,029][INFO][o.e.p.PluginsService] [paresh] loaded module [lang-groovy]
[2017-05-19T13:20:29,030][INFO][o.e.p.PluginsService] [paresh] loaded module [lang-mustache]
[2017-05-19T13:20:29,030][INFO][o.e.p.PluginsService] [paresh] loaded module [lang-painless]
[2017-05-19T13:20:29,030][INFO][o.e.p.PluginsService] [paresh] loaded module [percolator]
[2017-05-19T13:20:29,030][INFO][o.e.p.PluginsService] [paresh] loaded module [reindex]
[2017-05-19T13:20:29,030][INFO][o.e.p.PluginsService] [paresh] loaded module [transport-netty3]
[2017-05-19T13:20:29,030][INFO][o.e.p.PluginsService] [paresh] loaded module [transport-netty4]
[2017-05-19T13:20:29,031][INFO][o.e.p.PluginsService] [paresh] no plugins loaded
[2017-05-19T13:20:30,869][INFO][o.e.d.DiscoveryModule] [paresh] using discovery type [zen]
[2017-05-19T13:20:31,708][INFO][o.e.n.Node] [paresh] initialized
[2017-05-19T13:20:31,708][INFO][o.e.n.Node] [paresh] starting ...
[2017-05-19T13:20:32,092][INFO][o.e.t.TransportService] [paresh] publish_address {127.0.0.1:9302}, bound_addresses {[::1]:9302}, {127.0.0.1:9302}
[2017-05-19T13:20:35,472][INFO][o.e.c.s.ClusterService] [paresh] detected_master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300}, added {{fangels}{n0UBDKQOTIanjtVUL_sPlQ}{eYkGb8VkRna0Zsw082ZZYg}{127.0.0.1}{127.0.0.1:9301},{node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300},}, reason: zen-disco-receive(from master [master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300} committed version [6]])
[2017-05-19T13:21:02,191][WARN][o.e.n.Node] [paresh] timed out while waiting for initial discovery state - timeout: 30s
[2017-05-19T13:21:02,231][INFO][o.e.h.n.Netty4HttpServerTransport] [paresh] publish_address {127.0.0.1:9202}, bound_addresses {[::1]:9202}, {127.0.0.1:9202}
[2017-05-19T13:21:02,243][INFO][o.e.n.Node] [paresh] started
[2017-05-19T13:21:05,501][WARN][o.e.c.NodeConnectionsService] [paresh] failed to connect to node {fangels}{n0UBDKQOTIanjtVUL_sPlQ}{eYkGb8VkRna0Zsw082ZZYg}{127.0.0.1}{127.0.0.1:9301} (tried [1] times)
org.elasticsearch.transport.ConnectTransportException: [fangels][127.0.0.1:9301] handshake_timeout[30s]
	at org.elasticsearch.transport.TcpTransport.executeHandshake(TcpTransport.java:1589) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:533) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TcpTransport.connectToNode(TcpTransport.java:465) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:315) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:302) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.cluster.NodeConnectionsService.validateAndConnectIfNeeded(NodeConnectionsService.java:154) [elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.cluster.NodeConnectionsService$1.doRun(NodeConnectionsService.java:107) [elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:638) [elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-5.4.0.jar:5.4.0]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_131]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_131]
	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]
[2017-05-19T13:21:05,529][WARN][o.e.c.s.ClusterService] [paresh] cluster state update task [zen-disco-receive(from master [master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300} committed version [6]])] took [30s] above the warn threshold of 30s
[2017-05-19T13:21:28,213][INFO][o.e.c.s.ClusterService] [paresh] removed {{fangels}{n0UBDKQOTIanjtVUL_sPlQ}{eYkGb8VkRna0Zsw082ZZYg}{127.0.0.1}{127.0.0.1:9301},}, reason: zen-disco-receive(from master [master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300} committed version [7]])
```

---

<div class="post-metadata">

**Author:** ![pjayramkumar](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pjayramkumar](https://discuss.elastic.co/u/pjayramkumar)\
**Post date:** [May 22, 2017, 4:24am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/4 "2017-05-22T04:24:46Z")

</div>

hello

i am waiting for reply can you please reply

it's really a help if you reply soon

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [May 22, 2017, 7:19am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/5 "2017-05-22T07:19:46Z")

</div>

It is unclear what are the steps you did.

Did you start 4 nodes on your machine? I believe it's for tests right?

As you wrote, when I'm starting 4 nodes on the same machine for demos, I'm running:

```auto
bin/elasticsearch -Epath.data=./data1 -Epath.logs=./logs1 -Enode.name=node1
bin/elasticsearch -Epath.data=./data2 -Epath.logs=./logs2 -Enode.name=node2
bin/elasticsearch -Epath.data=./data3 -Epath.logs=./logs3 -Enode.name=node3
bin/elasticsearch -Epath.data=./data4 -Epath.logs=./logs4 -Enode.name=node4

```

Can you please stop all the nodes. Then start the first one.  
Then wait. Then start a second one.  
If it works, then a third one.

If it does not work, then copy all the logs from all nodes here.

---

<div class="post-metadata">

**Author:** ![pjayramkumar](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pjayramkumar](https://discuss.elastic.co/u/pjayramkumar)\
**Post date:** [May 22, 2017, 7:22am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/6 "2017-05-22T07:22:03Z")

</div>

i have started one via xml

then i try to create second via command

then it showing in node list

but when i try to add third then second one deleted that i created via command

and even after 1 day the third one also remove from the list of the

nodes

so what's should i need to do

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [May 22, 2017, 7:33am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/7 "2017-05-22T07:33:40Z")

</div>

I have no idea of this means:

> i have started one via xml

---

<div class="post-metadata">

**Author:** ![pjayramkumar](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pjayramkumar](https://discuss.elastic.co/u/pjayramkumar)\
**Post date:** [May 22, 2017, 8:02am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/8 "2017-05-22T08:02:18Z")

</div>

Here is full explanation about the issue

1st node via elasticsearch.xml

```
path:
  data: /usr/share/elasticsearch/data/node_1
  logs: /var/log/elasticsearch/node_1

cluster.name: cs

node.name: node_1

bootstrap.memory_lock: true
```

---

<div class="post-metadata">

**Author:** ![pjayramkumar](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pjayramkumar](https://discuss.elastic.co/u/pjayramkumar)\
**Post date:** [May 22, 2017, 8:02am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/9 "2017-05-22T08:02:42Z")

</div>

second Node : node\_2 via command

`bin/elasticsearch -Epath.data=/usr/share/elasticsearch/data/node_2 -Epath.logs=/var/log/elasticsearch/node_2 -Enode.name=node_2`

Log of second Node

```
[2017-05-22T07:28:24,745][INFO][o.e.n.Node] [node_2] initializing ...
[2017-05-22T07:28:24,854][INFO][o.e.e.NodeEnvironment] [node_2] using [1] data paths, mounts [[/ (rootfs)]], net usable_space [52.8gb], net total_space [59gb], spins? [unknown], types [rootfs]
[2017-05-22T07:28:24,854][INFO][o.e.e.NodeEnvironment] [node_2] heap size [247.5mb], compressed ordinary object pointers [true]
[2017-05-22T07:28:24,856][INFO][o.e.n.Node] [node_2] node name [node_2], node ID [Yl38JzyUT_S83xbv2rdK8Q]
[2017-05-22T07:28:24,857][INFO][o.e.n.Node] [node_2] version[5.4.0], pid[10215], build[780f8c4/2017-04-28T17:43:27.229Z], OS[Linux/3.10.0-514.16.1.el7.x86_64/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_131/25.131-b11]
[2017-05-22T07:28:25,992][INFO][o.e.p.PluginsService] [node_2] loaded module [aggs-matrix-stats]
[2017-05-22T07:28:25,992][INFO][o.e.p.PluginsService] [node_2] loaded module [ingest-common]
[2017-05-22T07:28:25,992][INFO][o.e.p.PluginsService] [node_2] loaded module [lang-expression]
[2017-05-22T07:28:25,992][INFO][o.e.p.PluginsService] [node_2] loaded module [lang-groovy]
[2017-05-22T07:28:25,992][INFO][o.e.p.PluginsService] [node_2] loaded module [lang-mustache]
[2017-05-22T07:28:25,992][INFO][o.e.p.PluginsService] [node_2] loaded module [lang-painless]
[2017-05-22T07:28:25,992][INFO][o.e.p.PluginsService] [node_2] loaded module [percolator]
[2017-05-22T07:28:25,993][INFO][o.e.p.PluginsService] [node_2] loaded module [reindex]
[2017-05-22T07:28:25,993][INFO][o.e.p.PluginsService] [node_2] loaded module [transport-netty3]
[2017-05-22T07:28:25,993][INFO][o.e.p.PluginsService] [node_2] loaded module [transport-netty4]
[2017-05-22T07:28:25,993][INFO][o.e.p.PluginsService] [node_2] no plugins loaded
[2017-05-22T07:28:27,934][INFO][o.e.d.DiscoveryModule] [node_2] using discovery type [zen]
[2017-05-22T07:28:28,564][INFO][o.e.n.Node] [node_2] initialized
[2017-05-22T07:28:28,564][INFO][o.e.n.Node] [node_2] starting ...
[2017-05-22T07:28:28,764][INFO][o.e.t.TransportService] [node_2] publish_address {127.0.0.1:9301}, bound_addresses {[::1]:9301}, {127.0.0.1:9301}
[2017-05-22T07:28:32,026][INFO][o.e.c.s.ClusterService] [node_2] detected_master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300}, added {{node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300},}, reason: zen-disco-receive(from master [master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300} committed version [9]])
[2017-05-22T07:28:32,141][INFO][o.e.h.n.Netty4HttpServerTransport] [node_2] publish_address {127.0.0.1:9201}, bound_addresses {[::1]:9201}, {127.0.0.1:9201}
[2017-05-22T07:28:32,146][INFO][o.e.n.Node] [node_2] started

```

And output of

curl -XGET '[http://localhost:9200/\_cluster/state?pretty](http://localhost:9200/_cluster/state?pretty)'

```
{
  "cluster_name" : "cs",
  "version" : 11,
  "state_uuid" : "IWtBtfC9Rf2pFfktRhYBuA",
  "master_node" : "44DUR4IFSQStThQWZoGpzg",
  "blocks" : { },
  "nodes" : {
    "Wmh4Qg6YStGeQwiihc7Wvw" : {
      "name" : "node_3",
      "ephemeral_id" : "QCbe0cxbQNWXu6cdnpM_Zw",
      "transport_address" : "127.0.0.1:9302",
      "attributes" : { }
    },
    "44DUR4IFSQStThQWZoGpzg" : {
      "name" : "node_1",
      "ephemeral_id" : "05XVwjEDRzumU88ojR-weQ",
      "transport_address" : "127.0.0.1:9300",
      "attributes" : { }
    }
  },
  "metadata" : {
    "cluster_uuid" : "VrqDSExLRM2ErjLzoYLovg",
    "templates" : { },
    "indices" : { },
    "index-graveyard" : {
      "tombstones" : []
    }
  },
  "routing_table" : {
    "indices" : { }
  },
  "routing_nodes" : {
    "unassigned" : [],
    "nodes" : {
      "Wmh4Qg6YStGeQwiihc7Wvw" : [],
      "44DUR4IFSQStThQWZoGpzg" : []
    }
  }
}
```

---

<div class="post-metadata">

**Author:** ![pjayramkumar](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pjayramkumar](https://discuss.elastic.co/u/pjayramkumar)\
**Post date:** [May 22, 2017, 8:02am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/10 "2017-05-22T08:02:56Z")

</div>

then i created node 3

`bin/elasticsearch -Epath.data=/usr/share/elasticsearch/data/node_3 -Epath.logs=/var/log/elasticsearch/node_3 -Enode.name=node_3`

Log of node 3

```
[2017-05-22T07:31:34,385][INFO][o.e.n.Node] [node_3] initializing ...
[2017-05-22T07:31:34,476][INFO][o.e.e.NodeEnvironment] [node_3] using [1] data paths, mounts [[/ (rootfs)]], net usable_space [52.8gb], net total_space [59gb], spins? [unknown], types [rootfs]
[2017-05-22T07:31:34,477][INFO][o.e.e.NodeEnvironment] [node_3] heap size [247.5mb], compressed ordinary object pointers [true]
[2017-05-22T07:31:34,479][INFO][o.e.n.Node] [node_3] node name [node_3], node ID [Wmh4Qg6YStGeQwiihc7Wvw]
[2017-05-22T07:31:34,479][INFO][o.e.n.Node] [node_3] version[5.4.0], pid[10350], build[780f8c4/2017-04-28T17:43:27.229Z], OS[Linux/3.10.0-514.16.1.el7.x86_64/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_131/25.131-b11]
[2017-05-22T07:31:35,559][INFO][o.e.p.PluginsService] [node_3] loaded module [aggs-matrix-stats]
[2017-05-22T07:31:35,559][INFO][o.e.p.PluginsService] [node_3] loaded module [ingest-common]
[2017-05-22T07:31:35,560][INFO][o.e.p.PluginsService] [node_3] loaded module [lang-expression]
[2017-05-22T07:31:35,560][INFO][o.e.p.PluginsService] [node_3] loaded module [lang-groovy]
[2017-05-22T07:31:35,560][INFO][o.e.p.PluginsService] [node_3] loaded module [lang-mustache]
[2017-05-22T07:31:35,560][INFO][o.e.p.PluginsService] [node_3] loaded module [lang-painless]
[2017-05-22T07:31:35,560][INFO][o.e.p.PluginsService] [node_3] loaded module [percolator]
[2017-05-22T07:31:35,560][INFO][o.e.p.PluginsService] [node_3] loaded module [reindex]
[2017-05-22T07:31:35,560][INFO][o.e.p.PluginsService] [node_3] loaded module [transport-netty3]
[2017-05-22T07:31:35,560][INFO][o.e.p.PluginsService] [node_3] loaded module [transport-netty4]
[2017-05-22T07:31:35,561][INFO][o.e.p.PluginsService] [node_3] no plugins loaded
[2017-05-22T07:31:37,291][INFO][o.e.d.DiscoveryModule] [node_3] using discovery type [zen]
[2017-05-22T07:31:38,079][INFO][o.e.n.Node] [node_3] initialized
[2017-05-22T07:31:38,079][INFO][o.e.n.Node] [node_3] starting ...
[2017-05-22T07:31:38,262][INFO][o.e.t.TransportService] [node_3] publish_address {127.0.0.1:9302}, bound_addresses {[::1]:9302}, {127.0.0.1:9302}
[2017-05-22T07:31:41,449][INFO][o.e.c.s.ClusterService] [node_3] detected_master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300}, added {{node_2}{Yl38JzyUT_S83xbv2rdK8Q}{rD09EHEWTUG935Iyx2Wk6Q}{127.0.0.1}{127.0.0.1:9301},{node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300},}, reason: zen-disco-receive(from master [master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300} committed version [10]])
[2017-05-22T07:32:08,302][WARN][o.e.n.Node] [node_3] timed out while waiting for initial discovery state - timeout: 30s
[2017-05-22T07:32:08,325][INFO][o.e.h.n.Netty4HttpServerTransport] [node_3] publish_address {127.0.0.1:9202}, bound_addresses {[::1]:9202}, {127.0.0.1:9202}
[2017-05-22T07:32:08,329][INFO][o.e.n.Node] [node_3] started
[2017-05-22T07:32:11,473][WARN][o.e.c.NodeConnectionsService] [node_3] failed to connect to node {node_2}{Yl38JzyUT_S83xbv2rdK8Q}{rD09EHEWTUG935Iyx2Wk6Q}{127.0.0.1}{127.0.0.1:9301} (tried [1] times)
org.elasticsearch.transport.ConnectTransportException: [node_2][127.0.0.1:9301] handshake_timeout[30s]
	at org.elasticsearch.transport.TcpTransport.executeHandshake(TcpTransport.java:1589) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:533) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TcpTransport.connectToNode(TcpTransport.java:465) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:315) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:302) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.cluster.NodeConnectionsService.validateAndConnectIfNeeded(NodeConnectionsService.java:154) [elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.cluster.NodeConnectionsService$1.doRun(NodeConnectionsService.java:107) [elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:638) [elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-5.4.0.jar:5.4.0]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_131]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_131]
	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]
[2017-05-22T07:32:11,520][WARN][o.e.c.s.ClusterService] [node_3] cluster state update task [zen-disco-receive(from master [master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300} committed version [10]])] took [30s] above the warn threshold of 30s
[2017-05-22T07:32:39,450][INFO][o.e.c.s.ClusterService] [node_3] removed {{node_2}{Yl38JzyUT_S83xbv2rdK8Q}{rD09EHEWTUG935Iyx2Wk6Q}{127.0.0.1}{127.0.0.1:9301},}, reason: zen-disco-receive(from master [master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300} committed version [11]])
```

---

<div class="post-metadata">

**Author:** ![pjayramkumar](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pjayramkumar](https://discuss.elastic.co/u/pjayramkumar)\
**Post date:** [May 22, 2017, 8:03am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/11 "2017-05-22T08:03:08Z")

</div>

and out put of curl -XGET '[http://localhost:9200/\_cluster/state?pretty](http://localhost:9200/_cluster/state?pretty)'

```
{
  "cluster_name" : "cs",
  "version" : 11,
  "state_uuid" : "IWtBtfC9Rf2pFfktRhYBuA",
  "master_node" : "44DUR4IFSQStThQWZoGpzg",
  "blocks" : { },
  "nodes" : {
    "Wmh4Qg6YStGeQwiihc7Wvw" : {
      "name" : "node_3",
      "ephemeral_id" : "QCbe0cxbQNWXu6cdnpM_Zw",
      "transport_address" : "127.0.0.1:9302",
      "attributes" : { }
    },
    "44DUR4IFSQStThQWZoGpzg" : {
      "name" : "node_1",
      "ephemeral_id" : "05XVwjEDRzumU88ojR-weQ",
      "transport_address" : "127.0.0.1:9300",
      "attributes" : { }
    }
  },
  "metadata" : {
    "cluster_uuid" : "VrqDSExLRM2ErjLzoYLovg",
    "templates" : { },
    "indices" : { },
    "index-graveyard" : {
      "tombstones" : []
    }
  },
  "routing_table" : {
    "indices" : { }
  },
  "routing_nodes" : {
    "unassigned" : [],
    "nodes" : {
      "Wmh4Qg6YStGeQwiihc7Wvw" : [],
      "44DUR4IFSQStThQWZoGpzg" : []
    }
  }
}

```

then after 30 min i fired the "curl -XGET '[http://localhost:9200/\_cluster/state?pretty](http://localhost:9200/_cluster/state?pretty)'"

and output

```
{
  "cluster_name" : "cs",
  "version" : 12,
  "state_uuid" : "7mmc-Go7QRqDA_h79s59vA",
  "master_node" : "44DUR4IFSQStThQWZoGpzg",
  "blocks" : { },
  "nodes" : {
    "44DUR4IFSQStThQWZoGpzg" : {
      "name" : "node_1",
      "ephemeral_id" : "05XVwjEDRzumU88ojR-weQ",
      "transport_address" : "127.0.0.1:9300",
      "attributes" : { }
    }
  },
  "metadata" : {
    "cluster_uuid" : "VrqDSExLRM2ErjLzoYLovg",
    "templates" : { },
    "indices" : { },
    "index-graveyard" : {
      "tombstones" : []
    }
  },
  "routing_table" : {
    "indices" : { }
  },
  "routing_nodes" : {
    "unassigned" : [],
    "nodes" : {
      "44DUR4IFSQStThQWZoGpzg" : []
    }
  }
}

```

i think now you understand what i am trying to explain you

i have to divide the reply in several post because of lenght

please reply asap

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [May 22, 2017, 8:29am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/12 "2017-05-22T08:29:00Z")

</div>

Can you do that again from start but remove first all your data dirs before restarting nodes

---

<div class="post-metadata">

**Author:** ![pjayramkumar](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pjayramkumar](https://discuss.elastic.co/u/pjayramkumar)\
**Post date:** [May 22, 2017, 8:30am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/13 "2017-05-22T08:30:16Z")

</div>

i did that already with remove the folder and restarting the nodes

and then i explained you as above

please look at that

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [May 22, 2017, 11:25am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/14 "2017-05-22T11:25:31Z")

</div>

When you start node2 and check the cluster state, it can not show node3.

You are not telling everything or you did not do what I asked.

---

<div class="post-metadata">

**Author:** ![pjayramkumar](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pjayramkumar](https://discuss.elastic.co/u/pjayramkumar)\
**Post date:** [May 22, 2017, 11:28am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/15 "2017-05-22T11:28:35Z")

</div>

it's because of copy past instead of node\_3 you can consider node\_2

but the issue is that it remove the old node and even not create new node

thanks

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [May 22, 2017, 2:14pm UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/16 "2017-05-22T14:14:11Z")

</div>

Sorry but if you can provide all the steps in the right order with the right responses from elasticsearch and the logs, that will help a lot to understand what is happening.

---

<div class="post-metadata">

**Author:** ![pjayramkumar](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pjayramkumar](https://discuss.elastic.co/u/pjayramkumar)\
**Post date:** [May 23, 2017, 5:58am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/17 "2017-05-23T05:58:51Z")

</div>

Hello

i solve that myself now

but still one issue

when i add node via terminal using command it added

but when i close the terminal then it's removed

so what should be the issue

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [May 23, 2017, 6:28am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/18 "2017-05-23T06:28:15Z")

</div>

If you close the terminal which starts a foreground process then the process is closed.

If you want to run it as a service that's another story.

Look at the documentation on how to run it in background or install as a service

---

<div class="post-metadata">

**Author:** ![pjayramkumar](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pjayramkumar](https://discuss.elastic.co/u/pjayramkumar)\
**Post date:** [May 23, 2017, 7:06am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/19 "2017-05-23T07:06:35Z")

</div>

i know it's another story because old story i finished by myself

can you give me docs about that

so i can follow that

i have restart many time like this service "service elasticsearch restart"

i that service you are talking about

thanks

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [May 23, 2017, 7:43am UTC](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436/20 "2017-05-23T07:43:13Z")

</div>

Start here: [https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html](https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html)

Then if you want to run manually as a daemon, read [https://www.elastic.co/guide/en/elasticsearch/reference/current/zip-targz.html#setup-installation-daemon](https://www.elastic.co/guide/en/elasticsearch/reference/current/zip-targz.html#setup-installation-daemon)

[Next page](https://discuss.elastic.co/t/when-add-new-node-in-elasticsearch-5-4-old-node-deleted/86436.md?page=2)
