When add new node in elasticsearch 5.4 old node deleted

Elastic Stack Elasticsearch
1

Hello

I created a node via command as elasticsearch user in server

here is command

bin/elasticsearch -Epath.data=/usr/share/elasticsearch/data/node_3 -Epath.logs=/var/log/elasticsearch/node_3 -Enode.name=fan

then it's showing fine

then i add another via command

bin/elasticsearch -Epath.data=/usr/share/elasticsearch/data/node_4 -Epath.logs=/var/log/elasticsearch/node_4 -Enode.name=fan_1

then fan is remove when i fire query like this

curl -XGET 'http://localhost:9200/_cluster/state?pretty'

what is missing please guide me

2

Please format your code using </> icon as explained in this guide. It will make your post more readable.

Or use markdown style like:

```
CODE
```

If you share logs of both nodes that might help to answer.

3 
[2017-05-19T13:20:27,612][INFO ][o.e.n.Node               ] [paresh] initializing ...
[2017-05-19T13:20:27,715][INFO ][o.e.e.NodeEnvironment    ] [paresh] using [1] data paths, mounts [[/ (rootfs)]], net usable_space [52.9gb], net total_space [59gb], spins? [unknown], types [rootfs]
[2017-05-19T13:20:27,715][INFO ][o.e.e.NodeEnvironment    ] [paresh] heap size [247.5mb], compressed ordinary object pointers [true]
[2017-05-19T13:20:27,718][INFO ][o.e.n.Node               ] [paresh] node name [paresh], node ID [oDsesoB-QwCcKEAlWbytzw]
[2017-05-19T13:20:27,719][INFO ][o.e.n.Node               ] [paresh] version[5.4.0], pid[21524], build[780f8c4/2017-04-28T17:43:27.229Z], OS[Linux/3.10.0-514.16.1.el7.x86_64/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_131/25.131-b11]
[2017-05-19T13:20:29,029][INFO ][o.e.p.PluginsService     ] [paresh] loaded module [aggs-matrix-stats]
[2017-05-19T13:20:29,029][INFO ][o.e.p.PluginsService     ] [paresh] loaded module [ingest-common]
[2017-05-19T13:20:29,029][INFO ][o.e.p.PluginsService     ] [paresh] loaded module [lang-expression]
[2017-05-19T13:20:29,029][INFO ][o.e.p.PluginsService     ] [paresh] loaded module [lang-groovy]
[2017-05-19T13:20:29,030][INFO ][o.e.p.PluginsService     ] [paresh] loaded module [lang-mustache]
[2017-05-19T13:20:29,030][INFO ][o.e.p.PluginsService     ] [paresh] loaded module [lang-painless]
[2017-05-19T13:20:29,030][INFO ][o.e.p.PluginsService     ] [paresh] loaded module [percolator]
[2017-05-19T13:20:29,030][INFO ][o.e.p.PluginsService     ] [paresh] loaded module [reindex]
[2017-05-19T13:20:29,030][INFO ][o.e.p.PluginsService     ] [paresh] loaded module [transport-netty3]
[2017-05-19T13:20:29,030][INFO ][o.e.p.PluginsService     ] [paresh] loaded module [transport-netty4]
[2017-05-19T13:20:29,031][INFO ][o.e.p.PluginsService     ] [paresh] no plugins loaded
[2017-05-19T13:20:30,869][INFO ][o.e.d.DiscoveryModule    ] [paresh] using discovery type [zen]
[2017-05-19T13:20:31,708][INFO ][o.e.n.Node               ] [paresh] initialized
[2017-05-19T13:20:31,708][INFO ][o.e.n.Node               ] [paresh] starting ...
[2017-05-19T13:20:32,092][INFO ][o.e.t.TransportService   ] [paresh] publish_address {127.0.0.1:9302}, bound_addresses {[::1]:9302}, {127.0.0.1:9302}
[2017-05-19T13:20:35,472][INFO ][o.e.c.s.ClusterService   ] [paresh] detected_master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300}, added {{fangels}{n0UBDKQOTIanjtVUL_sPlQ}{eYkGb8VkRna0Zsw082ZZYg}{127.0.0.1}{127.0.0.1:9301},{node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300},}, reason: zen-disco-receive(from master [master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300} committed version [6]])
[2017-05-19T13:21:02,191][WARN ][o.e.n.Node               ] [paresh] timed out while waiting for initial discovery state - timeout: 30s
[2017-05-19T13:21:02,231][INFO ][o.e.h.n.Netty4HttpServerTransport] [paresh] publish_address {127.0.0.1:9202}, bound_addresses {[::1]:9202}, {127.0.0.1:9202}
[2017-05-19T13:21:02,243][INFO ][o.e.n.Node               ] [paresh] started
[2017-05-19T13:21:05,501][WARN ][o.e.c.NodeConnectionsService] [paresh] failed to connect to node {fangels}{n0UBDKQOTIanjtVUL_sPlQ}{eYkGb8VkRna0Zsw082ZZYg}{127.0.0.1}{127.0.0.1:9301} (tried [1] times)
org.elasticsearch.transport.ConnectTransportException: [fangels][127.0.0.1:9301] handshake_timeout[30s]
	at org.elasticsearch.transport.TcpTransport.executeHandshake(TcpTransport.java:1589) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:533) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TcpTransport.connectToNode(TcpTransport.java:465) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:315) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:302) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.cluster.NodeConnectionsService.validateAndConnectIfNeeded(NodeConnectionsService.java:154) [elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.cluster.NodeConnectionsService$1.doRun(NodeConnectionsService.java:107) [elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:638) [elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-5.4.0.jar:5.4.0]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_131]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_131]
	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]
[2017-05-19T13:21:05,529][WARN ][o.e.c.s.ClusterService   ] [paresh] cluster state update task [zen-disco-receive(from master [master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300} committed version [6]])] took [30s] above the warn threshold of 30s
[2017-05-19T13:21:28,213][INFO ][o.e.c.s.ClusterService   ] [paresh] removed {{fangels}{n0UBDKQOTIanjtVUL_sPlQ}{eYkGb8VkRna0Zsw082ZZYg}{127.0.0.1}{127.0.0.1:9301},}, reason: zen-disco-receive(from master [master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300} committed version [7]])
4

hello

i am waiting for reply can you please reply

it's really a help if you reply soon

5

It is unclear what are the steps you did.

Did you start 4 nodes on your machine? I believe it's for tests right?

As you wrote, when I'm starting 4 nodes on the same machine for demos, I'm running:

bin/elasticsearch -Epath.data=./data1 -Epath.logs=./logs1 -Enode.name=node1
bin/elasticsearch -Epath.data=./data2 -Epath.logs=./logs2 -Enode.name=node2
bin/elasticsearch -Epath.data=./data3 -Epath.logs=./logs3 -Enode.name=node3
bin/elasticsearch -Epath.data=./data4 -Epath.logs=./logs4 -Enode.name=node4

Can you please stop all the nodes. Then start the first one.
Then wait. Then start a second one.
If it works, then a third one.

If it does not work, then copy all the logs from all nodes here.

6

i have started one via xml

then i try to create second via command

then it showing in node list

but when i try to add third then second one deleted that i created via command

and even after 1 day the third one also remove from the list of the

nodes

so what's should i need to do

7

I have no idea of this means:

i have started one via xml

8

Here is full explanation about the issue

1st node via elasticsearch.xml

path:
  data: /usr/share/elasticsearch/data/node_1
  logs: /var/log/elasticsearch/node_1

cluster.name: cs

node.name: node_1

bootstrap.memory_lock: true
9

second Node : node_2 via command

bin/elasticsearch -Epath.data=/usr/share/elasticsearch/data/node_2 -Epath.logs=/var/log/elasticsearch/node_2 -Enode.name=node_2

Log of second Node

[2017-05-22T07:28:24,745][INFO ][o.e.n.Node               ] [node_2] initializing ...
[2017-05-22T07:28:24,854][INFO ][o.e.e.NodeEnvironment    ] [node_2] using [1] data paths, mounts [[/ (rootfs)]], net usable_space [52.8gb], net total_space [59gb], spins? [unknown], types [rootfs]
[2017-05-22T07:28:24,854][INFO ][o.e.e.NodeEnvironment    ] [node_2] heap size [247.5mb], compressed ordinary object pointers [true]
[2017-05-22T07:28:24,856][INFO ][o.e.n.Node               ] [node_2] node name [node_2], node ID [Yl38JzyUT_S83xbv2rdK8Q]
[2017-05-22T07:28:24,857][INFO ][o.e.n.Node               ] [node_2] version[5.4.0], pid[10215], build[780f8c4/2017-04-28T17:43:27.229Z], OS[Linux/3.10.0-514.16.1.el7.x86_64/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_131/25.131-b11]
[2017-05-22T07:28:25,992][INFO ][o.e.p.PluginsService     ] [node_2] loaded module [aggs-matrix-stats]
[2017-05-22T07:28:25,992][INFO ][o.e.p.PluginsService     ] [node_2] loaded module [ingest-common]
[2017-05-22T07:28:25,992][INFO ][o.e.p.PluginsService     ] [node_2] loaded module [lang-expression]
[2017-05-22T07:28:25,992][INFO ][o.e.p.PluginsService     ] [node_2] loaded module [lang-groovy]
[2017-05-22T07:28:25,992][INFO ][o.e.p.PluginsService     ] [node_2] loaded module [lang-mustache]
[2017-05-22T07:28:25,992][INFO ][o.e.p.PluginsService     ] [node_2] loaded module [lang-painless]
[2017-05-22T07:28:25,992][INFO ][o.e.p.PluginsService     ] [node_2] loaded module [percolator]
[2017-05-22T07:28:25,993][INFO ][o.e.p.PluginsService     ] [node_2] loaded module [reindex]
[2017-05-22T07:28:25,993][INFO ][o.e.p.PluginsService     ] [node_2] loaded module [transport-netty3]
[2017-05-22T07:28:25,993][INFO ][o.e.p.PluginsService     ] [node_2] loaded module [transport-netty4]
[2017-05-22T07:28:25,993][INFO ][o.e.p.PluginsService     ] [node_2] no plugins loaded
[2017-05-22T07:28:27,934][INFO ][o.e.d.DiscoveryModule    ] [node_2] using discovery type [zen]
[2017-05-22T07:28:28,564][INFO ][o.e.n.Node               ] [node_2] initialized
[2017-05-22T07:28:28,564][INFO ][o.e.n.Node               ] [node_2] starting ...
[2017-05-22T07:28:28,764][INFO ][o.e.t.TransportService   ] [node_2] publish_address {127.0.0.1:9301}, bound_addresses {[::1]:9301}, {127.0.0.1:9301}
[2017-05-22T07:28:32,026][INFO ][o.e.c.s.ClusterService   ] [node_2] detected_master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300}, added {{node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300},}, reason: zen-disco-receive(from master [master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300} committed version [9]])
[2017-05-22T07:28:32,141][INFO ][o.e.h.n.Netty4HttpServerTransport] [node_2] publish_address {127.0.0.1:9201}, bound_addresses {[::1]:9201}, {127.0.0.1:9201}
[2017-05-22T07:28:32,146][INFO ][o.e.n.Node               ] [node_2] started

And output of

curl -XGET 'http://localhost:9200/_cluster/state?pretty'

{
  "cluster_name" : "cs",
  "version" : 11,
  "state_uuid" : "IWtBtfC9Rf2pFfktRhYBuA",
  "master_node" : "44DUR4IFSQStThQWZoGpzg",
  "blocks" : { },
  "nodes" : {
    "Wmh4Qg6YStGeQwiihc7Wvw" : {
      "name" : "node_3",
      "ephemeral_id" : "QCbe0cxbQNWXu6cdnpM_Zw",
      "transport_address" : "127.0.0.1:9302",
      "attributes" : { }
    },
    "44DUR4IFSQStThQWZoGpzg" : {
      "name" : "node_1",
      "ephemeral_id" : "05XVwjEDRzumU88ojR-weQ",
      "transport_address" : "127.0.0.1:9300",
      "attributes" : { }
    }
  },
  "metadata" : {
    "cluster_uuid" : "VrqDSExLRM2ErjLzoYLovg",
    "templates" : { },
    "indices" : { },
    "index-graveyard" : {
      "tombstones" : [ ]
    }
  },
  "routing_table" : {
    "indices" : { }
  },
  "routing_nodes" : {
    "unassigned" : [ ],
    "nodes" : {
      "Wmh4Qg6YStGeQwiihc7Wvw" : [ ],
      "44DUR4IFSQStThQWZoGpzg" : [ ]
    }
  }
}
10

then i created node 3

bin/elasticsearch -Epath.data=/usr/share/elasticsearch/data/node_3 -Epath.logs=/var/log/elasticsearch/node_3 -Enode.name=node_3

Log of node 3

[2017-05-22T07:31:34,385][INFO ][o.e.n.Node               ] [node_3] initializing ...
[2017-05-22T07:31:34,476][INFO ][o.e.e.NodeEnvironment    ] [node_3] using [1] data paths, mounts [[/ (rootfs)]], net usable_space [52.8gb], net total_space [59gb], spins? [unknown], types [rootfs]
[2017-05-22T07:31:34,477][INFO ][o.e.e.NodeEnvironment    ] [node_3] heap size [247.5mb], compressed ordinary object pointers [true]
[2017-05-22T07:31:34,479][INFO ][o.e.n.Node               ] [node_3] node name [node_3], node ID [Wmh4Qg6YStGeQwiihc7Wvw]
[2017-05-22T07:31:34,479][INFO ][o.e.n.Node               ] [node_3] version[5.4.0], pid[10350], build[780f8c4/2017-04-28T17:43:27.229Z], OS[Linux/3.10.0-514.16.1.el7.x86_64/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_131/25.131-b11]
[2017-05-22T07:31:35,559][INFO ][o.e.p.PluginsService     ] [node_3] loaded module [aggs-matrix-stats]
[2017-05-22T07:31:35,559][INFO ][o.e.p.PluginsService     ] [node_3] loaded module [ingest-common]
[2017-05-22T07:31:35,560][INFO ][o.e.p.PluginsService     ] [node_3] loaded module [lang-expression]
[2017-05-22T07:31:35,560][INFO ][o.e.p.PluginsService     ] [node_3] loaded module [lang-groovy]
[2017-05-22T07:31:35,560][INFO ][o.e.p.PluginsService     ] [node_3] loaded module [lang-mustache]
[2017-05-22T07:31:35,560][INFO ][o.e.p.PluginsService     ] [node_3] loaded module [lang-painless]
[2017-05-22T07:31:35,560][INFO ][o.e.p.PluginsService     ] [node_3] loaded module [percolator]
[2017-05-22T07:31:35,560][INFO ][o.e.p.PluginsService     ] [node_3] loaded module [reindex]
[2017-05-22T07:31:35,560][INFO ][o.e.p.PluginsService     ] [node_3] loaded module [transport-netty3]
[2017-05-22T07:31:35,560][INFO ][o.e.p.PluginsService     ] [node_3] loaded module [transport-netty4]
[2017-05-22T07:31:35,561][INFO ][o.e.p.PluginsService     ] [node_3] no plugins loaded
[2017-05-22T07:31:37,291][INFO ][o.e.d.DiscoveryModule    ] [node_3] using discovery type [zen]
[2017-05-22T07:31:38,079][INFO ][o.e.n.Node               ] [node_3] initialized
[2017-05-22T07:31:38,079][INFO ][o.e.n.Node               ] [node_3] starting ...
[2017-05-22T07:31:38,262][INFO ][o.e.t.TransportService   ] [node_3] publish_address {127.0.0.1:9302}, bound_addresses {[::1]:9302}, {127.0.0.1:9302}
[2017-05-22T07:31:41,449][INFO ][o.e.c.s.ClusterService   ] [node_3] detected_master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300}, added {{node_2}{Yl38JzyUT_S83xbv2rdK8Q}{rD09EHEWTUG935Iyx2Wk6Q}{127.0.0.1}{127.0.0.1:9301},{node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300},}, reason: zen-disco-receive(from master [master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300} committed version [10]])
[2017-05-22T07:32:08,302][WARN ][o.e.n.Node               ] [node_3] timed out while waiting for initial discovery state - timeout: 30s
[2017-05-22T07:32:08,325][INFO ][o.e.h.n.Netty4HttpServerTransport] [node_3] publish_address {127.0.0.1:9202}, bound_addresses {[::1]:9202}, {127.0.0.1:9202}
[2017-05-22T07:32:08,329][INFO ][o.e.n.Node               ] [node_3] started
[2017-05-22T07:32:11,473][WARN ][o.e.c.NodeConnectionsService] [node_3] failed to connect to node {node_2}{Yl38JzyUT_S83xbv2rdK8Q}{rD09EHEWTUG935Iyx2Wk6Q}{127.0.0.1}{127.0.0.1:9301} (tried [1] times)
org.elasticsearch.transport.ConnectTransportException: [node_2][127.0.0.1:9301] handshake_timeout[30s]
	at org.elasticsearch.transport.TcpTransport.executeHandshake(TcpTransport.java:1589) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:533) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TcpTransport.connectToNode(TcpTransport.java:465) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:315) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:302) ~[elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.cluster.NodeConnectionsService.validateAndConnectIfNeeded(NodeConnectionsService.java:154) [elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.cluster.NodeConnectionsService$1.doRun(NodeConnectionsService.java:107) [elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:638) [elasticsearch-5.4.0.jar:5.4.0]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-5.4.0.jar:5.4.0]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_131]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_131]
	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]
[2017-05-22T07:32:11,520][WARN ][o.e.c.s.ClusterService   ] [node_3] cluster state update task [zen-disco-receive(from master [master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300} committed version [10]])] took [30s] above the warn threshold of 30s
[2017-05-22T07:32:39,450][INFO ][o.e.c.s.ClusterService   ] [node_3] removed {{node_2}{Yl38JzyUT_S83xbv2rdK8Q}{rD09EHEWTUG935Iyx2Wk6Q}{127.0.0.1}{127.0.0.1:9301},}, reason: zen-disco-receive(from master [master {node_1}{44DUR4IFSQStThQWZoGpzg}{05XVwjEDRzumU88ojR-weQ}{127.0.0.1}{127.0.0.1:9300} committed version [11]])
11

and out put of curl -XGET 'http://localhost:9200/_cluster/state?pretty'

{
  "cluster_name" : "cs",
  "version" : 11,
  "state_uuid" : "IWtBtfC9Rf2pFfktRhYBuA",
  "master_node" : "44DUR4IFSQStThQWZoGpzg",
  "blocks" : { },
  "nodes" : {
    "Wmh4Qg6YStGeQwiihc7Wvw" : {
      "name" : "node_3",
      "ephemeral_id" : "QCbe0cxbQNWXu6cdnpM_Zw",
      "transport_address" : "127.0.0.1:9302",
      "attributes" : { }
    },
    "44DUR4IFSQStThQWZoGpzg" : {
      "name" : "node_1",
      "ephemeral_id" : "05XVwjEDRzumU88ojR-weQ",
      "transport_address" : "127.0.0.1:9300",
      "attributes" : { }
    }
  },
  "metadata" : {
    "cluster_uuid" : "VrqDSExLRM2ErjLzoYLovg",
    "templates" : { },
    "indices" : { },
    "index-graveyard" : {
      "tombstones" : [ ]
    }
  },
  "routing_table" : {
    "indices" : { }
  },
  "routing_nodes" : {
    "unassigned" : [ ],
    "nodes" : {
      "Wmh4Qg6YStGeQwiihc7Wvw" : [ ],
      "44DUR4IFSQStThQWZoGpzg" : [ ]
    }
  }
}

then after 30 min i fired the "curl -XGET 'http://localhost:9200/_cluster/state?pretty'"

and output

{
  "cluster_name" : "cs",
  "version" : 12,
  "state_uuid" : "7mmc-Go7QRqDA_h79s59vA",
  "master_node" : "44DUR4IFSQStThQWZoGpzg",
  "blocks" : { },
  "nodes" : {
    "44DUR4IFSQStThQWZoGpzg" : {
      "name" : "node_1",
      "ephemeral_id" : "05XVwjEDRzumU88ojR-weQ",
      "transport_address" : "127.0.0.1:9300",
      "attributes" : { }
    }
  },
  "metadata" : {
    "cluster_uuid" : "VrqDSExLRM2ErjLzoYLovg",
    "templates" : { },
    "indices" : { },
    "index-graveyard" : {
      "tombstones" : [ ]
    }
  },
  "routing_table" : {
    "indices" : { }
  },
  "routing_nodes" : {
    "unassigned" : [ ],
    "nodes" : {
      "44DUR4IFSQStThQWZoGpzg" : [ ]
    }
  }
}

i think now you understand what i am trying to explain you

i have to divide the reply in several post because of lenght

please reply asap

12

Can you do that again from start but remove first all your data dirs before restarting nodes

13

i did that already with remove the folder and restarting the nodes

and then i explained you as above

please look at that

14

When you start node2 and check the cluster state, it can not show node3.

You are not telling everything or you did not do what I asked.

15

it's because of copy past instead of node_3 you can consider node_2

but the issue is that it remove the old node and even not create new node

thanks

16

Sorry but if you can provide all the steps in the right order with the right responses from elasticsearch and the logs, that will help a lot to understand what is happening.

17

Hello

i solve that myself now

but still one issue

when i add node via terminal using command it added

but when i close the terminal then it's removed

so what should be the issue

18

If you close the terminal which starts a foreground process then the process is closed.

If you want to run it as a service that's another story.

Look at the documentation on how to run it in background or install as a service

19

i know it's another story because old story i finished by myself

can you give me docs about that

so i can follow that

i have restart many time like this service "service elasticsearch restart"

i that service you are talking about

thanks

20

Start here: https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html

Then if you want to run manually as a daemon, read https://www.elastic.co/guide/en/elasticsearch/reference/current/zip-targz.html#setup-installation-daemon