Hi all,
I've been working with this ELK solution for a few years and I can't restart all the nodes in a cluster to ... start from zero with a new cluster
1st - Delete all stored data
I can delete indexes ... (from command line)
curl -X DELETE "node: port / index_name"
for example a full erase
curl -X DELETE "192.168.72.10:9200/*"
2nd - Configure a new cluster - clean
My new cluster
Node: prso-home-1 (192.168.72.4)
cluster.name: PRSO_2021
node.name: prso-home-1
node.ingest: true
node.data: true
node.master: true
path.data: / var / lib / elasticsearch
path.logs: / var / log / elasticsearch
network.host: 192.168.72.4
discovery.seed_hosts: ["192.168.72.4", "192.168.72.5", "192.168.72.10", "192.168.72.20"]
cluster.initial_master_nodes: ["prso-elk-viten-1", "prso-home-1", "prso-elk-dm-1"]
Node: prso-elk-dm-1 (192.168.72.10)
cluster.name: PRSO_2021
node.name: prso-elk-dm-1
node.ingest: true
node.data: true
node.master: true
path.data: / var / lib / elasticsearch
path.logs: / var / log / elasticsearch
network.host: 192.168.72.10
discovery.seed_hosts: ["192.168.72.10", "192.168.72.4", "192.168.72.5", "192.168.72.20"]
cluster.initial_master_nodes: ["prso-elk-viten-1", "prso-home-1", "prso-elk-dm-1"]
Node: prso-elk-viten-1 (192.168.72.20)
cluster.name: PRSO_2021
node.name: prso-elk-viten-1
node.ingest: true
node.data: true
node.master: true
path.data: / var / lib / elasticsearch
path.logs: / var / log / elasticsearch
network.host: 192.168.72.20
discovery.seed_hosts: ["192.168.72.20", "192.168.72.4", "192.168.72.5", "192.168.72.10"]
cluster.initial_master_nodes: ["prso-elk-viten-1", "prso-home-1", "prso-elk-dm-1"]
The node 192.168.72.5 I have not yet turned on
Errors - received:
Prso-home-1 node
[2021-02-10T07: 47: 43,900] [WARN] [oeccCoordinator] [prso-home-1] failed to validate incoming join request from node [{prso-elk-viten-1} {ZPUhwBeiRM65AllVbmAnPA} {deSn9qdBRO-MxBuwWIOqNA } {192.168.72.20} {192.168.72.20:9300} {cdhilmrstw} {ml.machine_memory = 8589934592, ml.max_open_jobs = 20, xpack.installed = true, transform.node = true}]
org.elasticsearch.transport.RemoteTransportException: [prso-elk-viten-1] [192.168.72.20:9300] [internal: cluster / coordination / join / validate]
Prso-elk-viten-1 node
Caused by: org.elasticsearch.transport.RemoteTransportException: [prso-elk-viten-1] [192.168.72.20:9300] [internal: cluster / coordination / join / validate]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: join validation on cluster state with a different cluster uuid 1epEQFGfRgqPhi7Z1qfQ1Q than local cluster uuid nx6DeRiiTXS1zwX3gf6BvQ, rejecting
Prso-elk-dm-1 node
[2021-02-10T00: 40: 59,182] [INFO] [oecsClusterApplierService] [prso-elk-dm-1] master node changed {previous [{prso-home-1} {X-qTdaIoSuKqud-1AIayZQ} {BKUNpp47SaW82wXMMgmgyw} {192.168.72.4} {192.168.72.4:9300} {cdhilmrstw} {ml.machine_memory = 7516192768, ml.max_open_jobs = 20, xpack.installed = true, transform.node = true}], current }, term: 475 , version: 191, reason: becoming candidate: onLeaderFailure
Objective - reset the nodes to initialize a new cluster - clean and with new roles
Some advice before uninstalling elasticsearch - delete all files - reinstall elasticsearch ... let's see what happens.
Thank you very much
Pablo