network.host: 0.0.0.0
discovery.seed_hosts: < same as node 1>
transport.host: 0.0.0.0
```
Node 2 is generatng:
```auto
ERROR:Skipping security auto configurationbecause, this node is confiugred to bootstrap or to join a multi-node cluster, which is not supported., with exit code 80
```
I believe I addressed your changes. I appreciate any additional insight.
---
### Author:  [@stephenb](https://discuss.elastic.co/u/stephenb)
#### Post date: [December 27, 2024, 9:06pm UTC](https://discuss.elastic.co/t/adding-a-node-to-a-cluster-using-3-hosts-almalinux-9-elasticsearch-8-17/372464/4 "2024-12-27T21:06:44Z")
What other settings are set in your In your first node, can you please share the entire elasticsearch.yml
> [@Trent-alex](#):
>
> THis node is a fully-formed single node cluster,
This implies you have [single-node-discovery](https://www.elastic.co/guide/en/elasticsearch/reference/current/bootstrap-checks.html#single-node-discovery) set
Actually, please share both .ymls
---
### Author:  [@Trent-alex](https://discuss.elastic.co/u/Trent-alex)
#### Post date: [December 27, 2024, 9:28pm UTC](https://discuss.elastic.co/t/adding-a-node-to-a-cluster-using-3-hosts-almalinux-9-elasticsearch-8-17/372464/5 "2024-12-27T21:28:51Z")
I am actively correcting this is state now.
Node 1
```auto
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: my-application
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: her
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
#path.data: /path/to/data
#
# Path to log files:
#
#path.logs: /path/to/logs
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# By default Elasticsearch is only accessible on localhost. Set a different
# address here to expose this node on the network:
#
network.host: her
#
# By default Elasticsearch listens for HTTP traffic on the first free port it
# finds starting at 9200. Set a specific HTTP port here:
#
#http.port: 9200
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
#
discovery.seed_hosts: ["her","zel","gar"]
#
# Bootstrap the cluster using an initial set of master-eligible nodes:
#
cluster.initial_master_nodes: ["her"]
#
# For more information, consult the discovery and cluster formation module documentation.
#
# ---------------------------------- Various -----------------------------------
#
# Allow wildcard deletion of indices:
```
Node 2
```auto
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: my-application
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: zel
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
#path.data: /path/to/data
#
# Path to log files:
#
#path.logs: /path/to/logs
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# By default Elasticsearch is only accessible on localhost. Set a different
# address here to expose this node on the network:
#
network.host: zel
#
# By default Elasticsearch listens for HTTP traffic on the first free port it
# finds starting at 9200. Set a specific HTTP port here:
#
#http.port: 9200
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
#
discovery.seed_hosts: ["her","zel", "gar"]
#
# Bootstrap the cluster using an initial set of master-eligible nodes:
#
cluster.initial_master_nodes: ["her"]
#
# For more information, consult the discovery and cluster formation module documentation.
#
# ---------------------------------- Various -----------------------------------
#
# Allow wildcard deletion of indices:
#
```
---
### Author:  [@Trent-alex](https://discuss.elastic.co/u/Trent-alex)
#### Post date: [December 27, 2024, 9:35pm UTC](https://discuss.elastic.co/t/adding-a-node-to-a-cluster-using-3-hosts-almalinux-9-elasticsearch-8-17/372464/6 "2024-12-27T21:35:25Z")
With the above yml configs node 1 is still reporting that is a fully formed single -node cluster. First, Im not certain that this precludes adding more nodes. Second, if it does what configuration am I missing to stop this behavior
---
### Author:  [@stephenb](https://discuss.elastic.co/u/stephenb)
#### Post date: [December 27, 2024, 9:36pm UTC](https://discuss.elastic.co/t/adding-a-node-to-a-cluster-using-3-hosts-almalinux-9-elasticsearch-8-17/372464/7 "2024-12-27T21:36:54Z")
> [@Trent-alex](#):
>
> `transport.host: 0.0.0.0`
Those are not the entire ymls...
transport.host is not set...
also please show the actual messages not your summary of them... The more accurate and complete information you provide the quicker we can help..
---
### Author:  [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)
#### Post date: [December 27, 2024, 9:48pm UTC](https://discuss.elastic.co/t/adding-a-node-to-a-cluster-using-3-hosts-almalinux-9-elasticsearch-8-17/372464/8 "2024-12-27T21:48:46Z")
> [@stephenb](#):
>
> On the first node... Set and restart
>
> `transport.host: 0.0.0.0`
According to [the docs for this setting](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-network.html#transport-settings) this is not good advice:
> Use this setting only if you require different configurations for the transport and HTTP interfaces.
* * *
> [@stephenb](#):
>
> This implies you have [single-node-discovery](https://www.elastic.co/guide/en/elasticsearch/reference/current/bootstrap-checks.html#single-node-discovery) set
No, it doesn't. It means it's a single-node cluster with a discovery config, in this case, `discovery.seed_hosts`, which won't do anything on this node since the cluster already formed.
* * *
> [@Trent-alex](#):
>
> ```auto
> cluster.initial_master_nodes: ["her"]
>
> ```
This should not be set, according to [the docs for this setting](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-discovery-bootstrap-cluster.html):
> Do not configure this setting on nodes joining an existing cluster.
* * *
> [@Trent-alex](#):
>
> The second node does not start instead it reports
>
> ```auto
> ERROR:Skipping security auto configuration
>
> ```
You need to either use `--enrollment-token` to configure this node automatically, or else you must configure it entirely manually. You are apparently trying to do both, and ES is getting confused.
---
### Author:  [@Trent-alex](https://discuss.elastic.co/u/Trent-alex)
#### Post date: [December 27, 2024, 10:04pm UTC](https://discuss.elastic.co/t/adding-a-node-to-a-cluster-using-3-hosts-almalinux-9-elasticsearch-8-17/372464/9 "2024-12-27T22:04:17Z")
Thank you both for you added insight. Nodes 1yaml as stated above, transport.host was not changed
```auto
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: my-application
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: her
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
#path.data: /path/to/data
#
# Path to log files:
#
#path.logs: /path/to/logs
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# By default Elasticsearch is only accessible on localhost. Set a different
# address here to expose this node on the network:
#
network.host: her
#
# By default Elasticsearch listens for HTTP traffic on the first free port it
# finds starting at 9200. Set a specific HTTP port here:
#
#http.port: 9200
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
#
discovery.seed_hosts: ["her", "zel","gar"]
#
# Bootstrap the cluster using an initial set of master-eligible nodes:
#
cluster.initial_master_nodes: ["her"]
#
# For more information, consult the discovery and cluster formation module documentation.
#
# ---------------------------------- Various -----------------------------------
#
# Allow wildcard deletion of indices:
#
#action.destructive_requires_name: false
#----------------------- BEGIN SECURITY AUTO CONFIGURATION -----------------------
#
# The following settings, TLS certificates, and keys have been automatically
# generated to configure Elasticsearch security features on 27-12-2024 21:30:17
#
# --------------------------------------------------------------------------------
# Enable security features
xpack.security.enabled: true
xpack.security.enrollment.enabled: true
# Enable encryption for HTTP API client connections, such as Kibana, Logstash, and Agents
xpack.security.http.ssl:
enabled: true
keystore.path: certs/http.p12
# Enable encryption and mutual authentication between cluster nodes
xpack.security.transport.ssl:
enabled: true
verification_mode: certificate
keystore.path: certs/transport.p12
truststore.path: certs/transport.p12
#----------------------- END SECURITY AUTO CONFIGURATION -------------------------
```
It is producing this warning
```auto
2024-12-27T15:33:38,703][WARN][o.e.c.c.Coordinator] [her] This node is a fully-formed single-node cluster with cluster UUID [s_l_SZtFQ------------------------], but it is configured as if to discover other nodes and form a multi-node cluster via the [discovery.seed_hosts=[her, zel, gar]] setting. Fully-formed clusters do not attempt to discover other nodes, and nodes with different cluster UUIDs cannot belong to the same cluster. The cluster UUID persists across restarts and can only be changed by deleting the contents of the node's data path(s). Remove the discovery configuration to suppress this message. See [https://www.elastic.co/guide/en/elasticsearch/reference/8.17/modules-discovery-bootstrap-cluster.html#modules-discovery-bootstrap-cluster-joining] for more information
```
---
### Author:  [@Trent-alex](https://discuss.elastic.co/u/Trent-alex)
#### Post date: [December 27, 2024, 10:25pm UTC](https://discuss.elastic.co/t/adding-a-node-to-a-cluster-using-3-hosts-almalinux-9-elasticsearch-8-17/372464/10 "2024-12-27T22:25:11Z")
Node 2 after using enrollment token reports
```auto
[admin@zel elasticsearch-8.17.0]$ bin/elasticsearch --enrollment-token eyJ2ZXIiOiI4LjE0LjAiLCJhZHIiOlsiMTkyLjE2OC4xMC42MDo5MjAwIl0sImZnciI6IjNlYTVlOGZhYTM3ZmEzZjYzYWJjMTllM2M3MDQxZjFlNWMzOTRjMDk3ZDE5ZTQ3ZDkzNTZlY2Y1YzRhYmE0MDIiLCJrZXkiOiJqSEUxQ3BRQkhNUzJrdlh0RHk5OTpJeDE0XzkyblFnYUVkbnRjbkNtTE9BIn0=
ERROR: Skipping security auto configuration because this node is configured to bootstrap or to join a multi-node cluster, which is not supported., with exit code 80
[admin@zel elasticsearch-8.17.0]$
```
---
### Author:  [@stephenb](https://discuss.elastic.co/u/stephenb)
#### Post date: [December 27, 2024, 11:16pm UTC](https://discuss.elastic.co/t/adding-a-node-to-a-cluster-using-3-hosts-almalinux-9-elasticsearch-8-17/372464/11 "2024-12-27T23:16:06Z")
Thanks @DavidTurner for squaring me on that.... Guess I am just full of bad advice today... Ughh.. You think I would keep all this straight... After all these years...
---
### Author:  [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)
#### Post date: [December 28, 2024, 6:51pm UTC](https://discuss.elastic.co/t/adding-a-node-to-a-cluster-using-3-hosts-almalinux-9-elasticsearch-8-17/372464/12 "2024-12-28T18:51:00Z")
> [@Trent-alex](#):
>
> Node 2 after using enrollment token reports
>
> ```auto
> ...
>
> ```
You need to either use `--enrollment-token` to configure this node automatically, or else you must configure it entirely manually. You are apparently trying to do both, and ES is getting confused. (repeating my earlier message)
---
### Author:  [@stephenb](https://discuss.elastic.co/u/stephenb)
#### Post date: [December 28, 2024, 7:36pm UTC](https://discuss.elastic.co/t/adding-a-node-to-a-cluster-using-3-hosts-almalinux-9-elasticsearch-8-17/372464/13 "2024-12-28T19:36:10Z")
@DavidTurner So Here is my confusion... after running
`./bin/elasticsearch`
On an OOTB tar.gz you get these instructions
```Configure
• On this node:
⁃ Create an enrollment token with `bin/elasticsearch-create-enrollment-token -s node`.
⁃ >>> Uncomment the transport.host <<< setting at the end of config/elasticsearch.yml.
⁃ Restart Elasticsearch.
• On other nodes:
⁃ Start Elasticsearch with `bin/elasticsearch --enrollment-token `, using the enrollment token that you generated.
```
And the last lines in the config. And if you want to form a cluster that is not on localhost, you have to uncomment the last line.
```auto
# Allow HTTP API connections from anywhere
# Connections are encrypted and require user authentication
http.host: 0.0.0.0
# Allow other nodes to join the cluster from anywhere
# Connections are encrypted and mutually authenticated
#transport.host: 0.0.0.0
```
That is why I remembered to set transport host ... so our docs may be a bit confusing...
@Trent-alex
> [@DavidTurner](#):
>
> You need to either use `--enrollment-token` to configure this node automatically, or else you must configure it entirely manually. You are apparently trying to do both, and ES is getting confused. (repeating my earlier message)
What David is saying is that you are trying to both
manually configure your clusters and
trying auto-enrollment
that is why this is not working...
So what I just did on 2 computers.... for a test.
Downloaded and untarred the distros
Did not edit anything...
One the first node I ran
`./bin/elasticsearch`
Then, followed these directions...without editing anything but uncommenting the `transport.host` on the first node
Then, without editing anything on the second node, I ran the start with the enrollment token.
```auto
ℹ️ Configure other nodes to join this cluster:
• On this node:
⁃ Create an enrollment token with `bin/elasticsearch-create-enrollment-token -s node`.
⁃ Uncomment the transport.host setting at the end of config/elasticsearch.yml.
⁃ Restart Elasticsearch.
• On other nodes:
⁃ Start Elasticsearch with `bin/elasticsearch --enrollment-token `, using the enrollment token that you generated.
```
And everything worked just fine... the cluster formed.
If you want to set up everything manually ... which is good to learn... do not use the enrollment token method. You will need to learn more about discovery and cluster formation in detail
> **[Discovery and cluster formation settings | Elasticsearch Guide \[8.17\] | Elastic](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-discovery-settings.html)**
---
### Author:  [@thejackal2020](https://discuss.elastic.co/u/thejackal2020)
#### Post date: [December 28, 2024, 7:45pm UTC](https://discuss.elastic.co/t/adding-a-node-to-a-cluster-using-3-hosts-almalinux-9-elasticsearch-8-17/372464/14 "2024-12-28T19:45:15Z")
As someone who is still new, I believe using the enrollment token is the easiest way. I had some issues and redid mine and it worked. I have been working on it for a few days and after some help on the elasticsearch subreddit I got it working with the token.
---
### Author:  [@Trent-alex](https://discuss.elastic.co/u/Trent-alex)
#### Post date: [December 29, 2024, 10:49pm UTC](https://discuss.elastic.co/t/adding-a-node-to-a-cluster-using-3-hosts-almalinux-9-elasticsearch-8-17/372464/15 "2024-12-29T22:49:23Z")
Thank you all for you responses. I was able to add a second cluster. I will summarize my steps, hopefully this help the next person. Please note following occured before @stephenb last post but you can see the commonalities.
My primary references are:
[Add and remove nodes in your cluster | Elasticsearch Guide [8.17] | Elastic](https://www.elastic.co/guide/en/elasticsearch/reference/current/add-elasticsearch-nodes.html)
On Node 1 I changed the following in the elasticsearch.yml
```auto
cluster.name: < clustername> # consider using elasticsearch as this is the default name
node.name: node-1
network.host:
cluster.initial_master_nodes: ["node-1",""]
# Im not certain this is needed and there is a warning about leaving it in place here: https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-discovery-settings.html
http.host: 0.0.0.0
# I believe this conflicts with the reference but is needed if using different hosts
```
Run bin/elasticsearch
in another terminal get a new enrollment token if previous is older than 30 min
On second host soon to be 2nd Node
🎗remember to open ports 9200 & 9300,
Make NO changes to the elasticsearch.yml
bin\elasticsearch --enrollment-token \
After successfull enrollment, I changed the node.name of the second node
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [January 26, 2025, 10:49pm UTC](https://discuss.elastic.co/t/adding-a-node-to-a-cluster-using-3-hosts-almalinux-9-elasticsearch-8-17/372464/16 "2025-01-26T22:49:31Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.