Trying to configure Master and Data nodes on the same system

Elastic Stack Elasticsearch
1

Hello All, I am trying to get an understanding of the Elasticsearch cluster system. Hence, I have set up the Elasticsearch.yml file in the following. I have created 2 folders - one for Master and the other is Data. However, I get an error "Failed to send join request to master... My configurations are as follows

`Master Node

cluster.name: remote
node.name: Remote-Master
node.master: true
node.data: false
path.data: D:\ELK-Runnable\Elasticsearch\data
path.logs: D:\ELK-Runnable\Elasticsearch\logs
network.host: 0.0.0.0
http.port: 9200-9299
transport.port: 9300-9399
discovery.zen.minimum_master_nodes: 1`

`Data Node

cluster.name: remote
node.name: Remote-Data
node.master: false
node.data: true
path.data: D:\ELK-Runnable\Elasticsearch_Data\data
path.logs: D:\ELK-Runnable\Elasticsearch_Data\logs
network.host: 0.0.0.0
http.port: 9200-9299
transport.port: 9300-9399
discovery.zen.minimum_master_nodes: 1 `

The error is listed below
[2019-09-07T20:31:15,578][INFO ][o.e.d.z.ZenDiscovery ] [Remote-Data] failed to send join request to master [{Remote-Master}{96wtLUIOQz2YHSoiCYHIiA}{HZrGJ25IQHOelqzyc3FfRw}{127.0.0.1}{127.0.0.1:9300}{ml.machine_memory=17039638528, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true}], reason [RemoteTransportException[[Remote-Master][127.0.0.1:9300][internal:discovery/zen/join]]; nested: IllegalArgumentException[can't add node {Remote-Data}{96wtLUIOQz2YHSoiCYHIiA}{UrKgT27aSjmPGhmgxA81jQ}{192.168.0.157}{192.168.0.157:9300}{ml.machine_memory=17039638528, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true}, found existing node {Remote-Master}{96wtLUIOQz2YHSoiCYHIiA}{HZrGJ25IQHOelqzyc3FfRw}{127.0.0.1}{127.0.0.1:9300}{ml.machine_memory=17039638528, xpack.installed=true, ml.max_open_jobs=20, ml.enabled=true} with the same id but is a different node instance]; ]

I just want to achieve to ingest data through the master into the data node. I am just getting an understanding of cluster management. Any suggestions would be great. Thanks

2

Hi @revglen welcome to the community and thanks for trying elasticsearch.

Typically it is not recommended / best practice to run more than 1 node on a single server it can cause issues than can be difficult to debug.

Also it is also an anti-pattern / not best practice to attempt to ingest data through the master only node, the master node is really just to keep cluster state not to do actual indexing and query.

Perhaps you could read this section on node types and what their roles / purposes are and that will help clarify a few things.

Generally I would suggest a new user to just set up single node with default config and get used to it. By default a single node with default will be both a data node and master. If you really want to run separately you should run them on separate servers and point your ingest to the data node.

Good luck!

3

Thanks Stephen. It is indeed not a good practice to maintain multiple nodes on a single server.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.