Connecting Logstash to Elastic Master or Elastic Data

Elastic Stack Elasticsearch
1

Hello,

When having a Elastic Master servers and Elastic Data servers, should the Logstash consumer point to the Elastic Data for the output or the Elastic Master? What is the difference between the two connections/outputs and which one is recommended?

2

If you have dedicated master nodes in the cluster these should be left to manage the cluster and you should point Logstash to just the data nodes. The whole point of having dedicated mater nodes is to avoid them getting overloaded or have a lot of GC, and the best way to do this is to not send requests to them.

3

I have setup the logstash to point to the data nodes. All the data is getting replicated across all 3 data nodes. Is this normal behavior? Shouldn't the data be split across all 3 data nodes? The elasticsearch.yml for the data nodes has the following fields added to it:

  • cluster name: cluster1
  • node.name: ${HOSTNAME}
  • node.master: false
  • node.data: true
  • discovery.zen.ping.unicast.hosts: ["master1", "mastereligible1", "mastereligible2"]
  • discovery.zen.minimum_master_nodes: 1
4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.