Elastic Cluster

[Natalia_Queiroz]

Hi group,

I have the follow cenario: 1 node master, 2 data nodes and 1 client node (kibana+logstash) and a few questions.

Regarding the elasticsearch.yml configuration, should I need to configure an initial list of nodes that will be contacted to discover and form the cluster?

discovery.zen.ping.unicast.hosts: ["master-01", "datanode-01", "datanode-02"]

Regarding the logstash.conf file what IP do I put in Logstash's output's elasticsearch configuration? master-01 ip address?

output {
elasticsearch { ? }
}

Thanks,
Natalia

[warkolm (Mark Walkom)]

@Natalia_Queiroz

1 node master, 2 data nodes

That's not ideal, see Important Configuration Changes | Elasticsearch: The Definitive Guide [2.x] | Elastic

@Natalia_Queiroz

Regarding the elasticsearch.yml configuration, should I need to configure an initial list of nodes that will be contacted to discover and form the cluster

Yep!

@Natalia_Queiroz

Regarding the logstash.conf file what IP do I put in Logstash's output's elasticsearch configuration? master-01 ip address

Ideally never the master nodes.

[mujtabahussain]

@Natalia_Queiroz

discovery.zen.ping.unicast.hosts: ["master-01", "datanode-01", "datanode-02"]

Out of curiosity, where are you hosting this setup?

[poojagupta]

@Natalia_Queiroz

Regarding the elasticsearch.yml configuration, should I need to configure an initial list of nodes that will be contacted to discover and form the cluster?

you should make a cluster including all master, data and client nodes that is helpful for load balancing the data also. for this you have to mention all nodes hostname in discovery parameter.

@Natalia_Queiroz

Regarding the logstash.conf file what IP do I put in Logstash's output's elasticsearch configuration? master-01 ip address?

output {
elasticsearch { ? }

As you told logstash is configured on client node you can mention the IP of elasticsearch as per your configuration ex: localhost if you configured elasticsearch on the same machine or cluster IP from which you are accessing the Elasticsearch cluster. also you can mention the data node ip

process wil be as whenever any logs are coming it will go to client node and due to elasticsearch all data will be reflected in the cluster and request will be followed.