Not Using Client Node for Logstash

Elastic Stack Elasticsearch
1

Do we need to use client node when ingesting data through Logstash as we can specify individual Node names in comma separated format in Logstash.

If we do not use client node for Ingestion and rather point to data/master nodes can we still view the Ingestion statistics from Kibana?

2

If you have dedicated client nodes (called "coordinating only nodes" nowadays), you can point Logstash to those nodes. If you do not have dedicated coordinating only nodes, use the data nodes.

Whatever you do, if you have dedicated master nodes, do not send those master nodes any requests, ie. do not point Logstash to those nodes. Use the data nodes or coordinating only nodes.

The nodes that you choose to connect Logstash to should not impact the availability of ingestion statistics.

3

Thanks for your response. It clarifies my question.
Wanted to know one more thing, if I send my search requests to a specific Data Node, the statistics captured and displayed through Kibana would not be impacted?

4

What statistics are you talking about? The dashboards and visualizations you have created yourself? Unless you put a lot of pressure on your data nodes, those data nodes will be able to still respond to search and aggregation requests fine and your dashboards should work fine.

Don't send all requests to one specific data node though - load balance between the available nodes by round robining the requests.

5

I was referring to the ones shown in the Monitoring section of Kibana against a particular Index.
We do not have any custom visualization.

6

Those index statistics should not be impacted.

7

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.