Optimum number of workers

Elastic Stack Logstash
1

Hello guys,

I have a Kafka topic with 5 partitions. Assume I setup a 2 node Logstash cluster each with a pipeline to read from a Kafka topic, and each pipeline is assigned 4 worker nodes.

Now what would be the number of consumers that are reading from Kafka topic? Is it 2 or 8?

Thanks.
Darshan

2

Two. The number of worker threads does not affect the number of inputs.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.