Optimum number of workers

Hello guys,

I have a Kafka topic with 5 partitions. Assume I setup a 2 node Logstash cluster each with a pipeline to read from a Kafka topic, and each pipeline is assigned 4 worker nodes.

Now what would be the number of consumers that are reading from Kafka topic? Is it 2 or 8?


Two. The number of worker threads does not affect the number of inputs.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.