Is logstash input stage multithreaded?

Elastic Stack Logstash
1

I was looking at the logstash pipeline.workers option which states that

-w, --pipeline.workers COUNT

Sets the number of pipeline workers to run. This option sets the number of workers that will, in parallel, execute the filter and output stages of the pipeline. If you find that events are backing up, or that the CPU is not saturated, consider increasing this number to better utilize machine processing power. The default is the number of the host’s CPU cores.

I was wondering if logstash input stage also uses all the cores of my machine:

input {
  kafka {
    bootstrap_servers=>"kfk1:9092,kfk2:9092"
    topics => ["mytopic"]
    group_id => "mygroup"
    key_deserializer_class => "org.apache.kafka.common.serialization.ByteArrayDeserializer"
    value_deserializer_class => "org.apache.kafka.common.serialization.ByteArrayDeserializer"
    codec => avro {
      schema_uri => "/apps/schema/rocana3.schema"
    }
  }
}

Does this input > kafka > codec > avro also utilizes all the cores of my machine or this a single threaded stage?

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.