# How to increase the performance of the kafka input in indexer

**URL:** https://discuss.elastic.co/t/how-to-increase-the-performance-of-the-kafka-input-in-indexer/304549
**Category:** Logstash
**Created:** [May 12, 2022, 9:42am UTC](https://discuss.elastic.co/t/how-to-increase-the-performance-of-the-kafka-input-in-indexer/304549 "2022-05-12T09:42:39Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![Marco\_Bonardo](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/marco_bonardo/32/99030_2.png) [@Marco\_Bonardo](https://discuss.elastic.co/u/Marco_Bonardo)
#### Post date: [May 12, 2022, 9:42am UTC](https://discuss.elastic.co/t/how-to-increase-the-performance-of-the-kafka-input-in-indexer/304549/1 "2022-05-12T09:42:39Z")

</div>

Hello everyone, I have a problem I've been working on for days and I can't find a compatible solution. I need to consume about **150k messages per second** via a kafka input / topic / groupid. I have **8 logstash on separate machines** and performers of both cpu and memory (I already have about fifteen active pipelines but they are not a problem at the moment). Basically I can consume about 8k per second of messages, using the **consumer\_thread value of 5 for each node** (with topic partition 48). I always arrive at a maximum of about **42k messages per second** and the rest goes into lag. I've tried working with the worker and batch.size parameter but they haven't changed the context. I ask if you have tested solutions that can do for me, without increasing other logstash indexers. Thank you all

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [June 9, 2022, 9:43am UTC](https://discuss.elastic.co/t/how-to-increase-the-performance-of-the-kafka-input-in-indexer/304549/2 "2022-06-09T09:43:19Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
