# File-Beat-Kafka-Producer-config

**URL:** <https://discuss.elastic.co/t/file-beat-kafka-producer-config/139175>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [July 9, 2018, 1:05pm UTC](https://discuss.elastic.co/t/file-beat-kafka-producer-config/139175 "2018-07-09T13:05:52Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![SJN8](https://avatars.discourse-cdn.com/v4/letter/s/f08c70/32.png) [@SJN8](https://discuss.elastic.co/u/SJN8)\
**Post date:** [July 9, 2018, 1:05pm UTC](https://discuss.elastic.co/t/file-beat-kafka-producer-config/139175/1 "2018-07-09T13:05:52Z")

</div>

Hi All,

I am using kafka as Filebeat output .

I am seeing below exception while sending data to kafka topic ,

2018-07-09T13:54:10+02:00 INFO producer/broker/[[0]] maximum request accumulated, waiting for space

2018-07-09T13:54:14+02:00 INFO producer/broker/[[0]] maximum request accumulated, waiting for space

2018-07-09T13:54:17+02:00 INFO producer/broker/[[1]] maximum request accumulated, waiting for space

2018-07-09T13:54:18+02:00 INFO producer/broker/[[0]] maximum request accumulated, waiting for space

2018-07-09T13:54:18+02:00 INFO producer/broker/[[1]] maximum request accumulated, waiting for space

2018-07-09T13:54:18+02:00 INFO producer/broker/[[0]] maximum request accumulated, waiting for space

2018-07-09T13:54:19+02:00 INFO producer/broker/[[2]] maximum request accumulated, waiting for space

2018-07-09T13:54:20+02:00 INFO producer/broker/[[1]] maximum request accumulated, waiting for space

2018-07-09T13:54:21+02:00 INFO producer/broker/[[2]] maximum request accumulated, waiting for space

2018-07-09T13:54:22+02:00 INFO producer/broker/[[2]] maximum request accumulated, waiting for space

2018-07-09T13:54:22+02:00 INFO producer/broker/[[2]] maximum request accumulated, waiting for space

2018-07-09T13:54:25+02:00 INFO producer/broker/[[0]] maximum request accumulated, waiting for space

2018-07-09T13:54:25+02:00 INFO producer/broker/[[0]] maximum request accumulated, waiting for space

2018-07-09T13:54:29+02:00 INFO producer/broker/[[2]] maximum request accumulated, waiting for space

2018-07-09T13:54:30+02:00 INFO producer/broker/[[2]] maximum request accumulated, waiting for space

2018-07-09T13:54:30+02:00 INFO producer/broker/[[1]] maximum request accumulated, waiting for space

2018-07-09T13:54:30+02:00 INFO producer/broker/[[1]] maximum request accumulated, waiting for space

2018-07-09T13:54:30+02:00 INFO producer/broker/[[2]] maximum request accumulated, waiting for space

I have 3 broker , and my topic has 3 replication factor and 3 partition . .

Please help me in resolving the same as looks like i have to update something in my producer/broker config .

Thanks

---

<div class="post-metadata">

**Author:** ![exekias](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/exekias/32/28718_2.png) [@exekias](https://discuss.elastic.co/u/exekias)\
**Post date:** [July 10, 2018, 3:43pm UTC](https://discuss.elastic.co/t/file-beat-kafka-producer-config/139175/2 "2018-07-10T15:43:41Z")

</div>

Hi @SJN8,

This is not an exception but an info message. kafka client's buffer is full, and it's probably waiting for some ACKs before sending more messages.

Best regards

---

<div class="post-metadata">

**Author:** ![SJN8](https://avatars.discourse-cdn.com/v4/letter/s/f08c70/32.png) [@SJN8](https://discuss.elastic.co/u/SJN8)\
**Post date:** [July 11, 2018, 5:12am UTC](https://discuss.elastic.co/t/file-beat-kafka-producer-config/139175/3 "2018-07-11T05:12:44Z")

</div>

Yes , This is resolved by updating socket config .

Thanks .

---

<div class="post-metadata">

**Author:** ![arechan](https://avatars.discourse-cdn.com/v4/letter/a/b19c9b/32.png) [@arechan](https://discuss.elastic.co/u/arechan)\
**Post date:** [July 24, 2018, 2:49am UTC](https://discuss.elastic.co/t/file-beat-kafka-producer-config/139175/4 "2018-07-24T02:49:11Z")

</div>

Hi, my program has the same problem, how do you solve it?

---

<div class="post-metadata">

**Author:** ![SJN8](https://avatars.discourse-cdn.com/v4/letter/s/f08c70/32.png) [@SJN8](https://discuss.elastic.co/u/SJN8)\
**Post date:** [July 31, 2018, 5:27am UTC](https://discuss.elastic.co/t/file-beat-kafka-producer-config/139175/5 "2018-07-31T05:27:09Z")

</div>

I have solved by increasing Buffer memory and producer config of Filebeat and Kafka

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 28, 2018, 5:27am UTC](https://discuss.elastic.co/t/file-beat-kafka-producer-config/139175/6 "2018-08-28T05:27:13Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
