# Logstash keeps crashing

**URL:** <https://discuss.elastic.co/t/logstash-keeps-crashing/114713>\
**Category:** Logstash\
**Created:** [January 9, 2018, 2:15pm UTC](https://discuss.elastic.co/t/logstash-keeps-crashing/114713 "2018-01-09T14:15:01Z")\
**Posts on this page:** 1\
**Showing post:** 8

<div class="post-metadata">

**Author:** ![crapoulou](https://avatars.discourse-cdn.com/v4/letter/c/c2a13f/32.png) [@crapoulou](https://discuss.elastic.co/u/crapoulou)\
**Post date:** [January 12, 2018, 12:57pm UTC](https://discuss.elastic.co/t/logstash-keeps-crashing/114713/8 "2018-01-12T12:57:29Z")

</div>

Unfortunately, today, I get the same issue.  
Finally, a wrong fix found regarding the max size.

It looks the same issue than these topics but my config is correct in /opt/kafka/config/server.properties !  
listeners=PLAINTEXT://1.2.3.4:9092 #(IP changed)

> [@Sending batch to Kafka failed. Will retry after a delay Logstash error](https://discuss.elastic.co/t/sending-batch-to-kafka-failed-will-retry-after-a-delay-logstash-error/114133):
>
> Hi, I have a Logstash agent sending lines to a multi broker kafka setup. Currently I am getting the following error in Logstash log: [2017-12-27T15:06:15,369][INFO][logstash.outputs.kafka] Sending batch to Kafka failed. Will retry after a delay. {:batch\_size=\>125, :failures=\>125, :sleep=\>0.01} [2017-12-27T15:06:15,370][INFO][logstash.outputs.kafka] Sending batch to Kafka failed. Will retry after a delay. {:batch\_size=\>125, :failures=\>125, :sleep=\>0.01} [2017-12-27T15:06:15,370][INFO…

> [@Logstash output plugin kafka is not pushing data into kafka](https://discuss.elastic.co/t/logstash-output-plugin-kafka-is-not-pushing-data-into-kafka/104383/3):
>
> After updating all logstash plugins now i am seeing following logs [2017-10-18T19:55:36,794][INFO][logstash.outputs.kafka] Sending batch to Kafka failed. Will retry after a delay. {:batch\_size=\>6, :failures=\>6, :sleep=\>0.01} [2017-10-18T19:56:06,901][INFO][logstash.outputs.kafka] Sending batch to Kafka failed. Will retry after a delay. {:batch\_size=\>1, :failures=\>1, :sleep=\>0.01} [2017-10-18T19:56:06,903][INFO][logstash.outputs.kafka] Sending batch to Kafka failed. Will retry aft…

(Indeed, I see in the start sequence these two parameters) :  
security.protocol = PLAINTEXT  
bootstrap.servers = [1.2.3.4:9092, 1.2.3.5:9092]

It's not feeding through kafka.

**In debug mode I find :**  
[2018-01-12T11:49:10,544][DEBUG][org.apache.kafka.clients.NetworkClient] Initiating connection to node -1 at 1.2.3.4:9092.  
[2018-01-12T11:49:10,546][DEBUG][org.apache.kafka.common.metrics.Metrics] Added sensor with name node--1.bytes-sent  
[2018-01-12T11:49:10,547][DEBUG][org.apache.kafka.common.metrics.Metrics] Added sensor with name node--1.bytes-received  
[2018-01-12T11:49:10,547][DEBUG][org.apache.kafka.common.metrics.Metrics] Added sensor with name node--1.latency  
[2018-01-12T11:49:10,547][DEBUG][org.apache.kafka.common.network.Selector] Connection with /1.2.3.4 disconnected  
java.net.ConnectException: Connection refused  
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[?:1.8.0\_151]  
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) ~[?:1.8.0\_151]  
at org.apache.kafka.common.network.PlaintextTransportLayer.finishConnect(PlaintextTransportLayer.java:51) ~[kafka-clients-0.10.0.1.jar:?]  
at org.apache.kafka.common.network.KafkaChannel.finishConnect(KafkaChannel.java:73) ~[kafka-clients-0.10.0.1.jar:?]  
at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:309) [kafka-clients-0.10.0.1.jar:?]  
at org.apache.kafka.common.network.Selector.poll(Selector.java:283) [kafka-clients-0.10.0.1.jar:?]  
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:260) [kafka-clients-0.10.0.1.jar:?]  
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:229) [kafka-clients-0.10.0.1.jar:?]  
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:134) [kafka-clients-0.10.0.1.jar:?]  
at java.lang.Thread.run(Thread.java:748) [?:1.8.0\_151]

I tried to shutdown one of the servers. I have only 1 error message from time to time "Sending batch to Kafka failed. Will retry after a delay."

Once started, I have many times this error !

Do you have any idea ??  
Thank you !

---

_[View the full topic](https://discuss.elastic.co/t/logstash-keeps-crashing/114713)._
