# Kafka output gets permanently stuck after temporary wrong port — pipeline-to-pipeline address unavailable & retrying\_send stall **URL:** \ **Category:** Logstash\ **Created:** [December 5, 2025, 7:11am UTC](https://discuss.elastic.co/t/kafka-output-gets-permanently-stuck-after-temporary-wrong-port-pipeline-to-pipeline-address-unavailable-retrying-send-stall/383877 "2025-12-05T07:11:31Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![Mahesh\_Kumar1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mahesh_kumar1/32/137950_2.png) [@Mahesh\_Kumar1](https://discuss.elastic.co/u/Mahesh_Kumar1)\ **Post date:** [December 5, 2025, 7:11am UTC](https://discuss.elastic.co/t/kafka-output-gets-permanently-stuck-after-temporary-wrong-port-pipeline-to-pipeline-address-unavailable-retrying-send-stall/383877/1 "2025-12-05T07:11:31Z")
# Kafka output gets permanently stuck after temporary wrong port — pipeline-to-pipeline address unavailable & retrying\_send stall Hi, I am facing an issue with Logstash Kafka output when the Kafka broker becomes temporarily unreachable. Error : [2025-12-05T12:41:32,869][WARN][org.logstash.plugins.pipeline.AbstractPipelineBus][6c439cc070c5500b3acef737847adbb5978f7d66189e9c4591ef93fa3f24f09f] Attempted to send event to 'forward\_kafka but that address was unavailable. Maybe the destination pipeline is down or stopping? Will Retry. Problem Scenario - I intentionally changed the Kafka port to a wrong port (ex: 7879). - Logstash started showing Kafka connection errors (expected). - After a few seconds, I restored the correct port 7878 again. - Even after restoring the correct port, Logstash never recovers and it stops forwarding logs permanently. - Restarting Logstash fixes it, but I want Logstash to automatically recover without restart. My Logstash pipeline forwards logs to Kafka using this output configuration: ```logstash output { kafka { codec => json topic_id => "temp-logs" bootstrap_servers => "dev.custom.com:7878" client_id => "DEV-00135" security_protocol => "SASL_PLAINTEXT" sasl_mechanism => "PLAIN" sasl_jaas_config => "org.apache.kafka.common.security.plain.PlainLoginModule required username='admin' password='admin-secret';" } } How to resolve this issue ``` ---
**Author:** ![Rios](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rios/32/95745_2.png) [@Rios](https://discuss.elastic.co/u/Rios)\ **Post date:** [December 5, 2025, 9:47am UTC](https://discuss.elastic.co/t/kafka-output-gets-permanently-stuck-after-temporary-wrong-port-pipeline-to-pipeline-address-unavailable-retrying-send-stall/383877/2 "2025-12-05T09:47:19Z")
If you like to reload configuration changes in .conf automatically, without LS restart, you can set in logstash.yml: ```auto config.reload.automatic: true config.reload.interval: 10s ``` You can set [reconnect values](https://www.elastic.co/docs/reference/logstash/plugins/plugins-outputs-kafka#plugins-outputs-kafka-retries) in the kafka output params: - retries - retry\_backoff\_ms - reconnect\_backoff\_max\_ms - reconnect\_backoff\_ms - request\_timeout\_ms You can check default values, and do fine tuning for your case. The kafka plugin v 10.50 is from April 2020, not sure which LS version do you have. ---
**Author:** ![Mahesh\_Kumar1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mahesh_kumar1/32/137950_2.png) [@Mahesh\_Kumar1](https://discuss.elastic.co/u/Mahesh_Kumar1)\ **Post date:** [December 5, 2025, 10:08am UTC](https://discuss.elastic.co/t/kafka-output-gets-permanently-stuck-after-temporary-wrong-port-pipeline-to-pipeline-address-unavailable-retrying-send-stall/383877/3 "2025-12-05T10:08:32Z")
@Rios ```auto config.reload.automatic: true config.reload.interval: 10s ``` I already have these values in logstash.yml I have Logstash v 8.19.3 ---
**Author:** ![Mahesh\_Kumar1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mahesh_kumar1/32/137950_2.png) [@Mahesh\_Kumar1](https://discuss.elastic.co/u/Mahesh_Kumar1)\ **Post date:** [December 5, 2025, 10:21am UTC](https://discuss.elastic.co/t/kafka-output-gets-permanently-stuck-after-temporary-wrong-port-pipeline-to-pipeline-address-unavailable-retrying-send-stall/383877/4 "2025-12-05T10:21:40Z")
@Rios ```auto retries => 10 retry_backoff_ms => 500 reconnect_backoff_ms => 500 request_timeout_ms => 30000 ``` I have added these to my config but also the same issue persists Shoes error like ![image](https://us1.discourse-cdn.com/elastic/original/3X/4/a/4a10d7fcf2798d46361865d1076d3a5c4b58d021.png) ---
**Author:** ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)\ **Post date:** [December 5, 2025, 12:11pm UTC](https://discuss.elastic.co/t/kafka-output-gets-permanently-stuck-after-temporary-wrong-port-pipeline-to-pipeline-address-unavailable-retrying-send-stall/383877/5 "2025-12-05T12:11:38Z")
What exactly you did and how are your pipelines connected? You mentioned that you are you using pipeline-to-pipeline communicaton, but you didn't share any of your configurations. Please share your `pipelines.yml` file and the inputs and ouputs of all your pipelines running on the same instance. ---
**Author:** ![Mahesh\_Kumar1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mahesh_kumar1/32/137950_2.png) [@Mahesh\_Kumar1](https://discuss.elastic.co/u/Mahesh_Kumar1)\ **Post date:** [December 5, 2025, 5:32pm UTC](https://discuss.elastic.co/t/kafka-output-gets-permanently-stuck-after-temporary-wrong-port-pipeline-to-pipeline-address-unavailable-retrying-send-stall/383877/6 "2025-12-05T17:32:58Z")
@leandrojmp ```auto - pipeline.id: main_input path.config: "config/main_input.conf" - pipeline.id: input_snmp_trap path.config: "config/input_snmp_trap.conf" - pipeline.id: forward_syslog path.config: "config/forward_syslog.conf" - pipeline.id: input_eventlog path.config: "config/input_eventlog.conf" queue.max_bytes: 2048mb queue.type: persisted - pipeline.id: forward_eventlog path.config: "config/forward_eventlog.conf" queue.max_bytes: 1024mb queue.type: persisted - pipeline.id: forward_kafka path.config: "config/forward_kafka.conf" queue.max_bytes: 1000mb ``` These are my pipelines Iam sending logs to the kafka forward pipeline like this.. To a separate pipeline from main\_input pipeline. main\_input pipeline is the entry point of logs ```auto output { if ("forward_event" not in [tags]) { elasticsearch { hosts => ["localhost:9200"] index => "ScribblerCurrent" } } if ("forward_event" in [tags]) { pipeline { send_to => forward_Kafka } } } ```