# Logstash Kafka Input plugin : no message read from kafka topic

**URL:** <https://discuss.elastic.co/t/logstash-kafka-input-plugin-no-message-read-from-kafka-topic/83875>\
**Category:** Logstash\
**Created:** [April 27, 2017, 2:00pm UTC](https://discuss.elastic.co/t/logstash-kafka-input-plugin-no-message-read-from-kafka-topic/83875 "2017-04-27T14:00:43Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![gugansankar](https://avatars.discourse-cdn.com/v4/letter/g/e274bd/32.png) [@gugansankar](https://discuss.elastic.co/u/gugansankar)\
**Post date:** [April 27, 2017, 2:00pm UTC](https://discuss.elastic.co/t/logstash-kafka-input-plugin-no-message-read-from-kafka-topic/83875/1 "2017-04-27T14:00:43Z")

</div>

Planned to upgrade my ELK setup to 5.x along with that I tried to add kafka message queue between forwarder and logstash server on the new environment.

There is no issues on forwarders sent message to kafka. I verified it through kafka consumer script.

But when I pull message from kafka using logstash-kafka-input plugin, its not writing any messages . Should I need to add/enable any specific settings in my configuration ?.

my logstash simple config :

```
input {
kafka{
	topics => ["weblogs"]
	bootstrap_servers => "10.11.12.202:9092"
}
}

output {
  stdout { codec => rubydebug }
 file {
                 path => "/tmp/stdout.log"
           }
}

```

Kafka Consumer script output on the topic :

> [root@logstash kafka\_2.11-0.10.2.0]# bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic weblogs  
> 10.11.12.169 - - [27/Apr/2017:13:50:26 +0000] "GET / HTTP/1.0" 302 287 "-" "check\_http/v2.0.3 (nagios-plugins 2.0.3)"  
> 192.168.10.11 - - [27/Apr/2017:13:50:29 +0000] "GET / HTTP/1.0" 302 281 "-" "check\_http/v2.0.3 (nagios-plugins 2.0.3)"  
> 10.11.12.169 - - [27/Apr/2017:13:50:29 +0000] "GET / HTTP/1.0" 302 291 "-" "check\_http/v2.0.3 (nagios-plugins 2.0.3)"  
> 10.11.12.169 - - [27/Apr/2017:13:50:32 +0000] "GET / HTTP/1.0" 302 289 "-" "check\_http/v2.0.3 (nagios-plugins 2.0.3)"

---

<div class="post-metadata">

**Author:** ![gugansankar](https://avatars.discourse-cdn.com/v4/letter/g/e274bd/32.png) [@gugansankar](https://discuss.elastic.co/u/gugansankar)\
**Post date:** [May 2, 2017, 6:28am UTC](https://discuss.elastic.co/t/logstash-kafka-input-plugin-no-message-read-from-kafka-topic/83875/2 "2017-05-02T06:28:07Z")

</div>

Any idea ?. Due to this problem, I'm unable to upgrade my production env to latest version. can someone help me on this please ?

---

<div class="post-metadata">

**Author:** ![gugansankar](https://avatars.discourse-cdn.com/v4/letter/g/e274bd/32.png) [@gugansankar](https://discuss.elastic.co/u/gugansankar)\
**Post date:** [May 12, 2017, 4:59am UTC](https://discuss.elastic.co/t/logstash-kafka-input-plugin-no-message-read-from-kafka-topic/83875/3 "2017-05-12T04:59:02Z")

</div>

Can I create this issue in github ?. but I would like to know whether its a configuration related issue or something else. Thank you.

---

<div class="post-metadata">

**Author:** ![gugansankar](https://avatars.discourse-cdn.com/v4/letter/g/e274bd/32.png) [@gugansankar](https://discuss.elastic.co/u/gugansankar)\
**Post date:** [May 23, 2017, 7:18am UTC](https://discuss.elastic.co/t/logstash-kafka-input-plugin-no-message-read-from-kafka-topic/83875/4 "2017-05-23T07:18:25Z")

</div>

I have run the logstash on debug mode and paste the log here. Please someone help me to fix this issue.

[https://paste.ubuntu.com/24630775/](https://paste.ubuntu.com/24630775/)

---

<div class="post-metadata">

**Author:** ![zhaochl](https://avatars.discourse-cdn.com/v4/letter/z/7ba0ec/32.png) [@zhaochl](https://discuss.elastic.co/u/zhaochl)\
**Post date:** [June 4, 2017, 8:33am UTC](https://discuss.elastic.co/t/logstash-kafka-input-plugin-no-message-read-from-kafka-topic/83875/5 "2017-06-04T08:33:51Z")

</div>

Hi I am faced with the same problem , logstash version 5.3 ,  
get nothing from kafka topic,did you solved it

thanks.

---

<div class="post-metadata">

**Author:** ![gugansankar](https://avatars.discourse-cdn.com/v4/letter/g/e274bd/32.png) [@gugansankar](https://discuss.elastic.co/u/gugansankar)\
**Post date:** [June 5, 2017, 11:04am UTC](https://discuss.elastic.co/t/logstash-kafka-input-plugin-no-message-read-from-kafka-topic/83875/6 "2017-06-05T11:04:19Z")

</div>

Yes i fixed the issue.

Thanks,  
Gugan.K

---

<div class="post-metadata">

**Author:** ![gugansankar](https://avatars.discourse-cdn.com/v4/letter/g/e274bd/32.png) [@gugansankar](https://discuss.elastic.co/u/gugansankar)\
**Post date:** [June 5, 2017, 11:05am UTC](https://discuss.elastic.co/t/logstash-kafka-input-plugin-no-message-read-from-kafka-topic/83875/7 "2017-06-05T11:05:53Z")

</div>

The problem is not because of logstash input kafka plugin,  
It's kafka issue. By default it doesnt allow remote connection. You should  
enable it in kafka to allow remote connection

Thanks,  
Gugan.K

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 3, 2017, 11:19am UTC](https://discuss.elastic.co/t/logstash-kafka-input-plugin-no-message-read-from-kafka-topic/83875/8 "2017-07-03T11:19:43Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.