# Logstash input kafka not reading messages from topic

**URL:** <https://discuss.elastic.co/t/logstash-input-kafka-not-reading-messages-from-topic/199395>\
**Category:** Logstash\
**Created:** [September 13, 2019, 9:07am UTC](https://discuss.elastic.co/t/logstash-input-kafka-not-reading-messages-from-topic/199395 "2019-09-13T09:07:46Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![sunilmchaudhari](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sunilmchaudhari/32/9475_2.png) [@sunilmchaudhari](https://discuss.elastic.co/u/sunilmchaudhari)\
**Post date:** [September 13, 2019, 9:07am UTC](https://discuss.elastic.co/t/logstash-input-kafka-not-reading-messages-from-topic/199395/1 "2019-09-13T09:07:46Z")

</div>

I am using kafka as message broker and writing and reading messages using logstash-6.3.1.  
Attached document shows all the configuration.  
I have producer pipeline, which creates messages in kafka  
and consumr pipeline which read messages from kafka. However messages are getting created in kafka topic, but consumer instance of logstash not able to read those messages.  
There is no error. Both pipelines running under same instyance of logstash.

Producer pipeline:  
**100-producer-input.conf**  
 ![image](https://us1.discourse-cdn.com/elastic/original/3X/6/d/6df7c07302cc623651b2952436db0c96e726ee61.png)

**200-produccer-output.conf**  
 ![image](https://us1.discourse-cdn.com/elastic/original/3X/3/d/3d500c7b073f8801a43f445b124f61ff5c918215.png)

Above pipeline working fine and creating messages to kafka topic.

When I add another pipeline for consumer. it doesnt read messages.  
**Consumer configuration**  
**100-kafka-producer.conf**  
 ![image](https://us1.discourse-cdn.com/elastic/original/3X/d/5/d5af2561e9fff2d37ce96f12389312d6ef3a07e7.png)  
**200-kafka-consumer.conf**  
 ![image](https://us1.discourse-cdn.com/elastic/original/3X/b/4/b4aa81ef577676240d660780ea7685cf2848ba27.png)

In the initialization logs when logstash starts, it shows client.id as cbgm-client-0 in the logs. WHy does it append zero to client id?  
Whats wrong in my configuration?

thanks  
Sunil.

---

<div class="post-metadata">

**Author:** ![sunilmchaudhari](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sunilmchaudhari/32/9475_2.png) [@sunilmchaudhari](https://discuss.elastic.co/u/sunilmchaudhari)\
**Post date:** [September 13, 2019, 9:30am UTC](https://discuss.elastic.co/t/logstash-input-kafka-not-reading-messages-from-topic/199395/2 "2019-09-13T09:30:43Z")

</div>

One update.  
When I dont mention client\_id in the configuration of consumer. it shows client.id = logstash-0 in the logs.

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/a/1/a17031c671467eb5aa370b0c16c7b1f8d8145680.png)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 11, 2019, 9:30am UTC](https://discuss.elastic.co/t/logstash-input-kafka-not-reading-messages-from-topic/199395/3 "2019-10-11T09:30:43Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.