# Pulling topic metadata from kafka 0.9

**URL:** <https://discuss.elastic.co/t/pulling-topic-metadata-from-kafka-0-9/55440>\
**Category:** Logstash\
**Created:** [July 13, 2016, 7:10pm UTC](https://discuss.elastic.co/t/pulling-topic-metadata-from-kafka-0-9/55440 "2016-07-13T19:10:31Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![stecino](https://avatars.discourse-cdn.com/v4/letter/s/ea666f/32.png) [@stecino](https://discuss.elastic.co/u/stecino)\
**Post date:** [July 13, 2016, 7:10pm UTC](https://discuss.elastic.co/t/pulling-topic-metadata-from-kafka-0-9/55440/1 "2016-07-13T19:10:31Z")

</div>

I am using logstash-input-kafka 3.0.x and logstash-output-kafka 3.0.x with logstash 2.2.2

How can I pull topic metadata from it. I could with zk\_connect with plugin 2.x, but not with the plugin upgrade.

---

<div class="post-metadata">

**Author:** ![stecino](https://avatars.discourse-cdn.com/v4/letter/s/ea666f/32.png) [@stecino](https://discuss.elastic.co/u/stecino)\
**Post date:** [July 14, 2016, 5:40pm UTC](https://discuss.elastic.co/t/pulling-topic-metadata-from-kafka-0-9/55440/2 "2016-07-14T17:40:19Z")

</div>

With kafka 2.x plugin using zk\_connect I could run something like this

grok {  
match =\> { "[kafka][topic]" =\> "%{WORD:network\_hardware}-%{WORD}-%{WORD:dc}" }  
}

where based on the kafka topic name, I could execute different cases.

My current input setup

kafka {  
bootstrap\_servers =\> "broker-0.blah.consul:7000,broker-1.blah.consul:7000,broker-2.blah.consul:7000"

# bootstrap\_servers =\> "[test1.blah.com:2181](http://test1.blah.com:2181)"

```
      topics => ["f5test-logs-ev1","firewalltest-logs-ev1","paloaltotest-logs-ev1"]
      topics => ["f5-log-ev1","firewall-logs-ev1","paloalto-logs-ev1"]

      enable_auto_commit => "true"
      codec => plain
     }
```

---

<div class="post-metadata">

**Author:** ![allenmchan](https://avatars.discourse-cdn.com/v4/letter/a/ec9cab/32.png) [@allenmchan](https://discuss.elastic.co/u/allenmchan)\
**Post date:** [July 16, 2016, 7:53am UTC](https://discuss.elastic.co/t/pulling-topic-metadata-from-kafka-0-9/55440/3 "2016-07-16T07:53:49Z")

</div>

This question has been answered by this PR. I believe it is designed for 0.10 but LS team is planning to port it to 0.9

> <https://github.com/logstash-plugins/logstash-input-kafka/pull/103>

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:47am UTC](https://discuss.elastic.co/t/pulling-topic-metadata-from-kafka-0-9/55440/4 "2017-07-06T04:47:45Z")

</div>