# Logstash 5.0 Alpha kafka input error

**URL:** <https://discuss.elastic.co/t/logstash-5-0-alpha-kafka-input-error/47182>\
**Category:** Logstash\
**Created:** [April 13, 2016, 3:29am UTC](https://discuss.elastic.co/t/logstash-5-0-alpha-kafka-input-error/47182 "2016-04-13T03:29:36Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![zhanght1](https://avatars.discourse-cdn.com/v4/letter/z/958977/32.png) [@zhanght1](https://discuss.elastic.co/u/zhanght1)\
**Post date:** [April 13, 2016, 3:29am UTC](https://discuss.elastic.co/t/logstash-5-0-alpha-kafka-input-error/47182/1 "2016-04-13T03:29:36Z")

</div>

Here is the logstash.conf.  
input {  
kafka {  
zk\_connect =\> "10.120.31.78:2181"  
topic\_id =\> "elk"  
reset\_beginning =\> true  
}  
}  
output{  
stdout {}  
}  
After run the ./logstash -f logstash.conf ,I got this error.  
Unknown setting 'zk\_connect' for kafka {:level=\>:error}  
Unknown setting 'topic\_id' for kafka {:level=\>:error}  
Unknown setting 'reset\_beginning' for kafka {:level=\>:error}  
fetched an invalid config {:config=\>"input {\n kafka {\n zk\_connect =\> "10.120.31.78:2181"\n topic\_id =\> "elk"\n reset\_beginning =\> true\n }\n}\noutput{\n stdout {}\n}\n\n", :reason=\>"Something is wrong with your configuration.", :level=\>:error}  
How could I fix this problem?  
BR

---

<div class="post-metadata">

**Author:** ![Joe\_Lawson](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/joe_lawson/32/3390_2.png) [@Joe\_Lawson](https://discuss.elastic.co/u/Joe_Lawson)\
**Post date:** [April 13, 2016, 12:37pm UTC](https://discuss.elastic.co/t/logstash-5-0-alpha-kafka-input-error/47182/2 "2016-04-13T12:37:50Z")

</div>

Logstash 5 requires Kafka 0.9.X and the config has changed: [https://www.elastic.co/guide/en/logstash/5.0/plugins-inputs-kafka.html](https://www.elastic.co/guide/en/logstash/5.0/plugins-inputs-kafka.html)

PS in you example you are using Kafka 0.8.X settings.

---

<div class="post-metadata">

**Author:** ![Joe\_Lawson](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/joe_lawson/32/3390_2.png) [@Joe\_Lawson](https://discuss.elastic.co/u/Joe_Lawson)\
**Post date:** [April 13, 2016, 4:23pm UTC](https://discuss.elastic.co/t/logstash-5-0-alpha-kafka-input-error/47182/3 "2016-04-13T16:23:44Z")

</div>

Also, if you want Kafka 0.8 support with the 5.0 Alpha, you can uninstall the new kafka plugin and install version 2.0.6.

```
bin/logstash-plugin uninstall logstash-input-kafka
curl -L -O 'https://rubygems.org/downloads/logstash-input-kafka-2.0.6.gem'
bin/logstash-plugin install ./logstash-input-kafka-2.0.6.gem

```

[https://www.elastic.co/guide/en/logstash/5.0/working-with-plugins.html#installing-local-plugins](https://www.elastic.co/guide/en/logstash/5.0/working-with-plugins.html#installing-local-plugins)

---

<div class="post-metadata">

**Author:** ![Joe\_Lawson](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/joe_lawson/32/3390_2.png) [@Joe\_Lawson](https://discuss.elastic.co/u/Joe_Lawson)\
**Post date:** [April 13, 2016, 4:25pm UTC](https://discuss.elastic.co/t/logstash-5-0-alpha-kafka-input-error/47182/4 "2016-04-13T16:25:37Z")

</div>

> [@zhanght1](#):
>
> reset\_beginning =\> true

This setting is good for testing, but you would want to remove it from production because it can cause log duplication. Basically any logstash instance that has that entry is going to nuke the last offset recorded by the consumer group (default group name is logstash).

---

<div class="post-metadata">

**Author:** ![zhanght1](https://avatars.discourse-cdn.com/v4/letter/z/958977/32.png) [@zhanght1](https://discuss.elastic.co/u/zhanght1)\
**Post date:** [April 14, 2016, 3:12am UTC](https://discuss.elastic.co/t/logstash-5-0-alpha-kafka-input-error/47182/5 "2016-04-14T03:12:32Z")

</div>

Thanks Joe.  
I use the kafka version 2.11-0.9.0.1 and changed the logstash.conf.  
input {  
kafka {  
bootstrap\_servers =\> "10.120.31.78:2181"  
topics =\> "elk"

# reset\_beginning =\> true

```
}

```

}  
output{  
stdout {}  
}

And I could run ./logstash -f logstash.conf successfully,but I can not see any data even I could see the data in kafka [topic.Is](http://topic.Is) there anything wrong with the logstash.conf?  
BR  
Felix zhang

---

<div class="post-metadata">

**Author:** ![Mormaii](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mormaii/32/10790_2.png) [@Mormaii](https://discuss.elastic.co/u/Mormaii)\
**Post date:** [January 24, 2017, 8:13pm UTC](https://discuss.elastic.co/t/logstash-5-0-alpha-kafka-input-error/47182/6 "2017-01-24T20:13:18Z")

</div>

It's unfortunate you removed this setting instead of writing a simple warning on it because we need this for our testing environment and since we're using kafka 0.9 we can't use the old plugin version (Using 4.1.1)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:29am UTC](https://discuss.elastic.co/t/logstash-5-0-alpha-kafka-input-error/47182/7 "2017-07-06T04:29:09Z")

</div>