# Should I expect 2.3 kafka plugins to work with kafka 0.10?

**URL:** <https://discuss.elastic.co/t/should-i-expect-2-3-kafka-plugins-to-work-with-kafka-0-10/56213>\
**Category:** Logstash\
**Created:** [July 23, 2016, 10:57am UTC](https://discuss.elastic.co/t/should-i-expect-2-3-kafka-plugins-to-work-with-kafka-0-10/56213 "2016-07-23T10:57:04Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![memelet](https://avatars.discourse-cdn.com/v4/letter/m/6bbea6/32.png) [@memelet](https://discuss.elastic.co/u/memelet)\
**Post date:** [July 23, 2016, 10:57am UTC](https://discuss.elastic.co/t/should-i-expect-2-3-kafka-plugins-to-work-with-kafka-0-10/56213/1 "2016-07-23T10:57:04Z")

</div>

All our other kafka 0.9 clients work fine with 0.10 brokers. But whenever I start a kafka-output logstash hangs, and can only be recovered with kill -9. Nothing in the logs. (Have not run with -debug yet.)

kafka-input does not seem to have the same effect. But I don't really know if it's working at all as no input can send logs.

---

<div class="post-metadata">

**Author:** ![memelet](https://avatars.discourse-cdn.com/v4/letter/m/6bbea6/32.png) [@memelet](https://discuss.elastic.co/u/memelet)\
**Post date:** [July 23, 2016, 11:18am UTC](https://discuss.elastic.co/t/should-i-expect-2-3-kafka-plugins-to-work-with-kafka-0-10/56213/2 "2016-07-23T11:18:03Z")

</div>

Just noticed that I have v 2.x of the plugins install. Seems I should have 3.x. Trying that now...

Nope, same behavior with 3.x plugins.

---

<div class="post-metadata">

**Author:** ![memelet](https://avatars.discourse-cdn.com/v4/letter/m/6bbea6/32.png) [@memelet](https://discuss.elastic.co/u/memelet)\
**Post date:** [July 23, 2016, 11:38am UTC](https://discuss.elastic.co/t/should-i-expect-2-3-kafka-plugins-to-work-with-kafka-0-10/56213/3 "2016-07-23T11:38:53Z")

</div>

But I do know the plugin is starting, from logstash.err:

log4j:WARN No appenders could be found for logger (org.apache.kafka.clients.producer.ProducerConfig).  
log4j:WARN Please initialize the log4j system properly.  
log4j:WARN See [http://logging.apache.org/log4j/1.2/faq.html#noconfig](http://logging.apache.org/log4j/1.2/faq.html#noconfig) for more info.

---

<div class="post-metadata">

**Author:** ![allenmchan](https://avatars.discourse-cdn.com/v4/letter/a/ec9cab/32.png) [@allenmchan](https://discuss.elastic.co/u/allenmchan)\
**Post date:** [July 26, 2016, 5:15am UTC](https://discuss.elastic.co/t/should-i-expect-2-3-kafka-plugins-to-work-with-kafka-0-10/56213/4 "2016-07-26T05:15:58Z")

</div>

The logstash team put together a nice compatibility matrix on the logstash plugin page

> **[logstash-plugins/logstash-output-kafka](https://github.com/logstash-plugins/logstash-output-kafka)**
>
> logstash-output-kafka - Kafka Output for Logstash

Do you see any connections from logstash to kafka when running something like netstat?

---

<div class="post-metadata">

**Author:** ![memelet](https://avatars.discourse-cdn.com/v4/letter/m/6bbea6/32.png) [@memelet](https://discuss.elastic.co/u/memelet)\
**Post date:** [July 26, 2016, 7:53am UTC](https://discuss.elastic.co/t/should-i-expect-2-3-kafka-plugins-to-work-with-kafka-0-10/56213/5 "2016-07-26T07:53:31Z")

</div>

I had two problems, both user error.

The first was the EC2 security groups did not allow egress to kafka. The second, I was using the docs released docs, not the master docs. It seems that 3.x has unified the plugin parameters between input and output.

Just a few minutes ago we finished updating the production environment from rabbit to kafka and all is good.

thanks!

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:46am UTC](https://discuss.elastic.co/t/should-i-expect-2-3-kafka-plugins-to-work-with-kafka-0-10/56213/6 "2017-07-06T04:46:30Z")

</div>


