Logstash 5 Alpha 4 connection with zookeeper is getting error

Elastic Stack Logstash
1

Below is configuration to connect to zookeeper server which configured with Kafka 0.10

input {
kafka {
bootstrap_servers => "zk_server:2181"
topics => ['logstash_log_2']
}
}

output{
stdout{}
}

In zookeeper which is configured with Kafka -0.10 is giving below error in logs.

[2016-07-13 20:21:36,574] WARN Exception causing close of session 0x0 due to java.io.IOException: Unreasonable length = 1819240307 (org.apache.zookeeper.server.NIOServerCnxn)

because of which i feel data cannot be picked from kafka in logstash.

Please provide help

2

  1. Look at the compatibility matrix and see what kafka client it is
    https://github.com/logstash-plugins/logstash-input-kafka

  2. Given you are using the 0.10 client, you need to know that it doesnt connect to zookeeper. Kakfa removed zookeeper dependency from the clients starting 0.9.

  3. So look at the documentation and update your configuration

3

Thanks a lot. You are correct about zookeeper dependency. I removed it and it started working now.