I'm seeing the same error as the previous poster. I have a config defined:
input {
kafka {
zk_connect => "mzkeeper1q.qadfw2.mycomp.com:5181,mzkeeper2q.qadfw2.mycomp.com:5181,mzkeeper3q.qadfw2.mycomp.com:5181"
topic_id => "raw_log2kafka"
consumer_threads => 4
decoder_class => "com.mycomp.etl.avro.schema.kafka.RawLog2KafkaSerializer"
key_decoder_class => "com.mycomp.etl.avro.schema.kafka.RawLog2KafkaSerializer"
}
}
and I've put the decoder class (and the jar file) in the directory where logstash is installed, its bin and its lib directory, and I still get:
kafka client threw exception, restarting {:exception=>#<NameError:
cannot load Java class com.mycomp.etl.avro.schema.kafka.RawLog2KafkaSerializer
,
:level=>:warn, :file=>"logstash/inputs/kafka.rb", :line=>"150", :method=>"run"}
From what I've read, I thought I only needed the class file and I only needed it installed in the main logstash directory. The rest was just to try to get it working. This was using the main logstash 1.5.4. I then downloaded logstash-input-kafka from git (GitHub - joekiller/logstash-input-kafka: Kafka input for Logstash). I'm concerned because I don't even see the decoder_class/key_decoder_class parameters in that version and I hope those parameters are still being supported, because I coded it based on the documentation.
Any guidance would be appreciated. Keep in mind, I'm a java developer, so if you have ruby directions, please don't take anything for granted.
Thanks.
Ilene