WARN No appenders could be found for logger (org.apache.kafka.clients.producer.ProducerConfig)

[rahiminasab (Ehsan)]

Hi,

I am using Logstash 5.3.0.

When I use Kafka output plugin in my config file as follows:
output {
kafka {
codec => plain {
format => "%{message}"
}
bootstrap_servers => "dev02n.wh:9092"
topic_id => "hdfs_audit_log_test"
retries => 3
batch_size => 3
client_id => "hdp-nn-audit"
}
}

I get the following warnings:

log4j:WARN No appenders could be found for logger (org.apache.kafka.clients.producer.ProducerConfig).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

I do not receive any messages in the intended Kafka topic and I guess the reason is probably because that log4j is not setup properly.

What am I missing here?

[rahiminasab (Ehsan)]

my kafka version is 0.9. Java version 1.8.

downgrading the logstash to 2.3 solved the problem.

[magnusbaeck (Magnus Bäck)]

I do not receive any messages in the intended Kafka topic and I guess the reason is probably because that log4j is not setup properly.

No, that's not likely.