The logstash(indexer) can not get logs from kafka

Elastic Stack Logstash
1

logstash(agent)-->kafka--->logstash(indexer)-->ES
logstash(agent) collected logs and send them to kafka was good.but the logstash(indexer) can't get the logs from kafka to ES.and there is no error logs.how could i solve this problem ,anyone has any ideas about this ？

the test environment ：one zookeeper instance and one kafka instance in the same server

thank you！！！

run this command can see
kafka/bin/kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 172.16.255.116:9092 --topic XXXX
（3 partitions）
XXXX:2:28959
XXXX:1:28959
XXXX:0:28958

Version:
logstash--->5.5.0
kafka----->2.11-1.1.0

logstash(agent) config-file
output {
kafka {
bootstrap_servers => "172.16.255.116:9092"
topic_id => "XXXX"
acks => "0"
compression_type => "snappy"
}
}

logstash(indexer)config-file
input {
kafka{
topics => ["XXXX"]
bootstrap_servers => "172.16.255.116:9092"
consumer_threads => 5
decorate_events => true
}
}

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.