ELK_GB
July 13, 2017, 8:33pm
4
here is what resolved my issue, hopefully will help you, im running LS 5.4 and this resolved the json codec not working.
bin/logstash-plugin update logstash-input-kafka
update your LS Kafka input plugin.
stop LS then run the above command.
BTW this may not work:
if [@metadata][type] == "my_app" {
json {
source => "message"
}
check this topic:
Issue Summary:
filebeat outputs to kafka 0.10 topic
logstash indexer inputs from kafka 0.10
outputs to elasticsearch
Problem: document count on elasticsearch doesn't change
Note: I'm able to get filebeat=>logstash=>elasticsearch working ok. When I try to add the kafka broker and adjust input/output accordingly, the content consumed by logstash doesn't output to elasticsearch.
Versions
logstash version
# /usr/share/logstash/bin/logstash -V
logstash 5.2.0
installed from elastic.co repository…