Metricbeat kafka output problem

Elastic Stack Beats
1

Hi,
I want to use message que for any beat. I search how to implemente message que in elastic system, I think we should use Kafka . I use metricbeat 6.6.1v so metricbeat data is send to kafka but Kafka can not log version. For example; metricbeat-6.6.1-2019-03-21, I had no problems use Beat--> Logstash-->ELK I create kafka topic

metricbeat config

#----------------------------- Kafka output --------------------------------
output.kafka:
  enabled: true
  hosts: ["172.28.26.169:9092"]  
  topic: '%{[type]}'
  partition.round_robin:
    reachable_only: false 
  required_acks: 1
  compression: none
  max_message_bytes: 1000000

LOGSTASH Format

input {
   kafka {
     bootstrap_servers => "172.28.26.169:9092"
     topics => ["%{[type]}"]
	 codec => "json"
  }
}
output {
  elasticsearch {
    hosts => ["172.28.26.169:9200"]
    index => "%{[type]}"
	workers => 1  }}

Kafka Topic create

Topic name is metricbeat

I don't know what to do if ı use filebeat. I was use Beat --> Logstash old system and there is not problem. Beat data created dynamic method.
I hope I can explain problem.
Best regards.

2

Not sure I can fully follow. What exaclty is now not working? You get some errors?

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.