Metricbeat kafka output problem

I want to use message que for any beat. I search how to implemente message que in elastic system, I think we should use Kafka . I use metricbeat 6.6.1v so metricbeat data is send to kafka but Kafka can not log version. For example; metricbeat-6.6.1-2019-03-21, I had no problems use Beat--> Logstash-->ELK I create kafka topic

metricbeat config

#----------------------------- Kafka output --------------------------------
  enabled: true
  hosts: [""]  
  topic: '%{[type]}'
    reachable_only: false 
  required_acks: 1
  compression: none
  max_message_bytes: 1000000


input {
   kafka {
     bootstrap_servers => ""
     topics => ["%{[type]}"]
	 codec => "json"
output {
  elasticsearch {
    hosts => [""]
    index => "%{[type]}"
	workers => 1  }}

Kafka Topic create

Topic name is metricbeat

I don't know what to do if ı use filebeat. I was use Beat --> Logstash old system and there is not problem. Beat data created dynamic method.
I hope I can explain problem.
Best regards.

Not sure I can fully follow. What exaclty is now not working? You get some errors?

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.