Kafka Logs not working

Elastic Stack Beats
1

I installed FileBEat (Confirmed that its working) then I configured Kafka with the following configuration

- module: kafka
  # All logs
  log:
    enabled: true

    # Set custom paths for Kafka. If left empty,
    # Filebeat will look under /opt.
    var.kafka_home: /usr/share/kafka_2.12-2.0.0

    # Set custom paths for the log files. If left empty,
    # Filebeat will choose the paths depending on your OS.
    var.paths:
      - "/usr/share/kafka_2.12-2.0.0/controller.log*"
      - "/usr/share/kafka_2.12-2.0.0/server.log*"
      - "/usr/share/kafka_2.12-2.0.0/state-change.log*"
      - "/usr/share/kafka_2.12-2.0.0/kafka-*.log*"

When I start the FileBeat service, I dont see any logs on Kibana, I dont see any errors either. Ideas?

2

Hi @adwaitjoshi :slight_smile:

I think that your config is incorrect. You'll find logs under logs folder inside Kafka folder.

- module: kafka
  # All logs
  log:
    enabled: true

    # Set custom paths for Kafka. If left empty,
    # Filebeat will look under /opt.
    var.kafka_home: /usr/share/kafka_2.12-2.0.0

    # Set custom paths for the log files. If left empty,
    # Filebeat will choose the paths depending on your OS.
    var.paths:
      - "/usr/share/kafka_2.12-2.0.0/logs/controller.log*"
      - "/usr/share/kafka_2.12-2.0.0/logs/server.log*"
      - "/usr/share/kafka_2.12-2.0.0/logs/state-change.log*"
      - "/usr/share/kafka_2.12-2.0.0/logs/kafka-*.log*"

Best regards

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.