Filebeat Empty Monitoring Metrics

Elastic Stack Beats
1

Hi,

When monitoring Filebeat 6.7.1, we see some empty metrics:

Throughput (/s), Fail Rates (/s), Output Errors (/s)

All of these are at 0. Our output is Kafka

2

Hi @Or_Arnon,

Did this started happening with 6.7.1?

Could you share your configuration?

3

Hi

We actually had the same issue with 6.5 and now with 6.7.1

filebeat.inputs:
- type: log
  enabled: true
  paths:
    - /ephemeral/log/haproxy/haproxy*
  fields_under_root: true
  json.keys_under_root: true
  json.add_error_key: true
  scan_frequency: 10s

filebeat.config.modules:
  path: ${path.config}/modules.d/*.yml
  reload.enabled: true

filebeat.config.inputs:
  reload.enabled: true
  reload.period: 60s

output.kafka:
  enabled: true
  hosts: [ "kafka1:9092","kafka2:9092" ]
  worker: 2
  version: 2.0.0
  compression: snappy
  bulk_max_size: 4098
  required_acks: 0
  client_id: "filebeat"
  topic: "test_filebeat"

logging.level: info

http.enabled: true

xpack.monitoring:
  enabled: true
  elasticsearch:
    hosts: [ "kibana1:9200","kibana2:9200" ]
4

It seems that metrics collection is not supported in the Kafka output, there is an open issue about this: https://github.com/elastic/beats/issues/9378

5

Hi,

Thanks for bringing this to my attention.

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.