metricbeat.yml
path: ${path.config}/modules.d/*.yml
reload.enabled: true
setup.kibana:
host: "https://#.#.#.#:443"
protocol: "https"
ssl.verification_mode: none
output.elasticsearch: hosts: ["https://ec1:9200","https://ec2:9200"] ssl.certificate_authorities: ["/etc/elasticsearch/certs/ca/ca.crt"]
username: “***“
password: “***"
processors: - add_host_metadata: ~
logging.level: info
logging.selectors: ["*"]
logging.to_files: true
logging.files:
path: /var/log/metricbeat
name: metricbeat
keepfiles: 1
permissions: 0644
kafka.yml
- module: kafka
metricsets:
- partition
- consumergroup
- broker
enabled: true
period: 10s
hosts: ["kafka1:9092","kafka2:9092","kafka3:9092"]
systemctl daemon-reload
systemctl enable metricbeat
systemctl start metricbeat
metricbeat setup –e (loading dashboards on kibana)
Only two brokers are displayed in kafka dashboard there should be three brokers.
whereas in observability there are three kafka shown
