Apache kafka heartbeat creation

Elastic Stack Beats
1

Hi Team ,

I am unable to create heartbeat monitors for the apache kafka endpoints.
Can some one please help me out.

heartbeat.yml

Logs in kibana:
{
"_index": "heartbeat-7.2.0-2019.07.09-000001",
"_type": "_doc",
"_id": "hRIi4WsBeyb-AKwKKVP1",
"_version": 1,
"_score": null,
"_source": {
"@timestamp": "2019-07-11T13:04:00.001Z",
"ecs": {
"version": "1.0.0"
},
"summary": {
"up": 0,
"down": 1
},
"http": {
"rtt": {
"validate": {
"us": 0
},
"content": {
"us": 9223372036854776
}
}
},
"event": {
"dataset": "uptime"
},
"tcp": {
"rtt": {
"connect": {
"us": 7000
}
}
},
"monitor": {
"duration": {
"us": 11000
},
"name": "",
"type": "http",
"id": "auto-http-0X258A9A4A7CF070C5",
"check_group": "5378aec8-a3dc-11e9-aed0-005056bdb4d4",
"ip": "127.0.0.1",
"status": "down"
},
"host": {
"name": "VDMPAPIDEV01012"
},
"agent": {
"version": "7.2.0",
"type": "heartbeat",
"ephemeral_id": "90658818-932f-48ae-99e8-6ef14e9a712a",
"hostname": "VDMPAPIDEV01012",
"id": "f886e3c6-5d5d-469d-8768-b5380c650dcc"
},
"observer": {
"hostname": "VDMPAPIDEV01012"
},
"resolve": {
"ip": "127.0.0.1",
"rtt": {
"us": 3000
}
},
"url": {
"full": "http://localhost:9092",
"scheme": "http",
"domain": "localhost",
"port": 9092
},
"error": {
"type": "io",
"message": "Get http://localhost:9092: unexpected EOF"
}
},
"fields": {
"@timestamp": [
"2019-07-11T13:04:00.001Z"
]
},
"sort": [
1562850240001
]
}

Its showing down.

but the broker is working.

I am unable to

2

Can you ping that URL with cURL? Is that an HTTP endpoint or for the kafka protocol? If It's not HTTP you can use type: tcp

3

Hi ,

It's a Kafka protocol I hope which will work on the port 9092,that's Kafka broker.

Thanks,

Neha

4

In that case you'll need to use a plain TCP check as described.

5

Hi ,

If you set up Apache Kafka

https://medium.com/@shaaslam/installing-apache-kafka-on-windows-495f6f2fd3c8

Then in this port 9092 is my port to work.

Which is not working.

Thank s,

Neha

6

Hi ,

I will try tomorrow morning.

One more scenario I am stuck , I want to use jmx between Kafka to ELK stack,

How I can enable jmx in the Kafka on windows system.

Thanks,

Neha

7

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.