# Can filebeat monitoring send data to Kafka? **URL:** \ **Category:** Beats\ **Tags:** filebeat\ **Created:** [September 18, 2019, 12:49pm UTC](https://discuss.elastic.co/t/can-filebeat-monitoring-send-data-to-kafka/200006 "2019-09-18T12:49:37Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![arunpmohan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/arunpmohan/32/69467_2.png) [@arunpmohan](https://discuss.elastic.co/u/arunpmohan)\ **Post date:** [September 18, 2019, 12:49pm UTC](https://discuss.elastic.co/t/can-filebeat-monitoring-send-data-to-kafka/200006/1 "2019-09-18T12:49:37Z")
As per the monitoring options for Filebeat given [here](https://www.elastic.co/guide/en/beats/filebeat/current/monitoring-internal-collection.html), the monitoring stats can be send to Elasticsearch. But I would like the data to be sent to Kafka. Is this possible?. ---
**Author:** ![arunpmohan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/arunpmohan/32/69467_2.png) [@arunpmohan](https://discuss.elastic.co/u/arunpmohan)\ **Post date:** [September 19, 2019, 3:16pm UTC](https://discuss.elastic.co/t/can-filebeat-monitoring-send-data-to-kafka/200006/2 "2019-09-19T15:16:19Z")
I also tried to mimic Elasticsearch using Logstash in the filebeat configuration as below: > monitoring: > enabled: true > elasticsearch: > hosts: ["[http://localhost:5050](http://localhost:5050)"] My logstash configuration for this was below: > input { > http { > host =\> "0.0.0.0" > port =\> "5050" > } > } > output { > elasticsearch { > hosts =\> ["localhost:9200"] > index =\> "filebeat\_monitoring\_logs-%{+YYYY.MM.dd}" > } > stdout { codec =\> rubydebug } > } But this also didnt work. Any idea of how to collect monitoring data from filebeat to Kafka/Logstash? ---
**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\ **Post date:** [September 19, 2019, 3:26pm UTC](https://discuss.elastic.co/t/can-filebeat-monitoring-send-data-to-kafka/200006/3 "2019-09-19T15:26:32Z")
Yes take a look [here](https://www.elastic.co/guide/en/beats/filebeat/7.3/kafka-output.html) FIXED : I put the wrong link first time... ---
**Author:** ![arunpmohan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/arunpmohan/32/69467_2.png) [@arunpmohan](https://discuss.elastic.co/u/arunpmohan)\ **Post date:** [September 19, 2019, 3:33pm UTC](https://discuss.elastic.co/t/can-filebeat-monitoring-send-data-to-kafka/200006/4 "2019-09-19T15:33:03Z")
@stephenb I think what you have given is the normal data forwarding configuration to Kafka. What I am actually looking for is the monitoring stats data which is sent by the filebeat, that is to be forwarded to Kafka/Logstash. You can see the details [here](https://www.elastic.co/guide/en/beats/filebeat/current/monitoring-internal-collection.html) This data was what I was not able to send to Kafka/Logstash from Filebeat. ---
**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\ **Post date:** [September 19, 2019, 3:58pm UTC](https://discuss.elastic.co/t/can-filebeat-monitoring-send-data-to-kafka/200006/5 "2019-09-19T15:58:22Z")
@arunpmohan Ahh I see apologies... hmm... yes I don't see and obvious way... at the moment I will ask a question... Perhaps you could try this method [https://www.elastic.co/guide/en/beats/filebeat/current/monitoring-metricbeat-collection.html](https://www.elastic.co/guide/en/beats/filebeat/current/monitoring-metricbeat-collection.html) and ship the metricbeat output to Kafka ... ---
**Author:** ![arunpmohan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/arunpmohan/32/69467_2.png) [@arunpmohan](https://discuss.elastic.co/u/arunpmohan)\ **Post date:** [September 19, 2019, 4:08pm UTC](https://discuss.elastic.co/t/can-filebeat-monitoring-send-data-to-kafka/200006/6 "2019-09-19T16:08:59Z")
@stephenb Hmm.. I have 2 questions 1. we are using version 6.6. This is available only from 7.3 it seems. So will it work? 2. Also, it is tagged "xpack", so is it an xpack only feature? ---
**Author:** ![arunpmohan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/arunpmohan/32/69467_2.png) [@arunpmohan](https://discuss.elastic.co/u/arunpmohan)\ **Post date:** [September 28, 2019, 3:35pm UTC](https://discuss.elastic.co/t/can-filebeat-monitoring-send-data-to-kafka/200006/7 "2019-09-28T15:35:28Z")
@stephenb Can you please get back on the previous questions?. ---
**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\ **Post date:** [September 28, 2019, 3:43pm UTC](https://discuss.elastic.co/t/can-filebeat-monitoring-send-data-to-kafka/200006/8 "2019-09-28T15:43:06Z")
> [@arunpmohan](#): > > - we are using version 6.6. This is available only from 7.3 it seems. So will it work? > - Also, it is tagged "xpack", so is it an xpack only feature? So i do not expect it will work in 6.6 as that is explicitly 7.3 and beyond per the docs _"In 7.3 and later, you can use Metricbeat to collect data about Filebeat and ship it to the monitoring cluster..."_ As for checking around, no one I spoke to had tried that yet, and I do not have a proper test harness to try that so you would need to try it on your own. Per the "XPack" that means that it is not part of the OSS distribution in this case it is part of the "Basic / Default" distribution which is free to use. You can see what is part of OSS, Basic, Gold, Platinum [here](https://www.elastic.co/subscriptions) ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [October 26, 2019, 3:58pm UTC](https://discuss.elastic.co/t/can-filebeat-monitoring-send-data-to-kafka/200006/9 "2019-10-26T15:58:15Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.