# Using Kafka in ES Cluster

**URL:** <https://discuss.elastic.co/t/using-kafka-in-es-cluster/123709>\
**Category:** Elasticsearch\
**Created:** [March 13, 2018, 10:02am UTC](https://discuss.elastic.co/t/using-kafka-in-es-cluster/123709 "2018-03-13T10:02:47Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ben96](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ben96/32/28334_2.png) [@Ben96](https://discuss.elastic.co/u/Ben96)\
**Post date:** [March 13, 2018, 10:02am UTC](https://discuss.elastic.co/t/using-kafka-in-es-cluster/123709/1 "2018-03-13T10:02:47Z")

</div>

Hi everyone, Ben again

We are currently investigating to implement Kafka ( In cluster mode ) to perform with our existing Elastic Stack cluster.

I'm here to know about some configuration, if some of you are currently using it in your own ELK cluster.

I wanna need some informations about setting up Kafka in frontend of Beats. I want kafka usage for "Caching" or "Queueing", in case we shutdown some nodes or the cluster for maintenance. In this case Beats could still push data to kafka for X time.

Sorry in advance if i'm posting in the wrong Category..

Thanks you in advance for reading and answer my need ! 🙂

Nota Bene: In case you need fore details about pre-existing cluster (ELK) tell me

---

<div class="post-metadata">

**Author:** ![talevy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/talevy/32/44896_2.png) [@talevy](https://discuss.elastic.co/u/talevy)\
**Post date:** [March 16, 2018, 4:04pm UTC](https://discuss.elastic.co/t/using-kafka-in-es-cluster/123709/2 "2018-03-16T16:04:51Z")

</div>

Hi Ben,

here is a blog post that explains how Kafka fits with the Elastic Stack:

> **[Just Enough Kafka for the Elastic Stack, Part 1](https://www.elastic.co/blog/just-enough-kafka-for-the-elastic-stack-part1)**
>
> This post talks about design considerations for integrating Kafka with the Elastic Stack.

Beats can be used to monitor Kafka logs via filebeat modules:  
[https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-module-kafka.html](https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-module-kafka.html)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 13, 2018, 4:18pm UTC](https://discuss.elastic.co/t/using-kafka-in-es-cluster/123709/3 "2018-04-13T16:18:44Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.