# Elasticsearch Integration with Kafka, Zookeeper using filebeat

**URL:** <https://discuss.elastic.co/t/elasticsearch-integration-with-kafka-zookeeper-using-filebeat/74504>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [February 9, 2017, 1:17pm UTC](https://discuss.elastic.co/t/elasticsearch-integration-with-kafka-zookeeper-using-filebeat/74504 "2017-02-09T13:17:19Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![gauravbhutani30](https://avatars.discourse-cdn.com/v4/letter/g/e47774/32.png) [@gauravbhutani30](https://discuss.elastic.co/u/gauravbhutani30)\
**Post date:** [February 9, 2017, 1:17pm UTC](https://discuss.elastic.co/t/elasticsearch-integration-with-kafka-zookeeper-using-filebeat/74504/1 "2017-02-09T13:17:19Z")

</div>

Hi Everyone,

I am have a Elastic cluster running with nodes spread across multiple datacenters.  
Now, I have to ensure the data synchronization across the nodes. I came across Kafka which is used to process large data and it uses Zookeeper to sync the data between the nodes.

> **[Just Enough Kafka for the Elastic Stack, Part 1](https://www.elastic.co/blog/just-enough-kafka-for-the-elastic-stack-part1)**
>
> This post talks about design considerations for integrating Kafka with the Elastic Stack.

Can you please help me with the step by step guide on how to install, configure and run kafka with Elastisearch using filebeat as suggested in the above link.

I found the below link but did not get any practical example to configure it:  
[https://www.elastic.co/guide/en/beats/filebeat/master/kafka-output.html](https://www.elastic.co/guide/en/beats/filebeat/master/kafka-output.html)

Please help and suggest if there is any other solution!!

---

<div class="post-metadata">

**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\
**Post date:** [February 9, 2017, 3:18pm UTC](https://discuss.elastic.co/t/elasticsearch-integration-with-kafka-zookeeper-using-filebeat/74504/2 "2017-02-09T15:18:12Z")

</div>

The article wants you to send filebeat-\>logstash-\>kafka. In case you don't want any other inputs for logstash, you can have filebeat directly send to kafka.

[Here's a sample](https://www.elastic.co/guide/en/beats/filebeat/current/config-filebeat-logstash.html) how to have filebeat send data to logstash.

check out filebeat.full.yml or the filebeat docs for all output settings.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 9, 2017, 3:18pm UTC](https://discuss.elastic.co/t/elasticsearch-integration-with-kafka-zookeeper-using-filebeat/74504/3 "2017-03-09T15:18:35Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.