# Using two kafka in the ELK setup(Load balancing)

**URL:** <https://discuss.elastic.co/t/using-two-kafka-in-the-elk-setup-load-balancing/101646>\
**Category:** Logstash\
**Created:** [September 25, 2017, 7:01am UTC](https://discuss.elastic.co/t/using-two-kafka-in-the-elk-setup-load-balancing/101646 "2017-09-25T07:01:23Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Jay\_Dabhi](https://avatars.discourse-cdn.com/v4/letter/j/8c91f0/32.png) [@Jay\_Dabhi](https://discuss.elastic.co/u/Jay_Dabhi)\
**Post date:** [September 25, 2017, 7:01am UTC](https://discuss.elastic.co/t/using-two-kafka-in-the-elk-setup-load-balancing/101646/1 "2017-09-25T07:01:24Z")

</div>

Hi,

I am designing the ELK setup.I want the two kafka setup for the load balancing.  
My setup will be look like below:

filebeat-\>kafka(2 servers)-\>logstash(3 servers)-\>ES-\>Kibana

I want to kafka server so that the log messages that come from filebeat will divide and two kafka server will act as the redundancy setup.

How to do load balancing with multiple kafkas?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [September 26, 2017, 5:24am UTC](https://discuss.elastic.co/t/using-two-kafka-in-the-elk-setup-load-balancing/101646/2 "2017-09-26T05:24:56Z")

</div>

FYI we’ve renamed ELK to the Elastic Stack, otherwise Beats feels left out 😉

> [@Jay\_Dabhi](#):
>
> How to do load balancing with multiple kafkas?

Do you mean from Filebeat, or Logstash, or something else?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [September 26, 2017, 5:26am UTC](https://discuss.elastic.co/t/using-two-kafka-in-the-elk-setup-load-balancing/101646/3 "2017-09-26T05:26:49Z")

</div>

Are the Kafka nodes clustered?

---

<div class="post-metadata">

**Author:** ![Jay\_Dabhi](https://avatars.discourse-cdn.com/v4/letter/j/8c91f0/32.png) [@Jay\_Dabhi](https://discuss.elastic.co/u/Jay_Dabhi)\
**Post date:** [September 26, 2017, 6:37am UTC](https://discuss.elastic.co/t/using-two-kafka-in-the-elk-setup-load-balancing/101646/4 "2017-09-26T06:37:40Z")

</div>

Kafka node is clustered.  
How to do load balancing in logstash cluster(group of nodes)?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 24, 2017, 6:37am UTC](https://discuss.elastic.co/t/using-two-kafka-in-the-elk-setup-load-balancing/101646/5 "2017-10-24T06:37:41Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.