Using two kafka in the ELK setup(Load balancing)

Elastic Stack Logstash
1

Hi,

I am designing the ELK setup.I want the two kafka setup for the load balancing.
My setup will be look like below:

filebeat->kafka(2 servers)->logstash(3 servers)->ES->Kibana

I want to kafka server so that the log messages that come from filebeat will divide and two kafka server will act as the redundancy setup.

How to do load balancing with multiple kafkas?

2

FYI we’ve renamed ELK to the Elastic Stack, otherwise Beats feels left out :wink:

Do you mean from Filebeat, or Logstash, or something else?

3

Are the Kafka nodes clustered?

4

Kafka node is clustered.
How to do load balancing in logstash cluster(group of nodes)?

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.