Using two kafka in the ELK setup(Load balancing)


(Jay Dabhi) #1

Hi,

I am designing the ELK setup.I want the two kafka setup for the load balancing.
My setup will be look like below:

filebeat->kafka(2 servers)->logstash(3 servers)->ES->Kibana

I want to kafka server so that the log messages that come from filebeat will divide and two kafka server will act as the redundancy setup.

How to do load balancing with multiple kafkas?


(Mark Walkom) #2

FYI we’ve renamed ELK to the Elastic Stack, otherwise Beats feels left out :wink:

Do you mean from Filebeat, or Logstash, or something else?


(Christian Dahlqvist) #3

Are the Kafka nodes clustered?


(Jay Dabhi) #4

Kafka node is clustered.
How to do load balancing in logstash cluster(group of nodes)?


(system) #5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.