Elastic Search with Kafka


(Senthil Nathan Manoharan) #1

Hi Team

We are deliberating the feasibility of adding Confluent Kafka as a message broker to our Elastic Search instance.

Now that logstash comes with its own persistence and dead letter queues, I have some questions in this regard.

(1) Having a message queue layer like Kafka decouples the beat and logstash services which allows for handling work load bursts. How does the built-in queues of logstash handle this ?
(2) Is there any negative impact on Elastic Search performance with adding a message queue layer ?

Regards
Senthil Nathan M


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.