Kafka connect (elasticsearch connector) vs Logstash


(Venkat Venkat) #1

HI,

Thanks in advance!!

We are building a new pipe line, we want to use kafka connect (elasticsearch connector) instead of logstash, for one of theEnvoirnment, i want to know which one is better. Please advice me.


(Mark Walkom) #2

Better for what?


(Venkat Venkat) #3

I am more curious about the performance, Which are the dependencies for the kafka connect (elasticsearch connector) and Performance of both logstash and kafka connect.


(Venkat Venkat) #4

what to know the performance, which one give us good performance.


(Mark Walkom) #5

Performance for what? What are you wanting to do exactly?


(Venkat Venkat) #6

For injecting data...


(Venkat Venkat) #7
  1. elastic search connector from kafka topic to elastic search index or 2) kafka topic - logstash - elastic search

(Venkat Venkat) #8

Did you get my point or can i elaborate more on this ??


(Christian Dahlqvist) #9

Performance of the ingest pipeline depends a lot on the type of processing you want to perform, and the best way to find out is to benchmark with real data and real transformations. You may also want to examine aspects like error handling, resilience and how easy it is to manage depending on what your requirements are.


(system) #10

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.