Hi, I use Kafka for message queue/processing. My question is about performance/best practice. I will do my own performance tests but maybe someone has results/experience already. The data is raw in a Kafka (0.10) topic and I want to transfer it structured to ES and HDFS. Now I see 2 possibilities…

Kafka -> ES/HDFS with Logstash or Kafka Stream/Connect

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Kafka -> ES/HDFS with Logstash or Kafka Stream/Connect