When to use kafka or redis

Rob_Davidson · September 13, 2017, 3:22pm

My current setup looks like this

springbootApp -> log.json -> filebeat ->logstash ->elastic ->kibana

I am seeing examples where people use Kafka or Redis. When should I be considering using kafka and when is it not necessary? I am looking to see what tradeoffs and potential pitfalls I have with my current setup?

warkolm · September 13, 2017, 8:54pm

Usually, if you want an ability to separate ingest and processing and allow for extended buffering while also guaranteeing that data is moved off the source host ASAP.

Topic		Replies	Views
Is it still actual use Redis or Kafka before Elastic Stack? Elasticsearch	2	3316	September 15, 2017
Redis Vs Kafka Vs RabbitMQ in ELK Logstash	7	8560	July 6, 2017
Redis in elk Logstash	8	1211	February 26, 2021
When should I use Kafka? Beats filebeat	4	1811	August 21, 2020
Suitability of kafka in current ELK pipeline Elasticsearch	4	616	September 29, 2017

When to use kafka or redis

Related topics