When to use kafka or redis

My current setup looks like this

springbootApp -> log.json -> filebeat ->logstash ->elastic ->kibana

I am seeing examples where people use Kafka or Redis. When should I be considering using kafka and when is it not necessary? I am looking to see what tradeoffs and potential pitfalls I have with my current setup?

Usually, if you want an ability to separate ingest and processing and allow for extended buffering while also guaranteeing that data is moved off the source host ASAP.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.