I am seeing examples where people use Kafka or Redis. When should I be considering using kafka and when is it not necessary? I am looking to see what tradeoffs and potential pitfalls I have with my current setup?
Usually, if you want an ability to separate ingest and processing and allow for extended buffering while also guaranteeing that data is moved off the source host ASAP.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.