Persistent queue and kafka output

Hi,
We are reading from kafka topics, performing different transformations and then write back to other kafka topics.

Since logstash does periodic commits to kafka we where not able to use inmemory queues and we are instead moving to persistent queues.

My question is when kafka output acknowledges a message, is it after a message has been successfully sent to kafka or only after it has been put in the producer buffer?

I would expect that it is ACK:ed after it has been successfully sent but I want to be certain.

Regards /Johan

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.