Hi,
When should we use kafka in ELK stack?
Where should we put kafka module in ELK stack provided filebeat is being used for log shipping?
FYI we’ve renamed ELK to the Elastic Stack, otherwise Beats feels left out 
Usually Kafka is deployed as a broker layer, see https://www.elastic.co/guide/en/logstash/5.6/deploying-and-scaling.html#integrating-with-messaging-queues for some info.
are there some guides on how to deploy and configure with this architecture?
I already tried to use kafka but on my producer side, it does not send data to elasticsearch.
Kafka does not send to Elasticsearch anyway, you still need Logstash there to extract from it and then do the processing and sending.
Yes @warkolm, that's also what i did.
ES -> logstash -> kafka -> logstash -> es
Might b be easier to start another thread with more, specific details 
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.