Is there anyone here tried to use logstash to push data from elasticserach to kafka?
I have used elasticsearch inputs and kafka outputs. Did you have a more specific question?
Yes, I have.
The key is to make sure that the query you use in the elasticsearch input includes an ascending sort on the @timestamp field. This ensures that the data is written to the Kafka topic in order.
I tried to use kafka output plugin. My input is elasticsearch. But it duplicates the docs in kafka
I posted another topic in regards with my issue
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.