Sending data from kafka docker container to elastic search docker container

shubham_sharma · July 9, 2016, 5:35am

Hi Team,

I am using spotify/kafka docker image & official elasticsearch docker images but I am unable to send any logs from kafka to elasticsearch.Kiindly guide. I am using kafka version 2.11-0.8..2.1 with elasticsearch 2.3.2

magnusbaeck · July 18, 2016, 9:55am

Elasticsearch doesn't support ingesting data directly from Kafka, so it's not clear exactly what you've tried. Are you using Logstash as well? Perhaps https://www.elastic.co/blog/just-enough-kafka-for-the-elastic-stack-part1 and the follow-up post can help you.

anishm · July 18, 2016, 10:34am

You can also look at several Kafka Connect projects http://www.confluent.io/product/connectors which are meant to send data from Kafka to ElasticSearch.