Kafka Consumer ElasticSearch?

[rishabh_jain]

is there any way by which the data sent into kafka stream can be dumped into elasticsearch?

[Luca_Belluccini]

Hello @rishabh_jain

Not directly... You need something in the middle.

Few options:

• ES-Hadoop for Spark
• Logstash with Kafka Input
• Filebeat with Kafka Input
• Kafka Connector for Elasticsearch - Not by Elastic

[rishabh_jain]

Thanks.
Can you help me with one more problem
is there any way in which i can do Upsert on the basis of version
i.e if document doesn't exists then it would create the document
and if exists then it would look for version if new version is greater than existing version then only it would update the document.

[Christian_Dahlqvist]

You should be able to use the version and version_type request parameters to control this. Not sure which ingest methods do or do not support this though.

[rishabh_jain]

POST API does not support external versioninig is there any way ?

[Luca_Belluccini]

Hello @rishabh_jain

By Update you mean partially updating a document or overwriting the existing one?

[rishabh_jain]

want to partially update a document.
and also if the document doesn't exists then it should be created