Spark Structured Streaming Sink and Elasticsearch

Elastic Stack Elasticsearch
1

Hello,

Is there a plan to go from DStreams to the new Structured Streaming support for Spark ?

https://www.elastic.co/guide/en/elasticsearch/hadoop/master/spark.html#spark-streaming

I was hoping for an Elasticsearch API that looked like :

http://developer.couchbase.com/documentation/server/4.5/connectors/spark-2.0/structured-streaming.html

If anyone knows, is there support for the new Spark structured Streaming API in Elasticsearch? if yes, when would we expect to see it. If no, are there other workarounds that don't involve using DStreams ?

Thanks

Rene

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.