# Spark StreamingContext read streaming updates from ES

**URL:** <https://discuss.elastic.co/t/spark-streamingcontext-read-streaming-updates-from-es/20853>\
**Category:** Elasticsearch\
**Created:** [November 20, 2014, 1:01am UTC](https://discuss.elastic.co/t/spark-streamingcontext-read-streaming-updates-from-es/20853 "2014-11-20T01:01:07Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Brian\_Walsh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/brian_walsh/32/1087_2.png) [@Brian\_Walsh](https://discuss.elastic.co/u/Brian_Walsh)\
**Post date:** [November 20, 2014, 1:01am UTC](https://discuss.elastic.co/t/spark-streamingcontext-read-streaming-updates-from-es/20853/1 "2014-11-20T01:01:07Z")

</div>

Existing Spark support allows us to read or write to ES.

Read support is to one shot, that is, read what ES has in it's index now.

I'd like to have a Spark thread read streaming updates from ES, using it as  
a source not a sink.

I was wondering if there was a way to write a spark StreamingContext that  
will observe updates to ES?

Something like

ssc.elasticSearchStream(...)

Thanks for your time.

-b

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/3c4b5844-2648-40ee-8769-cd9c40456947%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/3c4b5844-2648-40ee-8769-cd9c40456947%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 12:48am UTC](https://discuss.elastic.co/t/spark-streamingcontext-read-streaming-updates-from-es/20853/2 "2017-07-06T00:48:51Z")

</div>


