Elasticsearch to Spark Streaming and back


(Dar Varley) #1

We currently use ELK to search our logs.
I'm wondering is it possible for Spark Streaming to use Elasticsearch as a data source?

I want to stream thru logs arriving into Elasticsearch to check the time difference between a log statements for a request and another for response. And then write the time difference back into Elasticsearch.


(system) #2