We currently use ELK to search our logs.
I'm wondering is it possible for Spark Streaming to use Elasticsearch as a data source?
I want to stream thru logs arriving into Elasticsearch to check the time difference between a log statements for a request and another for response. And then write the time difference back into Elasticsearch.