Is it now possible to perform ES aggregations using Spark?
An earlier post from March 2016 says the functionality isn't available yet but is on the roadmap.
Hello everyone,
based on discussion about ES use cases I was wondering whether there is any way how Spark could benefit from ES aggregations and convert them to Dataframe. F.e something like:
val esConf = ... val esQuery = """{"agg" : {"my_agg" : {"terms" : {"field": "field_A"} } } }""" val jsonResult = client.search(esQuery, esConf) val transformer = ... val df = jsonResult.toDF(transformer) val result = df.filter(...).join(otherDf) ....
A) Is there any plan to support something similar in E…
Can you please give me an update on its status?
Thanks!
system
June 19, 2019, 2:36pm
2
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
@angelazhao This issue is a big one that the project is looking to complete, but at the moment work on it is stalled. You can follow the issue here