i'm looking for a way for elastic to generate a spark job which will perform aggregations and write them back to elasticsearch and for them to be available for kibana to display. we're using kibana as a BI platform for our data, but it's getting too massive. we can increase the compute (by a lot) …

Is there a way for Elasticsearch to initiate a spark job?

Christian_Dahlqvist (Christian Dahlqvist) May 12, 2019, 8:01pm 2

I suspect you would need to orchestrate such a scheme outside Elasticsearch.

Topic		Replies	Views
Access spark from kibana Kibana	3	2259	May 29, 2017
Submitting jobs to apache spark Kibana	3	715	July 6, 2017
Support for Aggregations in Spark Elasticsearch es-hadoop	2	1214	June 24, 2019
Possible to use aggregations Elasticsearch es-hadoop	3	738	July 6, 2017
Use cases Elasticsearch and Spark Elasticsearch es-hadoop	5	3412	July 6, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Is there a way for Elasticsearch to initiate a spark job?

Related topics