Hi all, is there a way to handle multipe ES clusters in a Spark application? For example, use sparkSQL to query data from two ES clusters. For now, i've just seen configuration of "es.nodes" in sparkConf. Is it possible to specify "es.node" when read datasource? ex: sqlContext.read.format("org.…

Multiple ES clusters in SparkSQL

ludonara November 25, 2015, 9:58am 2

this is related to my question Using ES Spark to copy data from one instance to another and the response seems "no way for now"

Topic		Replies	Views
Using Spark DataSource with ES Hadoop Elasticsearch es-hadoop	2	677	July 6, 2017
Using ES Spark to copy data from one instance to another Elasticsearch es-hadoop	2	1429	July 6, 2017
ElasticSearch Hadoop connector - distribute the data Elasticsearch es-hadoop	1	689	December 13, 2016
Spark querying on ELK Stack Elasticsearch es-hadoop	2	1575	February 26, 2018
ElasticSearch+Hadoop+Spark Elasticsearch	2	963	July 6, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Multiple ES clusters in SparkSQL

Related topics