Hi all, is there a way to handle multipe ES clusters in a Spark application? For example, use sparkSQL to query data from two ES clusters. For now, i've just seen configuration of "es.nodes" in sparkConf. Is it possible to specify "es.node" when read datasource? ex: sqlContext.read.format("org.…

Multiple ES clusters in SparkSQL

ludonara November 25, 2015, 9:58am 2

this is related to my question Using ES Spark to copy data from one instance to another and the response seems "no way for now"

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.