ElasticSearch Hadoop connector - distribute the data


(Prashanth) #1

Is there a way we can use the ES-Hadoop connector in a cluster mode. How to configure the connector to work with Spark/Hadoop with more than one node or will it will be connected to the master node only?

For e.g. we have two Hadoop nodes with Spark running on them. Can we read the data from an index in ES using the connector and distribute the data across the two spark/hadoop nodes for further processing?

Thanks.


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.