I'm trying to use elasticsearch-hadoop in Spark 1.6 (right now It's the only avaible version in our CDH cluster) and I'm having issues with
java.lang.ClassNotFoundException using the main jar
From the documentation I'm supposed to use a separate jar
elasticsearch-spark-1.x-<version>.jar, but I can't find it.
In the zip from the official download page there are these jars:
elasticsearch-hadoop-6.5.4.jar elasticsearch-hadoop-cascading-6.5.4.jar elasticsearch-hadoop-hive-6.5.4.jar elasticsearch-hadoop-mr-6.5.4.jar elasticsearch-hadoop-pig-6.5.4.jar elasticsearch-spark-20_2.11-6.5.4.jar elasticsearch-storm-6.5.4.jar
The spark jar is the one for Spark 2.x...