Unable to find prebuilt jar for Spark 1.6

Elastic Stack Elasticsearch
1

Hi,

I'm trying to use elasticsearch-hadoop in Spark 1.6 (right now It's the only avaible version in our CDH cluster) and I'm having issues with java.lang.ClassNotFoundException using the main jar elasticsearch-hadoop-6.5.4.jar.

From the documentation I'm supposed to use a separate jar elasticsearch-spark-1.x-<version>.jar, but I can't find it.

In the zip from the official download page there are these jars:

elasticsearch-hadoop-6.5.4.jar
elasticsearch-hadoop-cascading-6.5.4.jar
elasticsearch-hadoop-hive-6.5.4.jar
elasticsearch-hadoop-mr-6.5.4.jar
elasticsearch-hadoop-pig-6.5.4.jar
elasticsearch-spark-20_2.11-6.5.4.jar
elasticsearch-storm-6.5.4.jar

The spark jar is the one for Spark 2.x...

Thanks,
Enrico

2

You should be able to get that artifact from maven. We publish two 1.3-1.6 compatibility jars there depending on your scala major version:

For Scala 2.10 you can find the available versions and artifact names here:
http://repo1.maven.org/maven2/org/elasticsearch/elasticsearch-spark-13_2.10/

For Scala 2.11 you can find the available versions and artifact names here:
http://repo1.maven.org/maven2/org/elasticsearch/elasticsearch-spark-13_2.11/

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.