Unsupported/Unknown Elasticsearch version 2.1.1


#1

Hello

I am trying to integrate ElsticSearch with Hive for the first time (a plain Apache Hadoop).
I am able to create an external table in Hive stored by org.elasticsearch.hadoop.hive.EsStorageHandler so I guess the AUX_JAR_PATH is properly configured.
However, when I try to load data into the table I get exceptions.

The full error stack is not that interesting, but the error says:
org.elasticsearch.hadoop.EsHadoopIllegalArgumentException(Unsupported/Unknown Elasticsearch version 2.1.1)

My Elasticsearch version is 2.1.1 and the ES-Hadoop integration jar is 2.1.2 (both are latest stable version).

What am I doing wrong ? How can I make it work ?

Thanks

Guy


#2

Hello,

It's simply because ES-Hadoop v2.1.2 only supports ES until v1.7.x
You need to use ES-Hadoop v2.2.0-rc1.


(Costin Leau) #3

From the project readme:

Elasticsearch (1.x or higher (2.x highly recommended)) cluster accessible through REST.
That's it!
Significant effort has been invested to create a small, dependency-free,
self-contained jar that can be downloaded and put to use without any
dependencies. Simply make it available to your job classpath and you're
set.
For a certain library, see the dedicated chapter.

ES-Hadoop 2.0.x and 2.1.x are compatible with Elasticsearch 1.X only

ES-Hadoop 2.2.x and higher are compatible with Elasticsearch 1.X and 2.X


#4

Thank you very much, I missed that point...


(system) #5