ES-hadoop 5.0.0 alpha release? and Hive 1.x support


(no jihun) #1

Hi all.

I just wonder Elastcsearch-hadoop will be released of 5.0.0-alpha1 or not in a soon.

Because I am on a work with ES 5.0.alpha1 and encounter " Unsupported/Unknown Elasticsearch version 5.0.0-alpha1"

	at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:246)
	... 27 more
Caused by: org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Unsupported/Unknown Elasticsearch version 5.0.0-alpha1
	at org.elasticsearch.hadoop.rest.InitializationUtils.discoverEsVersion(InitializationUtils.java:185)
	... 32 more
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1459773554571_0739_1_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]
ERROR : DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0

And..
Will ES-hadoop 5.x support hive 1.x even ES-hadoop bumped hive version to 2.0?

thank you!


(Costin Leau) #2

Master supports ES 5.0.0.alpha1 and the ETA is likely next week.
Hive 2.0 requires some additional testing and might not make the release next week.


(system) #3