# Es-hadoop-5.0+ doesn't support es2.x.x

**URL:** <https://discuss.elastic.co/t/es-hadoop-5-0-doesnt-support-es2-x-x/69406>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [December 19, 2016, 8:30am UTC](https://discuss.elastic.co/t/es-hadoop-5-0-doesnt-support-es2-x-x/69406 "2016-12-19T08:30:19Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![1222kkk](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/1222kkk/32/23635_2.png) [@1222kkk](https://discuss.elastic.co/u/1222kkk)\
**Post date:** [December 19, 2016, 8:30am UTC](https://discuss.elastic.co/t/es-hadoop-5-0-doesnt-support-es2-x-x/69406/1 "2016-12-19T08:30:19Z")

</div>

my version is  
spark :2.0.2  
elasticsearch : 2.3.2

I found es-hadoop-5.0+ support spark 2.0+ with es 5.0

Does it support spark 2.0+ with es2.x.x ?

---

<div class="post-metadata">

**Author:** ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)\
**Post date:** [December 19, 2016, 3:58pm UTC](https://discuss.elastic.co/t/es-hadoop-5-0-doesnt-support-es2-x-x/69406/2 "2016-12-19T15:58:03Z")

</div>

ES-Hadoop 5.1 supports Spark 1.3-2.0 and Elasticsearch 1.x to 5.1. If you are having issues with the framework please post a stack trace and a description of the problem you're running into.

---

<div class="post-metadata">

**Author:** ![1222kkk](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/1222kkk/32/23635_2.png) [@1222kkk](https://discuss.elastic.co/u/1222kkk)\
**Post date:** [December 20, 2016, 1:43am UTC](https://discuss.elastic.co/t/es-hadoop-5-0-doesnt-support-es2-x-x/69406/3 "2016-12-20T01:43:33Z")

</div>

```
Exception in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID 5, 192.168.1.90): java.lang.NoSuchMethodError: org.apache.spark.TaskContext.addOnCompleteCallback(Lscala/Function0;)V
	at org.elasticsearch.spark.rdd.EsRDDWriter.write(EsRDDWriter.scala:42)
	at org.elasticsearch.spark.rdd.EsSpark$$anonfun$doSaveToEs$1.apply(EsSpark.scala:84)
	at org.elasticsearch.spark.rdd.EsSpark$$anonfun$doSaveToEs$1.apply(EsSpark.scala:84)
	at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)
	at org.apache.spark.scheduler.Task.run(Task.scala:86)
	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

```

the error is the above, I have tip in the es-hadoop github.

I guess es 2.3.2 work with spark 2.0.2 is deprecated by es-hadoop because I found elasticsearch-spark-20\_2.11-5.1.1.jar still not supports this.

@james.baiera

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [January 17, 2017, 1:44am UTC](https://discuss.elastic.co/t/es-hadoop-5-0-doesnt-support-es2-x-x/69406/4 "2017-01-17T01:44:20Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.