# ERROR: Multiple ES-Hadoop versions detected

**URL:** https://discuss.elastic.co/t/error-multiple-es-hadoop-versions-detected/59220
**Category:** Elasticsearch
**Tags:** es-hadoop
**Created:** [August 29, 2016, 5:18pm UTC](https://discuss.elastic.co/t/error-multiple-es-hadoop-versions-detected/59220 "2016-08-29T17:18:55Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![OmarBarac](https://avatars.discourse-cdn.com/v4/letter/o/dec6dc/32.png) [@OmarBarac](https://discuss.elastic.co/u/OmarBarac)
#### Post date: [August 29, 2016, 5:18pm UTC](https://discuss.elastic.co/t/error-multiple-es-hadoop-versions-detected/59220/1 "2016-08-29T17:18:55Z")

</div>

Hi,  
We are using Hadoop with elasticsearch on a cluster of 5 nodes and we are using : CDH 5.8.0, eastic search 2.3.5 and elasticsearch-hadoop-2.3.4.

We created a table on elastic search using hive and it worked and we are trying to load the data from hive :  
INSERT overwrite TABLE cdr\_es SELECT ....  
FROM cdr\_link

But we have the following error :

Diagnostic Messages for this Task:  
Error: java.lang.RuntimeException: java.lang.Error: Multiple ES-Hadoop versions detected in the classpath; please use only one  
jar:file:/data/yarn/nm/usercache/cloudera-scm/filecache/938/elasticsearch-hadoop-cascading-2.3.4.jar  
jar:file:/data/yarn/nm/usercache/cloudera-scm/filecache/955/elasticsearch-hadoop-hive-2.3.4.jar  
jar:file:/data/yarn/nm/usercache/cloudera-scm/filecache/931/elasticsearch-storm-2.3.4.jar  
jar:file:/data/yarn/nm/usercache/cloudera-scm/filecache/940/elasticsearch-hadoop-mr-2.3.4.jar  
jar:file:/data/yarn/nm/usercache/cloudera-scm/filecache/926/elasticsearch-spark\_2.11-2.3.4.jar  
jar:file:/data/yarn/nm/usercache/cloudera-scm/filecache/937/elasticsearch-spark-1.2\_2.10-2.3.4.jar  
jar:file:/data/yarn/nm/usercache/cloudera-scm/filecache/929/elasticsearch-spark-1.2\_2.11-2.3.4.jar  
jar:file:/data/yarn/nm/usercache/cloudera-scm/filecache/950/elasticsearch-hadoop-pig-2.3.4.jar  
jar:file:/data/yarn/nm/usercache/cloudera-scm/filecache/959/elasticsearch-spark\_2.10-2.3.4.jar  
jar:file:/data/yarn/nm/usercache/cloudera-scm/filecache/943/elasticsearch-hadoop-2.3.4.jar

```
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:179)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

```

Caused by: java.lang.Error: Multiple ES-Hadoop versions detected in the classpath; please use only one

If we delete one of the jars (elasticsearch-hadoop-hive-2.3.4 or elasticsearch-hadoop-cascading-2.3.4.jar or elasticsearch-hadoop-2.3.4.jar) than we will have an error with a missing package.

How can we solve the problem ?  
Thanks

---

<div class="post-metadata">

### Author: ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)
#### Post date: [August 29, 2016, 8:35pm UTC](https://discuss.elastic.co/t/error-multiple-es-hadoop-versions-detected/59220/2 "2016-08-29T20:35:43Z")

</div>

You seem to be using all of the jars when you should be using only one. We provide the full package of features in one jar (elasticsearch-hadoop-2.3.4.jar), but we also provide dedicated jars for each technology should users desire to use them in a standalone fashion. Keep the elasticsearch-hadoop-2.3.4.jar and remove the others.

---

<div class="post-metadata">

### Author: ![OmarBarac](https://avatars.discourse-cdn.com/v4/letter/o/dec6dc/32.png) [@OmarBarac](https://discuss.elastic.co/u/OmarBarac)
#### Post date: [August 30, 2016, 7:22am UTC](https://discuss.elastic.co/t/error-multiple-es-hadoop-versions-detected/59220/3 "2016-08-30T07:22:32Z")

</div>

Hi James,  
Thanks for the answer.  
If we leave only the jar that we need (elasticsearch-hadoop-2.3.4.jar) then we will have another errors "File file:/usr/lib/elasticsearch-hadoop-2.3.4/dist/elasticsearch-hadoop-cascading-2.3.4.jar does not exist"

2016-08-30 08:20:54,773 ERROR org.apache.hadoop.hive.ql.exec.Task: [HiveServer2-Background-Pool: Thread-1040]: Job Submission failed with exception 'java.io.FileNotFoundException(File file:/usr/lib/elasticsearch-hadoop-2.3.4/dist/elasticsearch-hadoop-cascading-2.3.4.jar does not exist)'  
java.io.FileNotFoundException: File file:/usr/lib/elasticsearch-hadoop-2.3.4/dist/elasticsearch-hadoop-cascading-2.3.4.jar does not exist

If we have all the libraries then the map works perfectly but we have the "Multiple ES-Hadoop versions detected" error when starting to reduce.

How can we solve that ?

Thanks

---

<div class="post-metadata">

### Author: ![OmarBarac](https://avatars.discourse-cdn.com/v4/letter/o/dec6dc/32.png) [@OmarBarac](https://discuss.elastic.co/u/OmarBarac)
#### Post date: [September 1, 2016, 8:26am UTC](https://discuss.elastic.co/t/error-multiple-es-hadoop-versions-detected/59220/4 "2016-09-01T08:26:48Z")

</div>

We used elasticsearch-hadoop-2.3.3.jar and it worked without problems.

I guess that there is a problem with the 2.3.4

Thank you

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 1:23pm UTC](https://discuss.elastic.co/t/error-multiple-es-hadoop-versions-detected/59220/5 "2017-07-06T13:23:28Z")

</div>


