# Getting Error on sc.esRDD on Scala11 version of Spark **URL:** \ **Category:** Elasticsearch\ **Tags:** es-hadoop\ **Created:** [July 4, 2015, 9:35am UTC](https://discuss.elastic.co/t/getting-error-on-sc-esrdd-on-scala11-version-of-spark/24892 "2015-07-04T09:35:58Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![deepakas](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/deepakas/32/697_2.png) [@deepakas](https://discuss.elastic.co/u/deepakas)\ **Post date:** [July 4, 2015, 9:35am UTC](https://discuss.elastic.co/t/getting-error-on-sc-esrdd-on-scala11-version-of-spark/24892/1 "2015-07-04T09:35:58Z")
I am getting error while using es-hadoop with spark on scala11. It works with the spark-shell binaries I have with scala10 This line generates the error. val esRDD = sc.esRDD("realtimeanalytics/events") This works finaloutput.toJSON.saveJsonToEs("realtimeanalytics/events") Any inputs will be appreciated. This is the error I am getting while calling sc.esRDD. -- 15/07/04 10:07:08 ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0) java.lang.NoClassDefFoundError: scala/collection/GenTraversableOnce$class at org.elasticsearch.spark.rdd.AbstractEsRDDIterator.(AbstractEsRDDIterator.scala:13) at org.elasticsearch.spark.rdd.ScalaEsRDDIterator.(ScalaEsRDD.scala:25) at org.elasticsearch.spark.rdd.ScalaEsRDD.compute(ScalaEsRDD.scala:21) at org.elasticsearch.spark.rdd.ScalaEsRDD.compute(ScalaEsRDD.scala:15) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277) at org.apache.spark.rdd.RDD.iterator(RDD.scala:244) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61) at org.apache.spark.scheduler.Task.run(Task.scala:64) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.ClassNotFoundException: scala.collection.GenTraversableOnce$class at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ... 12 more 15/07/04 10:07:08 ERROR SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[Executor task launch worker-0,5,main] java.lang.NoClassDefFoundError: scala/collection/GenTraversableOnce$class at org.elasticsearch.spark.rdd.AbstractEsRDDIterator.(AbstractEsRDDIterator.scala:13) at org.elasticsearch.spark.rdd.ScalaEsRDDIterator.(ScalaEsRDD.scala:25) at org.elasticsearch.spark.rdd.ScalaEsRDD.compute(ScalaEsRDD.scala:21) at org.elasticsearch.spark.rdd.ScalaEsRDD.compute(ScalaEsRDD.scala:15) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277) at org.apache.spark.rdd.RDD.iterator(RDD.scala:244) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61) at org.apache.spark.scheduler.Task.run(Task.scala:64) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.ClassNotFoundException: scala.collection.GenTraversableOnce$class at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ... 12 more 15/07/04 10:07:08 WARN TaskSetManager: Lost task 0.0 in stage 0.0 (TID 0, localhost): java.lang.NoClassDefFoundError: scala/collection/GenTraversableOnce$class at org.elasticsearch.spark.rdd.AbstractEsRDDIterator.(AbstractEsRDDIterator.scala:13) at org.elasticsearch.spark.rdd.ScalaEsRDDIterator.(ScalaEsRDD.scala:25) at org.elasticsearch.spark.rdd.ScalaEsRDD.compute(ScalaEsRDD.scala:21) at org.elasticsearch.spark.rdd.ScalaEsRDD.compute(ScalaEsRDD.scala:15) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277) at org.apache.spark.rdd.RDD.iterator(RDD.scala:244) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61) at org.apache.spark.scheduler.Task.run(Task.scala:64) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.ClassNotFoundException: scala.collection.GenTraversableOnce$class at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ... 12 more ---
**Author:** ![deepakas](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/deepakas/32/697_2.png) [@deepakas](https://discuss.elastic.co/u/deepakas)\ **Post date:** [July 4, 2015, 9:55am UTC](https://discuss.elastic.co/t/getting-error-on-sc-esrdd-on-scala11-version-of-spark/24892/2 "2015-07-04T09:55:28Z")
It worked when I added the scala 2.10 dependency to the project.. org.scala-lang scala-library 2.10.1 ---
**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\ **Post date:** [July 14, 2015, 7:42am UTC](https://discuss.elastic.co/t/getting-error-on-sc-esrdd-on-scala11-version-of-spark/24892/3 "2015-07-14T07:42:23Z")
Scala 2.10 is not compatible with Scala 2.11 - make sure you use the proper es-spark artifact by specifying the proper Scala [suffix](https://www.elastic.co/guide/en/elasticsearch/hadoop/current/install.html) ---
**Author:** ![SaurabhM](https://avatars.discourse-cdn.com/v4/letter/s/8c91f0/32.png) [@SaurabhM](https://discuss.elastic.co/u/SaurabhM)\ **Post date:** [July 21, 2016, 7:28am UTC](https://discuss.elastic.co/t/getting-error-on-sc-esrdd-on-scala11-version-of-spark/24892/4 "2016-07-21T07:28:54Z")
> [@costin](#): > > es-spark I dont see any specific built for scala 2.11 [https://mvnrepository.com/artifact/org.elasticsearch/elasticsearch-hadoop](https://mvnrepository.com/artifact/org.elasticsearch/elasticsearch-hadoop) Getting exception java.lang.NoClassDefFoundError: scala/collection/GenTraversableOnce$class ---
**Author:** ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)\ **Post date:** [July 22, 2016, 8:08pm UTC](https://discuss.elastic.co/t/getting-error-on-sc-esrdd-on-scala11-version-of-spark/24892/5 "2016-07-22T20:08:59Z")
We release two scala artifacts: one for 2.10 and one for 2.11. Please note the suffix of the artifact name here: [https://mvnrepository.com/artifact/org.elasticsearch/elasticsearch-spark\_2.11](https://mvnrepository.com/artifact/org.elasticsearch/elasticsearch-spark_2.11) ---
**Author:** ![SaurabhM](https://avatars.discourse-cdn.com/v4/letter/s/8c91f0/32.png) [@SaurabhM](https://discuss.elastic.co/u/SaurabhM)\ **Post date:** [July 23, 2016, 1:20am UTC](https://discuss.elastic.co/t/getting-error-on-sc-esrdd-on-scala11-version-of-spark/24892/6 "2016-07-23T01:20:47Z")
Even I used that library still getting the same error Fyi- we are using spark1.6.1 custom built using 2.11 ---
**Author:** ![pervoliner](https://avatars.discourse-cdn.com/v4/letter/p/919ad9/32.png) [@pervoliner](https://discuss.elastic.co/u/pervoliner)\ **Post date:** [October 13, 2016, 5:08pm UTC](https://discuss.elastic.co/t/getting-error-on-sc-esrdd-on-scala11-version-of-spark/24892/7 "2016-10-13T17:08:42Z")
I think I have found a solution. at least it works for me. I have replaced file SPARK\_HOME/jars/elasticsearch-hadoop-2.4.0.jar with elasticsearch-spark\_2.11-2.4.0.jar which I got here [https://mvnrepository.com/artifact/org.elasticsearch/elasticsearch-spark\_2.11](https://mvnrepository.com/artifact/org.elasticsearch/elasticsearch-spark_2.11) ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:22pm UTC](https://discuss.elastic.co/t/getting-error-on-sc-esrdd-on-scala11-version-of-spark/24892/8 "2017-07-06T13:22:56Z")