Error while loading RDDOperationScope, Missing dependency 'bad symbolic reference

My POM has

  • org.apache.spark.spark-core_2.10.1.5.1
  • org.elasticsearchsearch.elasticsearch-spark_2.10.2.1.0.Beta1
  • org.scalatest.scalatest_2.10.2.2.3

If I try to use anything higher than elasticsearch-spark_2.10.2.1.0.Beta1, I get the error in the below.

What are the right dependencies if I want to run:

  • Apache Spark 1.5.1
  • Elasticsearch 1.7.0
  • on JDK 1.8.66

Thanks,
Q

error while loading RDDOperationScope, Missing dependency 'bad symbolic reference. A signature in RDDOperationScope.class refers to term annotation

Likely at runtime you are using a mixture of Scala 2.11 and libraries compiled for Scala 2.10. Double check that indeed, all the jars are compiled for the same scala version (note that ES-Spark comes with binaries for both 2.10 and 2.11).