Scala version for elasticsearch-hadoop for 5.0.0-alpha4?


(Yu Watanabe) #1

Hi !

I appreciate someone can help me out with the issue I am having.

Problem
I am having version confilict errors when I do spark-submit.

16/07/13 05:00:25 INFO BlockManagerMaster: Registered BlockManager
Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
        at org.elasticsearch.spark.rdd.EsSpark$.esRDD(EsSpark.scala:29)
        at org.elasticsearch.spark.package$SparkContextFunctions.esRDD(package.scala:21)
        at ElasticConn$.main(ElasticConn.scala:17)
        at ElasticConn.main(ElasticConn.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
        at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

My environment
Spark 1.6.2
Scala 2.10.6
elasticsearch 5.0.0-alpha4

Question
I read the readme on github but could not find the version of scala that is used .

Could someone teach where can I find scala version which is used to compile elasticsearch-hadoop library?


(Yu Watanabe) #2

I appreciate if someone could update this issue.


(system) #3