Elasticsearch support for spark 2.4.2 with scala 2.12

Elastic Stack Elasticsearch
1

I'm not able to find any ES 6.7.1 supporting jar for spark 2.4.2 with scala 2.12
In maven repo only scala 2.11 and 2.10 is supported for the jar

<dependency>
    <groupId>org.elasticsearch</groupId>
    <artifactId>elasticsearch-spark-20_2.11</artifactId>
    <version>6.7.1</version>
</dependency>

For my application we are using spark 2.4.2 which supports only scala 2.12 version.

Following is the error shown when I try to run with "elasticsearch-spark-20_2.11" jar

image
image.png1366×366 17.4 KB

Is there any alternative to resolve this situation as downgrade is not an option?
o

2

There is an open issue to increase the Spark support to cover these versions. Unfortunately, until the testing is completed for the process, there is no support for Scala 2.12.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.