ServiceConfigurationError: org.apache.spark.sql.sources.DataSourceRegister: Provider org.elasticsearch.spark.sql.DefaultSource15 could not be instantiated

Elastic Stack Elasticsearch
1

I am trying to index using spark on Amazon EMR cluster. I am facing this issue on the cluster.

pom.xml for Elastic

org.elasticsearch
elasticsearch
6.4.3


org.slf4j
slf4j-log4j12


log4j
log4j


    <dependency>
        <groupId>org.elasticsearch</groupId>
        <artifactId>elasticsearch-spark-20_2.11</artifactId>
        <version>7.6.0</version>
        <exclusions>
            <exclusion>
                <groupId>org.slf4j</groupId>
                <artifactId>slf4j-log4j12</artifactId>
            </exclusion>
            <exclusion>
                <groupId>log4j</groupId>
                <artifactId>log4j</artifactId>
            </exclusion>
        </exclusions>
    </dependency>
org.apache.spark spark-core_2.11 2.4.4 org.slf4j slf4j-log4j12 log4j log4j org.apache.spark spark-sql_2.11 2.4.4 org.slf4j slf4j-log4j12 log4j log4j 
    </dependency>
2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.