# Elasticsearch hadpop error :java.lang.NoClassDefFoundError: Could not initialize class org.elasticsearch.spark.serialization.ScalaMetadataExtractor

**URL:** <https://discuss.elastic.co/t/elasticsearch-hadpop-error-java-lang-noclassdeffounderror-could-not-initialize-class-org-elasticsearch-spark-serialization-scalametadataextractor/256136>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [November 20, 2020, 3:00pm UTC](https://discuss.elastic.co/t/elasticsearch-hadpop-error-java-lang-noclassdeffounderror-could-not-initialize-class-org-elasticsearch-spark-serialization-scalametadataextractor/256136 "2020-11-20T15:00:52Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Vishnu\_Singhal](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vishnu_singhal/32/52488_2.png) [@Vishnu\_Singhal](https://discuss.elastic.co/u/Vishnu_Singhal)\
**Post date:** [November 20, 2020, 3:00pm UTC](https://discuss.elastic.co/t/elasticsearch-hadpop-error-java-lang-noclassdeffounderror-could-not-initialize-class-org-elasticsearch-spark-serialization-scalametadataextractor/256136/1 "2020-11-20T15:00:52Z")

</div>

Receiving following error after upgrading to spark 3.0.0 with any of the version of elasticsearch-hadoop jar

```auto
  <dependency>
            <groupId>org.elasticsearch</groupId>
            <artifactId>elasticsearch-hadoop</artifactId>
            <version>${elastic.version}</version>
            <scope>compile</scope>
        </dependency>

```

tried elastic.version with 7.1.1 , 7.4.0,7.5.0 , 7.10.0

```auto
2020-11-20 14:54:25 INFO DAGScheduler:57 - ResultStage 89 (runJob at EsSpark.scala:108) failed in 0.102 s due to Job aborted due to stage failure: Task 1 in stage 89.0 failed 4 times, most recent failure: Lost task 1.3 in stage 89.0 (TID 517, 10.4.6.202, executor 2): java.lang.NoClassDefFoundError: Could not initialize class org.elasticsearch.spark.serialization.ScalaMetadataExtractor$
        at org.elasticsearch.spark.serialization.ScalaMetadataExtractor.getValue(ScalaMetadataExtractor.scala:32)
        at org.elasticsearch.hadoop.serialization.bulk.PerEntityPoolingMetadataExtractor.get(PerEntityPoolingMetadataExtractor.java:97)
        at org.elasticsearch.hadoop.serialization.bulk.AbstractBulkFactory.getMetadataExtractorOrFallback(AbstractBulkFactory.java:493)
        at org.elasticsearch.hadoop.serialization.bulk.AbstractBulkFactory.writeObjectHeader(AbstractBulkFactory.java:404)
        at org.elasticsearch.hadoop.serialization.bulk.AbstractBulkFactory$DynamicHeaderRef.getDynamicContent(AbstractBulkFactory.java:177)
        at org.elasticsearch.hadoop.serialization.bulk.TemplatedBulk.writeTemplate(TemplatedBulk.java:84)
        at org.elasticsearch.hadoop.serialization.bulk.TemplatedBulk.write(TemplatedBulk.java:56)
        at org.elasticsearch.hadoop.serialization.bulk.BulkEntryWriter.writeBulkEntry(BulkEntryWriter.java:68)
        at org.elasticsearch.hadoop.rest.RestRepository.writeToIndex(RestRepository.java:170)
        at org.elasticsearch.spark.rdd.EsRDDWriter.write(EsRDDWriter.scala:74)
        at org.elasticsearch.spark.rdd.EsSpark$$anonfun$doSaveToEs$1.apply(EsSpark.scala:108)
        at org.elasticsearch.spark.rdd.EsSpark$$anonfun$doSaveToEs$1.apply(EsSpark.scala:108)
        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
        at org.apache.spark.scheduler.Task.run(Task.scala:127)
        at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:444)
        at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1377)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:447)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 18, 2020, 3:01pm UTC](https://discuss.elastic.co/t/elasticsearch-hadpop-error-java-lang-noclassdeffounderror-could-not-initialize-class-org-elasticsearch-spark-serialization-scalametadataextractor/256136/2 "2020-12-18T15:01:03Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.