ES-Hadoop compatibility with Spark 2.4.4

Elastic Stack Elasticsearch
1

Hello,
We have an EMR v5.28 cluster that comes with Spark 2.4.4. Our understanding is that Elasticsearch-Hadoop is not compatible with Spark 2.4.4 since Spark is compiled with Scala 2.12, and ES-Hadoop requires Scala 2.11. Is that correct? If so, are there any recommendations how we can overcome this pitfall?

Thanks.

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.