Can you please confirm the following 2 questions
- see that from Spark Packages link
https://spark-packages.org/package/elastic/elasticsearch-hadoop that anything above 5.0.0-Alpha4 release provides only Scala 2.11 versions and does not have jars compiled for Scala 2.10 versions, Are there any specific dependancy on Scala 2.11 which forces this change? If not can we also generate Scala 2.10 version and upload them to Spark Packages so that it benefits users like us.
Currently we are in Spark 1.6.2, Scala 2.10 and ES 5.1.1. I am not able to use Elasticsearch Spark Connector. While we were trying out Alpha release, I was able to at least use 5.0.0.-Alpha4 connector which was with Scala 2.10. But I am not able to use them now given the fact that we do a check for version starting with 5.0 with InitializationUtils.java in org.elasticsearch.hadoop.rest in 5.0.0-Alpha4 which is preventing it to work from 5.1.1.
Please let me know what is the alternative
- Also please confirm if latest release of connectors will also support Spark 1.6.2.