I tried to connect my Spark code with Elastic Cloud without success. Following this post https://www.elastic.co/guide/en/cloud/current/shield.html, I have a configuration as follow:
- Im using Spark 1.6.0, trial version of Elastic Cloud - Elasticsearch 2.2.0, es-hadoop connector elasticsearch-spark_2.10-2.2.0-rc1 => with this setup I can connect to AWS Elasticsearch cluster ( without authentication).
- Here is the error with above configuration:
org.elasticsearch.hadoop.EsHadoopIllegalStateException: Cannot instantiate SSL
- Here is the error without SSL enable:
org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException: Connection error (check network and/or proxy settings)- all nodes failed; tried [[126.96.36.199:9343]]
- I have tried with different port: 9200, 9243, 9343, 80, 443 with and without SSL enable but cannot connect. Could you please point out the configuration to connect from Spark to Elastic Cloud with Shield. Any help is appreciate !!