Hi,
I am working in databricks and had this working and now it stopped without any changes to my code.
I am connecting to Elastic with the es-hadoop client via pyspark. Here are my settings
.format("org.elasticsearch.spark.sql") \
.option("es.resource",esindex) \
.option("es.port", 9200) \
.option("es.nodes", datanode) \
.option("es.net.ssl","true") \
.option("es.nodes.wan.only", "true") \
.option("es.net.ssl.certificate_authorities", "/dbfs/FileStore/tables/trustedroot.crt") \
.option("es.net.ssl.supported_protocols", "TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384") \
.option("es.net.ssl.verification_mode", "false") \
.option("es.net.ssl.certtp.allow.self.signed", "true") \
.option("es.net.http.auth.user", username) \
.option("es.net.http.auth.pass", password) \
.option("es.spark.dataframe.write.null", "true")
and I am now getting this error in the elastic logs. and getting this error on the client side.
Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
Any help is appreciated