[2021-08-18T14:40:31,056][WARhttp client did not trust this server's certificate, closing connection Netty4HttpChannel

[mlo (Mark Lopez)]

Hi,

I am working in databricks and had this working and now it stopped without any changes to my code.

I am connecting to Elastic with the es-hadoop client via pyspark. Here are my settings

.format("org.elasticsearch.spark.sql") \
        .option("es.resource",esindex) \
        .option("es.port", 9200) \
        .option("es.nodes", datanode) \
        .option("es.net.ssl","true") \
        .option("es.nodes.wan.only", "true") \
        .option("es.net.ssl.certificate_authorities", "/dbfs/FileStore/tables/trustedroot.crt") \
        .option("es.net.ssl.supported_protocols", "TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384") \
        .option("es.net.ssl.verification_mode", "false") \
        .option("es.net.ssl.certtp.allow.self.signed", "true") \
        .option("es.net.http.auth.user", username) \
        .option("es.net.http.auth.pass", password) \
        .option("es.spark.dataframe.write.null", "true")

and I am now getting this error in the elastic logs. and getting this error on the client side.
Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

Any help is appreciated