Elasticsearch spark runtime dependencies

[krezno]

Hello,

I have sucessfuly managed to use elasticsearch-spark with both pyspark and scala spark by simply adding the jar to the classpath. I have noticed that the jar has some runtime dependencies such as protobuf-java and jaxb-api. I am afraid that because I am not explicitly adding these dependencies that something subtle might break and cause unexpected results.

My question is whether it is safe to simply use the jar with elasticsearch spark without adding additional jars or are there side effects to consider? What do these dependencies add to the library? thanks

[Keith_Massey]

Hi @krezno. I have not double-checked, but I believe that your spark classpath will already be pulling in those dependencies. Is that not the case? I have never had to explicitly add them.