I recently upgraded the Elasticsearch from 5.5.1 to using ElasticSearch 6.2.3
I get the following error during execution in apache-spark 2.2.1
Exception in thread "main" java.lang.NoClassDefFoundError: org/elasticsearch/common/logging/Loggers
at org.elasticsearch.common.unit.ByteSizeValue.(ByteSizeValue.java:36)
at org.elasticsearch.common.network.NetworkService.(NetworkService.java:56)
at org.elasticsearch.transport.TcpTransport.(TcpTransport.java:151)
at org.elasticsearch.client.transport.TransportClient.newPluginService(TransportClient.java:100)
at org.elasticsearch.client.transport.TransportClient.buildTemplate(TransportClient.java:130)
at org.elasticsearch.client.transport.TransportClient.(TransportClient.java:273)
at org.elasticsearch.transport.client.PreBuiltTransportClient.(PreBuiltTransportClient.java:128)
It appears that package org.elasticsearch.common.logging; in 6.2.3. is missing the Loggers.class and many others.
Here are the logging dependencies for compiling my application using Elasticsearch 6.2.3 in sbt
"org.apache.logging.log4j" % "log4j-api" % "2.9.1",
"org.apache.logging.log4j" % "log4j-core" % "2.9.1"
"org.elasticsearch" % "elasticsearch" % "6.2.3",
"org.elasticsearch.client" % "transport" % "6.2.3"
Any ideas on how to fix this issue? Thanks in advance.