Java Transport Client 5.4.1 NullPointerException

Elastic Stack Elasticsearch
1

Hello,

I am trying to upgrade my service from Elasticsearch 1.4 to Elasticsearch 5.4.1. It run without issues on Centos 6.8, but after the upgrade I am getting the following error:

Exception in thread "main" java.lang.ExceptionInInitializerError
at org.elasticsearch.common.logging.DeprecationLogger.(DeprecationLogger.java:138)
at org.elasticsearch.common.xcontent.support.AbstractXContentParser.(AbstractXContentParser.java:57)
at org.elasticsearch.common.xcontent.json.JsonXContentParser.(JsonXContentParser.java:44)
at org.elasticsearch.common.xcontent.json.JsonXContent.createParser(JsonXContent.java:103)
at org.elasticsearch.common.settings.Setting.parseableStringToList(Setting.java:848)
at org.elasticsearch.common.settings.Setting.lambda$listSetting$27(Setting.java:802)
at org.elasticsearch.common.settings.Setting.listSetting(Setting.java:807)
at org.elasticsearch.common.settings.Setting.listSetting(Setting.java:802)
at org.elasticsearch.common.network.NetworkService.(NetworkService.java:50)
at org.elasticsearch.client.transport.TransportClient.newPluginService(TransportClient.java:98)
at org.elasticsearch.client.transport.TransportClient.buildTemplate(TransportClient.java:126)
at org.elasticsearch.client.transport.TransportClient.(TransportClient.java:268)
at org.elasticsearch.transport.client.PreBuiltTransportClient.(PreBuiltTransportClient.java:127)
at org.elasticsearch.transport.client.PreBuiltTransportClient.(PreBuiltTransportClient.java:113)
at org.elasticsearch.transport.client.PreBuiltTransportClient.(PreBuiltTransportClient.java:103)
...
Caused by: java.lang.NullPointerException
at org.elasticsearch.Build.(Build.java:51)
... 24 more

What could be the cause of this problem?

Thanks,

Agnieszka

1 Like
2

Never saw that. It sounds like the manifest file is not there.
My guess is that you still have an old elasticsearch jar somewhere in your class path.

3

My class path has elasticsearch-5.4.1.jar and transport-5.4.1.jar and I do have a manifest file present.

4

There has been a thread about this issue already, but apparently it has been resolved: ES 5.3 and Java-API 5.3.0 > java.lang.NullPointerException? in Elasticsearch 5.3. However, I am still seeing that issue the the latest version (5.4.1 and 5.4.0).

5

@jasontedor WDYT?

6

To complement the information on this issue, we found that:

Returns a JarInputStream with man = null (and most of the other properties are null) possibly because is not being able to read the MANIFEST file.

To verify that there was a Manifest file we manually uncompress the elasticsearch-5.4.1.jar file and the file seems to be correct.

Any ideas what can cause this behaviour?

If it helps:
OS: Centos 6.8
openjdk version "1.8.0_121"
OpenJDK Runtime Environment (build 1.8.0_121-b13)
OpenJDK 64-Bit Server VM (build 25.121-b13, mixed mode)

7

How are you starting elasticsearch?

8

We are starting the elasticsearch with the following config:

cluster.name: "elasticsearch"
node.master: true
node.data: true
path.data: /var/log/elasticsearch/
path.logs: /var/log/elasticsearch/
node.name: "test"

The command is:
/usr/share/elasticsearch/bin/elasticsearch -Epath.conf=/etc/elasticsearch/elasticsearch.yml

9

How are you starting the transport client, what is it hosted inside of?

10

Hi jasontedor, here is a snippet:

 val s = Settings.builder()
    .put("cluster.name", clusterName)
    .build()

  val client = new PreBuiltTransportClient(s)
  nodes.asScala.foreach { node =>
    client.addTransportAddress(new InetSocketTransportAddress(node))
  }

The exception occurs on the instantiation of the PreBuiltTransportClient

We found that our elasticsearch-5.4.1.jar has a different sha1 hash from the one published on maven central.

We are investigating this issue, but I believe this is the reason why it cannot read the manifest file.

11

That would indeed be a problem.

12

Has this been fixed?

13

@billnbell Is what fixed? The issue reported here for this user was caused by them not using an official distribution.

14

@jasontedor we are using the official distribution of Elasticsearch.
After more investigation we found that the issue was in our CI system at build time when it create rpms for our Scala services.

Apparently there is some jar repackaging happening on Centos that changes the sha1 sums of the jar files and in the case of elasticsearch-5.4.1.jar when you try to instantiate a PreBuiltTransportClient it does some validation using the MANIFEST file and this was failing because of the different sha1sum.

To fix this we had to explicit remove the repackaging in the spec files generated by sbt and maven.

For sbt (Build.sbt):

import com.typesafe.sbt.packager.rpm.RpmPlugin.Names
val script =
  """%define __os_install_post \
%{_rpmconfigdir}/brp-compress \
%{!?__debug_package:%{_rpmconfigdir}/brp-strip %{__strip}} \
%{_rpmconfigdir}/brp-strip-static-archive %{__strip} \
%{_rpmconfigdir}/brp-strip-comment-note %{__strip} %{__objdump} \
%{nil}
"""
...


maintainerScripts in Rpm += (Names.Pre -> ((maintainerScripts in Rpm).value.getOrElse(Names.Pre, Nil) :+ script))

For maven (inside the rpm-maven-plugin configuration node) :

                            <defineStatements>
                                <defineStatement>_unpackaged_files_terminate_build 0</defineStatement>
                                <defineStatement>__os_install_post \
%{_rpmconfigdir}/brp-compress \
%{!?__debug_package:%{_rpmconfigdir}/brp-strip %{__strip}} \
%{_rpmconfigdir}/brp-strip-static-archive %{__strip} \
%{_rpmconfigdir}/brp-strip-comment-note %{__strip} %{__objdump} \
%{nil}
                                </defineStatement>
</defineStatements>
15

I'm glad you've found the issue. I want to be clear about something for others that are following this thread. A repackaged distribution is not an official distribution, and we do not support repackaged distributions.

1 Like
16

Thanks the help and clarification @jasontedor! :slight_smile:

17

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.