Es5 couldn't start due to the missing license plugin

Elastic Stack Elasticsearch
1

Hi,

After upgrading es to 5.0, I couldn't launch it. I checked the log, and it initially says the plugin license is incompatible. I removed the license.

Now I couldn't install the latest license to es 5.0. I searched around and couldn't find any license plugins.

Anyone knows how to install the latest license plugin?

thanks

2

All of those plugins are now part of a plugin called x-pack.

3

Thank you so much Nik!

I added x-pack via elasticsearch-plugin. Now I have the following error indicating something wrong with the bootstrap. I also commented out the bootstrap.mlockall settings in elasticsearch.yml,but still got the same error. Any idea?

[2016-11-01T15:09:10,587][ERROR][o.e.b.Bootstrap ] Exception
java.lang.IllegalArgumentException: unknown setting [bootstrap.mlockall] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:271) ~[elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:239) ~[elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.common.settings.SettingsModule.(SettingsModule.java:138) ~[elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.node.Node.(Node.java:311) ~[elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.node.Node.(Node.java:220) ~[elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:191) ~[elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:191) ~[elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:286) [elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:112) [elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:103) [elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.cli.SettingCommand.execute(SettingCommand.java:54) [elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:96) [elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.cli.Command.main(Command.java:62) [elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80) [elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:73) [elasticsearch-5.0.0.jar:5.0.0]

4

Remove this line in your config:

bootstrap.mlockall: xxx
5

Thanks,

After commenting out bootstrap.mlockall: xxx, and service stop on all the nodes, I restarted the elastic search. Now I got a different error message.
This time, it seems during the bootstrapping, it has node validation exception.

...
[2016-11-02T10:59:47,436][INFO ][o.e.p.PluginsService ] [xlab-node9] loaded module [lang-groovy]
[2016-11-02T10:59:47,436][INFO ][o.e.p.PluginsService ] [xlab-node9] loaded module [lang-mustache]
[2016-11-02T10:59:47,436][INFO ][o.e.p.PluginsService ] [xlab-node9] loaded module [lang-painless]
[2016-11-02T10:59:47,436][INFO ][o.e.p.PluginsService ] [xlab-node9] loaded module [percolator]
[2016-11-02T10:59:47,436][INFO ][o.e.p.PluginsService ] [xlab-node9] loaded module [reindex]
[2016-11-02T10:59:47,437][INFO ][o.e.p.PluginsService ] [xlab-node9] loaded module [transport-netty3]
[2016-11-02T10:59:47,437][INFO ][o.e.p.PluginsService ] [xlab-node9] loaded module [transport-netty4]
[2016-11-02T10:59:47,437][INFO ][o.e.p.PluginsService ] [xlab-node9] loaded plugin [analysis-icu]
[2016-11-02T10:59:47,437][INFO ][o.e.p.PluginsService ] [xlab-node9] loaded plugin [x-pack]
[2016-11-02T10:59:49,903][INFO ][o.e.n.Node ] [xlab-node9] initialized
[2016-11-02T10:59:49,903][INFO ][o.e.n.Node ] [xlab-node9] starting ...
[2016-11-02T10:59:50,149][INFO ][o.e.t.TransportService ] [xlab-node9] publish_address {172.19.62.4:9300}, bound_addresses {[::1]:9300}, {127.0.0.1:9300}, {172.19.62.4:9300}
[2016-11-02T10:59:50,154][INFO ][o.e.b.BootstrapCheck ] [xlab-node9] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
[2016-11-02T10:59:50,159][ERROR][o.e.b.Bootstrap ] [xlab-node9] node validation exception
bootstrap checks failed
max file descriptors [65535] for elasticsearch process likely too low, increase to at least [65536]
[2016-11-02T10:59:50,161][INFO ][o.e.n.Node ] [xlab-node9] stopping ...
[2016-11-02T10:59:50,312][INFO ][o.e.n.Node ] [xlab-node9] stopped
[2016-11-02T10:59:50,313][INFO ][o.e.n.Node ] [xlab-node9] closing ...
[2016-11-02T10:59:50,325][INFO ][o.e.n.Node ] [xlab-node9] closed

6

You must fix that:

max file descriptors [65535] for elasticsearch process likely too low, increase to at least [65536]

Read Bootstrap Checks | Elasticsearch Guide [8.11] | Elastic

7

Thanks so much! Yes, the max file descriptors is set too low. I fixed that. Now it complained a different error. I remembered that when installing the x-pack plugin, it complained about "plugin requires additional permissions" and list a few jdk related permissions. Do those matter?

[2016-11-02T13:02:21,611][INFO ][o.e.n.Node ] [xlab-node9] initialized
[2016-11-02T13:02:21,611][INFO ][o.e.n.Node ] [xlab-node9] starting ...
[2016-11-02T13:02:21,825][INFO ][o.e.t.TransportService ] [xlab-node9] publish_address {172.19.62.4:9300}, bound_addresses {[::1]:9300}, {127.0.0.1:9300}, {172.19.62.4:9300}
[2016-11-02T13:02:21,829][INFO ][o.e.b.BootstrapCheck ] [xlab-node9] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
[2016-11-02T13:02:31,736][INFO ][o.e.x.m.e.Exporters ] [xlab-node9] skipping exporter [default_local] as it isn't ready yet
[2016-11-02T13:02:31,737][ERROR][o.e.x.m.AgentService ] [xlab-node9] exception when exporting documents
org.elasticsearch.xpack.monitoring.exporter.ExportException: exporters are either not ready or faulty
at org.elasticsearch.xpack.monitoring.exporter.Exporters.export(Exporters.java:188) ~[x-pack-5.0.0.jar:5.0.0]
at org.elasticsearch.xpack.monitoring.AgentService$ExportingWorker.run(AgentService.java:208) [x-pack-5.0.0.jar:5.0.0]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_91]

8

Another thing I found is that elasticsearch is started on just one node, even it keeps throwing out exceptions. But it couldn't discover other nodes specified in the elasticsearch.yml.
discovery.zen.ping.unicast.hosts: ["172.19.62.4", "172.19.62.6", "172.19.62.8"]

When I tried to access 172.19.62.4:9200, it asked for username,password. Is there a default credential for that?

best,

9

In 5.0 it's elastic / changeme