Failed to start Elasticcluster after adding trial license

Elastic serach container fails after adding trial license key.. logs doesnt show any specific error.
Created elasticsearch keystore in /usr/share/elasticsearch/config
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[2018-10-02T23:47:23,656][INFO ][o.e.n.Node ] [es] initializing ...
[2018-10-02T23:47:23,753][INFO ][o.e.e.NodeEnvironment ] [es] using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/scinic)]], net usable_space [79.9gb], net total_space [79.9gb], types [xfs]
[2018-10-02T23:47:23,754][INFO ][o.e.e.NodeEnvironment ] [es] heap size [1007.3mb], compressed ordinary object pointers [true]
[2018-10-02T23:47:23,755][INFO ][o.e.n.Node ] [es] node name [es], node ID [ZzEsvHGNQfmnOsVd4yJwMA]
[2018-10-02T23:47:23,755][INFO ][o.e.n.Node ] [es] version[6.3.0], pid[1], build[default/tar/424e937/2018-06-11T23:38:03.357887Z], OS[Linux/4.17.11-1.el7.elrepo.x86_64/amd64], JVM["Oracle Corporation"/OpenJDK 64-Bit Server VM/10.0.2/10.0.2+13]
[2018-10-02T23:47:23,756][INFO ][o.e.n.Node ] [es] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.pSx3v0dd, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -Des.cgroups.hierarchy.override=/, -Xms1024m, -Xmx1024m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=tar]
[INFO ][o.e.p.PluginsService ] [es] loaded module [aggs-matrix-stats]
[INFO ][o.e.p.PluginsService ] [es] loaded module [analysis-common]
[INFO ][o.e.p.PluginsService ] [es] loaded module [ingest-common]
[o.e.p.PluginsService ] [es] loaded module [lang-expression]
[INFO ][o.e.p.PluginsService ] [es] loaded module [lang-mustache]
[INFO ][o.e.p.PluginsService ] [es] loaded module [lang-painless]
[INFO ][o.e.p.PluginsService ] [es] loaded module [mapper-extras]
-10-02T23:47:25,690][INFO ][o.e.p.PluginsService ] [es] loaded module [parent-join]
-02T23:47:25,690][INFO ][o.e.p.PluginsService ] [es] loaded module [percolator]
T23:47:25,690][INFO ][o.e.p.PluginsService ] [es] loaded module [rank-eval]
2T23:47:25,691][INFO ][o.e.p.PluginsService ] [es] loaded module [reindex]
0-02T23:47:25,691][INFO ][o.e.p.PluginsService ] [es] loaded module [repository-url]
47:25,691][INFO ][o.e.p.PluginsService ] [es] loaded module [transport-netty4]
INFO ][o.e.p.PluginsService ] [es] loaded module [tribe]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-core]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-deprecation]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-graph]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-logstash]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-ml]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-monitoring]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-rollup]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-security]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-sql]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-upgrade]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-watcher]
INFO ][o.e.p.PluginsService ] [es] no plugins loaded

18-10-02T23:47:29,002][INFO ][o.e.x.s.a.s.FileRolesStore] [es] parsed [0] roles from file [/usr/share/elasticsearch/config/roles.yml]
018-10-02T23:47:29,797][INFO ][o.e.d.DiscoveryModule ] [es] using discovery type [zen]
T23:47:30,315][INFO ][o.e.n.Node ] [es] initialized
2018-10-02T23:47:30,315][INFO ][o.e.n.Node ] [es] starting ...
[2018-10-02T23:47:30,471][INFO ][o.e.t.TransportService ] [es] publish_address {172.16.xx.xx:9300}, bound_addresses {[::]:9300}
[2018-10-02T23:47:30,489][INFO ][o.e.b.BootstrapChecks ] [es] bound or publishing to a non-loopback address, enforcing bootstrap checks
[2018-10-02T23:47:33,530][INFO ][o.e.c.s.MasterService ] [es] zen-disco-elected-as-master ([0] nodes joined)[, ], reason: new_master {es}{ZzEsvHGNQfmnOsVd4yJwMA}{XDlxOFRaRJmFVmOtrtZp7g}{172.16.xx.xx}{172.16.xx.xx:9300}{xpack.installed=true}
[2018-10-02T23:47:33,535][INFO ][o.e.c.s.ClusterApplierService] [es] new_master {es}{ZzEsvHGNQfmnOsVd4yJwMA}{XDlxOFRaRJmFVmOtrtZp7g}{172.16.xx.xx}{172.16.xx.xx:9300}{xpack.installed=true}, reason: apply cluster state (from master [master {es}{ZzEsvHGNQfmnOsVd4yJwMA}{XDlxOFRaRJmFVmOtrtZp7g}{172.16.xx.xx}{172.16.xx.xx:9300}{xpack.installed=true} committed version [1] source [zen-disco-elected-as-master ([0] nodes joined)[, ]]])
[2018-10-02T23:47:33,556][INFO ][o.e.x.s.t.n.SecurityNetty4HttpServerTransport] [es] publish_address {172.16.xx.xx:9200}, bound_addresses {[::]:9200}
[2018-10-02T23:47:33,556][INFO ][o.e.n.Node ] [es] started
[INFO ][o.e.g.GatewayService ] [es] recovered [0] indices into cluster_state
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.triggered_watches] for index patterns [.triggered_watches*]
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.watches] for index patterns [.watches*]
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.watch-history-7] for index patterns [.watcher-history-7*]
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.monitoring-logstash] for index patterns [.monitoring-logstash-6-]
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.monitoring-es] for index patterns [.monitoring-es-6-
]
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.monitoring-alerts] for index patterns [.monitoring-alerts-6]
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.monitoring-beats] for index patterns [.monitoring-beats-6-]
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.monitoring-kibana] for index patterns [.monitoring-kibana-6-
]
[INFO ][o.e.l.LicenseService ] [es] license [11472ae9-d6ff-425a-b11f-7e31eaf31f9a] mode [basic] - valid
[INFO ][o.e.c.s.MasterService ] [es] zen-disco-node-join, reason: added {{es-data}{nH2d7RGUSoSJZG-b9gElsw}{l83Nhg2TQ7-sZ-KnVPTvLA}{172.16.xx.xx}{172.16.xx.xx:9300}{ml.machine_memory=3145728000, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},}
[INFO ][o.e.c.s.ClusterApplierService] [es] added {{es-data}{nH2d7RGUSoSJZG-b9gElsw}{l83Nhg2TQ7-sZ-KnVPTvLA}{172.16.xx.xx}{172.16.xx.xx:9300}{ml.machine_memory=3145728000, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},}, reason: apply cluster state (from master [master {es}{ZzEsvHGNQfmnOsVd4yJwMA}{XDlxOFRaRJmFVmOtrtZp7g}{172.16.xx.xx}{172.16.xx.xx:9300}{xpack.installed=true} committed version [15] source [zen-disco-node-join]])
[INFO ][o.e.c.s.MasterService ] [es] zen-disco-node-join, reason: added {{es-data}{JLL7GVfNQrK1N29RKB-R9A}{WRZDV4i0TkGu2TSNvhHzCw}{172.16.xx.xx}{172.16.xx.xx:9300}{ml.machine_memory=3145728000, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},}
[INFO ][o.e.c.s.ClusterApplierService] [es] added {{es-data}{JLL7GVfNQrK1N29RKB-R9A}{WRZDV4i0TkGu2TSNvhHzCw}{172.16.xx.xx}{172.16.xx.xx:9300}{ml.machine_memory=3145728000, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},}, reason: apply cluster state (from master [master {es}{ZzEsvHGNQfmnOsVd4yJwMA}{XDlxOFRaRJmFVmOtrtZp7g}{172.16.xx.xx}{172.16.xx.xx:9300}{xpack.installed=true} committed version [16] source [zen-disco-node-join]])
[INFO ][o.e.l.LicenseService ] [es] license [86604741-f8f0-4874-8cf0-ee2f46ecd408] mode [trial] - valid
[o.e.n.Node ] [es] stopping ...
[INFO ][o.e.x.w.WatcherService ] [es] stopping watch service, reason [shutdown initiated]
[INFO ][o.e.n.Node ] [es] stopped
[INFO ][o.e.n.Node ] [es] closing ...
[INFO ][o.e.n.Node ] [es] closed

Command i used to add the trial license:

curl -XPUT 'http://es-master:9200/_xpack/license' -H "Content-Type: application/json" -d @license.json

i Only added tial license to my master node and once i add the trial license it exits i am running in elastic search cluster with master and data nodes is there a documentation on how to setup elastic cluster with xpack trial license

Please use the code button </> to format data like logs, it makes it much easier to read.

You don't need to apply a trial license from 6.3.0 onwards, it comes with a basic license enabled.

That suggests that something is asking Elasticsearch to stop, Elasticsearch cannot just stop itself.

Hi,

Thanks For the response.
Whats the difference between basic license and trial license??

Thanks

I set the log level to debug and i see this error org.elasticsearch.ElasticsearchSecurityException: missing authentication token for REST request [/] at org.elasticsearch.xpack.core.security.support.Exceptions.authenticationError(Exceptions.java:24) ~[x-pack-core-6.3.0.jar:6.3.0] at org.elasticsearch.xpack.core.security.authc.DefaultAuthenticationFailureHandler.missingToken(DefaultAuthenticationFailureHandler.java:57) ~[x-pack-core-6.3.0.jar:6.3.0] at org.elasticsearch.xpack.security.authc.AuthenticationService$AuditableRestRequest.anonymousAccessDenied(AuthenticationService.java:586) ~[x-pack-security-6.3.0.jar:6.3.0]

I wanted to use trial license instead of basic license since security futures are not available in basic license

You can see the differences here https://www.elastic.co/subscriptions

I was able to get around it but i having new issue now

Path: /_xpack/security/_authenticate, params: {pretty=, index=_xpack, id=_authenticate, type=security} org.elasticsearch.index.IndexNotFoundException: no such index

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.