Failed to start Elasticcluster after adding trial license


(Rajeshwer rao Madoori) #1

Elastic serach container fails after adding trial license key.. logs doesnt show any specific error.
Created elasticsearch keystore in /usr/share/elasticsearch/config
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[2018-10-02T23:47:23,656][INFO ][o.e.n.Node ] [es] initializing ...
[2018-10-02T23:47:23,753][INFO ][o.e.e.NodeEnvironment ] [es] using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/scinic)]], net usable_space [79.9gb], net total_space [79.9gb], types [xfs]
[2018-10-02T23:47:23,754][INFO ][o.e.e.NodeEnvironment ] [es] heap size [1007.3mb], compressed ordinary object pointers [true]
[2018-10-02T23:47:23,755][INFO ][o.e.n.Node ] [es] node name [es], node ID [ZzEsvHGNQfmnOsVd4yJwMA]
[2018-10-02T23:47:23,755][INFO ][o.e.n.Node ] [es] version[6.3.0], pid[1], build[default/tar/424e937/2018-06-11T23:38:03.357887Z], OS[Linux/4.17.11-1.el7.elrepo.x86_64/amd64], JVM["Oracle Corporation"/OpenJDK 64-Bit Server VM/10.0.2/10.0.2+13]
[2018-10-02T23:47:23,756][INFO ][o.e.n.Node ] [es] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.pSx3v0dd, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -Des.cgroups.hierarchy.override=/, -Xms1024m, -Xmx1024m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=tar]
[INFO ][o.e.p.PluginsService ] [es] loaded module [aggs-matrix-stats]
[INFO ][o.e.p.PluginsService ] [es] loaded module [analysis-common]
[INFO ][o.e.p.PluginsService ] [es] loaded module [ingest-common]
[o.e.p.PluginsService ] [es] loaded module [lang-expression]
[INFO ][o.e.p.PluginsService ] [es] loaded module [lang-mustache]
[INFO ][o.e.p.PluginsService ] [es] loaded module [lang-painless]
[INFO ][o.e.p.PluginsService ] [es] loaded module [mapper-extras]
-10-02T23:47:25,690][INFO ][o.e.p.PluginsService ] [es] loaded module [parent-join]
-02T23:47:25,690][INFO ][o.e.p.PluginsService ] [es] loaded module [percolator]
T23:47:25,690][INFO ][o.e.p.PluginsService ] [es] loaded module [rank-eval]
2T23:47:25,691][INFO ][o.e.p.PluginsService ] [es] loaded module [reindex]
0-02T23:47:25,691][INFO ][o.e.p.PluginsService ] [es] loaded module [repository-url]
47:25,691][INFO ][o.e.p.PluginsService ] [es] loaded module [transport-netty4]
INFO ][o.e.p.PluginsService ] [es] loaded module [tribe]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-core]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-deprecation]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-graph]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-logstash]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-ml]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-monitoring]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-rollup]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-security]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-sql]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-upgrade]
[INFO ][o.e.p.PluginsService ] [es] loaded module [x-pack-watcher]
INFO ][o.e.p.PluginsService ] [es] no plugins loaded


(Rajeshwer rao Madoori) #2

18-10-02T23:47:29,002][INFO ][o.e.x.s.a.s.FileRolesStore] [es] parsed [0] roles from file [/usr/share/elasticsearch/config/roles.yml]
018-10-02T23:47:29,797][INFO ][o.e.d.DiscoveryModule ] [es] using discovery type [zen]
T23:47:30,315][INFO ][o.e.n.Node ] [es] initialized
2018-10-02T23:47:30,315][INFO ][o.e.n.Node ] [es] starting ...
[2018-10-02T23:47:30,471][INFO ][o.e.t.TransportService ] [es] publish_address {172.16.xx.xx:9300}, bound_addresses {[::]:9300}
[2018-10-02T23:47:30,489][INFO ][o.e.b.BootstrapChecks ] [es] bound or publishing to a non-loopback address, enforcing bootstrap checks
[2018-10-02T23:47:33,530][INFO ][o.e.c.s.MasterService ] [es] zen-disco-elected-as-master ([0] nodes joined)[, ], reason: new_master {es}{ZzEsvHGNQfmnOsVd4yJwMA}{XDlxOFRaRJmFVmOtrtZp7g}{172.16.xx.xx}{172.16.xx.xx:9300}{xpack.installed=true}
[2018-10-02T23:47:33,535][INFO ][o.e.c.s.ClusterApplierService] [es] new_master {es}{ZzEsvHGNQfmnOsVd4yJwMA}{XDlxOFRaRJmFVmOtrtZp7g}{172.16.xx.xx}{172.16.xx.xx:9300}{xpack.installed=true}, reason: apply cluster state (from master [master {es}{ZzEsvHGNQfmnOsVd4yJwMA}{XDlxOFRaRJmFVmOtrtZp7g}{172.16.xx.xx}{172.16.xx.xx:9300}{xpack.installed=true} committed version [1] source [zen-disco-elected-as-master ([0] nodes joined)[, ]]])
[2018-10-02T23:47:33,556][INFO ][o.e.x.s.t.n.SecurityNetty4HttpServerTransport] [es] publish_address {172.16.xx.xx:9200}, bound_addresses {[::]:9200}
[2018-10-02T23:47:33,556][INFO ][o.e.n.Node ] [es] started
[INFO ][o.e.g.GatewayService ] [es] recovered [0] indices into cluster_state
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.triggered_watches] for index patterns [.triggered_watches*]
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.watches] for index patterns [.watches*]
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.watch-history-7] for index patterns [.watcher-history-7*]
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.monitoring-logstash] for index patterns [.monitoring-logstash-6-]
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.monitoring-es] for index patterns [.monitoring-es-6-
]
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.monitoring-alerts] for index patterns [.monitoring-alerts-6]
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.monitoring-beats] for index patterns [.monitoring-beats-6-]
[INFO ][o.e.c.m.MetaDataIndexTemplateService] [es] adding template [.monitoring-kibana] for index patterns [.monitoring-kibana-6-
]
[INFO ][o.e.l.LicenseService ] [es] license [11472ae9-d6ff-425a-b11f-7e31eaf31f9a] mode [basic] - valid
[INFO ][o.e.c.s.MasterService ] [es] zen-disco-node-join, reason: added {{es-data}{nH2d7RGUSoSJZG-b9gElsw}{l83Nhg2TQ7-sZ-KnVPTvLA}{172.16.xx.xx}{172.16.xx.xx:9300}{ml.machine_memory=3145728000, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},}
[INFO ][o.e.c.s.ClusterApplierService] [es] added {{es-data}{nH2d7RGUSoSJZG-b9gElsw}{l83Nhg2TQ7-sZ-KnVPTvLA}{172.16.xx.xx}{172.16.xx.xx:9300}{ml.machine_memory=3145728000, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},}, reason: apply cluster state (from master [master {es}{ZzEsvHGNQfmnOsVd4yJwMA}{XDlxOFRaRJmFVmOtrtZp7g}{172.16.xx.xx}{172.16.xx.xx:9300}{xpack.installed=true} committed version [15] source [zen-disco-node-join]])
[INFO ][o.e.c.s.MasterService ] [es] zen-disco-node-join, reason: added {{es-data}{JLL7GVfNQrK1N29RKB-R9A}{WRZDV4i0TkGu2TSNvhHzCw}{172.16.xx.xx}{172.16.xx.xx:9300}{ml.machine_memory=3145728000, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},}
[INFO ][o.e.c.s.ClusterApplierService] [es] added {{es-data}{JLL7GVfNQrK1N29RKB-R9A}{WRZDV4i0TkGu2TSNvhHzCw}{172.16.xx.xx}{172.16.xx.xx:9300}{ml.machine_memory=3145728000, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},}, reason: apply cluster state (from master [master {es}{ZzEsvHGNQfmnOsVd4yJwMA}{XDlxOFRaRJmFVmOtrtZp7g}{172.16.xx.xx}{172.16.xx.xx:9300}{xpack.installed=true} committed version [16] source [zen-disco-node-join]])
[INFO ][o.e.l.LicenseService ] [es] license [86604741-f8f0-4874-8cf0-ee2f46ecd408] mode [trial] - valid
[o.e.n.Node ] [es] stopping ...
[INFO ][o.e.x.w.WatcherService ] [es] stopping watch service, reason [shutdown initiated]
[INFO ][o.e.n.Node ] [es] stopped
[INFO ][o.e.n.Node ] [es] closing ...
[INFO ][o.e.n.Node ] [es] closed


(Rajeshwer rao Madoori) #3

Command i used to add the trial license:

curl -XPUT 'http://es-master:9200/_xpack/license' -H "Content-Type: application/json" -d @license.json

i Only added tial license to my master node and once i add the trial license it exits i am running in elastic search cluster with master and data nodes is there a documentation on how to setup elastic cluster with xpack trial license


(Mark Walkom) #4

Please use the code button </> to format data like logs, it makes it much easier to read.

You don't need to apply a trial license from 6.3.0 onwards, it comes with a basic license enabled.

That suggests that something is asking Elasticsearch to stop, Elasticsearch cannot just stop itself.


(Rajeshwer rao Madoori) #5

Hi,

Thanks For the response.
Whats the difference between basic license and trial license??

Thanks


(Rajeshwer rao Madoori) #6

I set the log level to debug and i see this error org.elasticsearch.ElasticsearchSecurityException: missing authentication token for REST request [/] at org.elasticsearch.xpack.core.security.support.Exceptions.authenticationError(Exceptions.java:24) ~[x-pack-core-6.3.0.jar:6.3.0] at org.elasticsearch.xpack.core.security.authc.DefaultAuthenticationFailureHandler.missingToken(DefaultAuthenticationFailureHandler.java:57) ~[x-pack-core-6.3.0.jar:6.3.0] at org.elasticsearch.xpack.security.authc.AuthenticationService$AuditableRestRequest.anonymousAccessDenied(AuthenticationService.java:586) ~[x-pack-security-6.3.0.jar:6.3.0]


(Rajeshwer rao Madoori) #7

I wanted to use trial license instead of basic license since security futures are not available in basic license


(Mark Walkom) #8

You can see the differences here https://www.elastic.co/subscriptions


(Rajeshwer rao Madoori) #9

I was able to get around it but i having new issue now

Path: /_xpack/security/_authenticate, params: {pretty=, index=_xpack, id=_authenticate, type=security} org.elasticsearch.index.IndexNotFoundException: no such index


(system) #10

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.