Elasticsearch cluster crash after upgrade 7.4.0 to 7.5.0

Elastic Stack Elasticsearch
1

by the way, first i installed elasticsearch cluster v7.4.0 with 2 nodes, then i forgot to terminate automatic upgrade on centos repository, now the impact my cluster upgraded to 7.5 and it was crash. below :

[2019-10-16T04:35:49,878][INFO ][o.e.x.s.s.SecurityStatusChangeListener] [elastic-node-1] Active license is now [BASIC]; Security is disabled
[2019-10-16T04:38:45,027][INFO ][o.e.n.Node ] [elastic-node-1] stopping ...
[2019-10-16T04:38:45,038][INFO ][o.e.x.w.WatcherService ] [elastic-node-1] stopping watch service, reason [shutdown initiated]
[2019-10-16T04:38:45,039][INFO ][o.e.x.w.WatcherLifeCycleService] [elastic-node-1] watcher has stopped and shutdown
[2019-10-16T04:38:45,441][INFO ][o.e.x.m.p.l.CppLogMessageHandler] [elastic-node-1] [controller/3099] [Main.cc@150] Ml controller exiting
[2019-10-16T04:38:45,444][INFO ][o.e.x.m.p.NativeController] [elastic-node-1] Native controller process has stopped - no new native processes can be started
[2019-10-16T04:38:45,460][INFO ][o.e.n.Node ] [elastic-node-1] stopped
[2019-10-16T04:38:45,460][INFO ][o.e.n.Node ] [elastic-node-1] closing ...
[2019-10-16T04:38:45,471][INFO ][o.e.n.Node ] [elastic-node-1] closed

please help me soon ! this is production issue

2

and then,
when i define both elastic host on kibana like below config :

elasticsearch.hosts: ["http://elastic02:9200","http://elastic02:9200"]

i got issue, when i hit kibana dashboard it such like slow access, sometime got error.

3

What are the logs when you start?

4

here @dadoonet

[2019-10-16T04:35:49,878][INFO ][o.e.x.s.s.SecurityStatusChangeListener] [elastic-node-1] Active license is now [BASIC]; Security is disabled
[2019-10-16T04:38:45,027][INFO ][o.e.n.Node ] [elastic-node-1] stopping ...
[2019-10-16T04:38:45,038][INFO ][o.e.x.w.WatcherService ] [elastic-node-1] stopping watch service, reason [shutdown initiated]
[2019-10-16T04:38:45,039][INFO ][o.e.x.w.WatcherLifeCycleService] [elastic-node-1] watcher has stopped and shutdown
[2019-10-16T04:38:45,441][INFO ][o.e.x.m.p.l.CppLogMessageHandler] [elastic-node-1] [controller/3099] [Main.cc@150] Ml controller exiting
[2019-10-16T04:38:45,444][INFO ][o.e.x.m.p.NativeController] [elastic-node-1] Native controller process has stopped - no new native processes can be started
[2019-10-16T04:38:45,460][INFO ][o.e.n.Node ] [elastic-node-1] stopped
[2019-10-16T04:38:45,460][INFO ][o.e.n.Node ] [elastic-node-1] closing ...
[2019-10-16T04:38:45,471][INFO ][o.e.n.Node ] [elastic-node-1] closed

5

Looks like logs when you stop. Not when you start.

6

here @dadoonet

● elasticsearch.service - Elasticsearch
   Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; enabled; vendor preset: disabled)
   Active: active (running) since Tue 2019-12-10 03:57:12 UTC; 8min ago
     Docs: http://www.elastic.co
 Main PID: 2954 (java)
   CGroup: /system.slice/elasticsearch.service
           ├─2954 /usr/share/elasticsearch/jdk/bin/java -Des.networkaddress.cache.ttl=60 -Des.networkaddress.cache.negative.ttl=10 -XX:+AlwaysPreTouch -Xss1m -Djava.aw...
           └─3051 /usr/share/elasticsearch/modules/x-pack-ml/platform/linux-x86_64/bin/controller

Dec 10 03:56:44 elastic-node-1 systemd[1]: Starting Elasticsearch...
Dec 10 03:56:45 elastic-node-1 elasticsearch[2954]: OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely ... release.
Dec 10 03:57:12 elastic-node-1 systemd[1]: Started Elasticsearch.
Hint: Some lines were ellipsized, use -l to show in full.
7

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

9

Sorry for the late reply. Could you share elasticsearch logs?