Elastic search( 7.10.0 ) stops working after we query from kibana

[Subhom_Dutta]

Hi,
Below are the logs of the single node cluster of elastic search before it stops

[2021-01-30T15:34:36,160][INFO ][o.e.x.m.p.NativeController] [ELK-NODE] Native controller process has stopped - no new native processes can be started
[2021-01-30T15:34:36,176][INFO ][o.e.b.Bootstrap ] [ELK-NODE] running graceful exit on windows
[2021-01-30T15:34:36,176][INFO ][o.e.n.Node ] [ELK-NODE] stopping ...
[2021-01-30T15:34:36,206][INFO ][o.e.x.w.WatcherService ] [ELK-NODE] stopping watch service, reason [shutdown initiated]
[2021-01-30T15:34:36,206][INFO ][o.e.x.w.WatcherLifeCycleService] [ELK-NODE] watcher has stopped and shutdown

[warkolm (Mark Walkom)]

Welcome to our community!

Is there more to the Elasticsearch logs prior to this?

[Subhom_Dutta]

Thanks Mark

I am attaching the logs please let me know if you need more.

[2021-01-30T03:22:59,769][INFO ][o.e.n.Node ] [ELK-NODE] started
[2021-01-30T03:23:00,066][WARN ][r.suppressed ] [ELK-NODE] path: /.kibana_task_manager/_update_by_query, params: {ignore_unavailable=true, refresh=true, conflicts=proceed, index=.kibana_task_manager, max_docs=10}
org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];

[2021-01-30T03:23:00,525][INFO ][o.e.l.LicenseService ] [ELK-NODE] license [e26e69ef-ca12-450b-ace3-23ec99e23d9d] mode [basic] - valid
[2021-01-30T03:23:00,531][INFO ][o.e.x.s.s.SecurityStatusChangeListener] [ELK-NODE] Active license is now [BASIC]; Security is disabled
[2021-01-30T03:23:00,585][INFO ][o.e.g.GatewayService ] [ELK-NODE] recovered [40] indices into cluster_state
[2021-01-30T03:23:02,894][WARN ][r.suppressed ] [ELK-NODE] path: /.kibana_task_manager/_update_by_query, params: {ignore_unavailable=true, refresh=true, conflicts=proceed, index=.kibana_task_manager, max_docs=10}
org.elasticsearch.action.search.SearchPhaseExecutionException:
at
[2021-01-30T03:23:06,132][WARN ][r.suppressed ] [ELK-NODE] path: /.kibana_task_manager/_update_by_query, params: {ignore_unavailable=true, refresh=true, conflicts=proceed, index=.kibana_task_manager, max_docs=10}
org.elasticsearch.action.search.SearchPhaseExecutionException: all shards failed

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?]
at java.lang.Thread.run(Thread.java:832) [?:?]

[2021-01-30T03:23:09,392][WARN ][r.suppressed ] [ELK-NODE] path: /.kibana_task_manager/_update_by_query, params: {ignore_unavailable=true, refresh=true, conflicts=proceed, index=.kibana_task_manager, max_docs=10}
org.elasticsearch.action.search.SearchPhaseExecutionException: all shards failed

[2021-01-30T03:23:16,262][WARN ][r.suppressed ] [ELK-NODE] path: /.kibana_task_manager/_update_by_query, params: {ignore_unavailable=true, refresh=true, conflicts=proceed, index=.kibana_task_manager, max_docs=10}
org.elasticsearch.action.search.SearchPhaseExecutionException: all shards failed

[2021-01-30T03:23:49,290][INFO ][o.e.i.b.HierarchyCircuitBreakerService] [ELK-NODE] attempting to trigger G1GC due to high heap usage [2060110440]
[2021-01-30T03:23:49,338][INFO ][o.e.i.b.HierarchyCircuitBreakerService] [ELK-NODE] GC did bring memory usage down, before [2060110440], after [1165415032], allocations [81], duration [48]
[2021-01-30T03:24:00,696][WARN ][r.suppressed ] [ELK-NODE] path: /txlogs-alias/_doc, params: {index=txlogs-alias, op_type=create}
org.elasticsearch.action.UnavailableShardsException: [txlogs-000001][0] primary shard is not active Timeout: [1m],

Below is the heap space config.

-Xms3g
-Xmx3g

Thanks

[warkolm (Mark Walkom)]

You might want to increase your heap size.