[v6.2.2]ES often happen Frequently error of timeout question now and then

Elastic Stack Elasticsearch
1

image
image.png1182×545 31.8 KB

image
image.png1252×676 29.1 KB

Errors (1、2) often happen Frequently,how to solve?

2

java.lang.IllegalStateException: Request cannot be executed; I/O reactor status: STOPPED
at org.apache.http.util.Asserts.check(Asserts.java:46) ~[httpcore-4.4.4.jar:4.4.4]
at org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase.ensureRunning(CloseableHttpAsyncClientBase.java:90) ~[httpasyncclient-4.1.2.jar:4.1.2]
at org.apache.http.impl.nio.client.InternalHttpAsyncClient.execute(InternalHttpAsyncClient.java:123) ~[httpasyncclient-4.1.2.jar:4.1.2]
at org.elasticsearch.client.RestClient.performRequestAsync(RestClient.java:347) ~[elasticsearch-rest-client-6.2.4.jar:6.2.4]
at org.elasticsearch.client.RestClient.performRequestAsync(RestClient.java:329) [elasticsearch-rest-client-6.2.4.jar:6.2.4]
at org.elasticsearch.client.RestClient.performRequestAsync(RestClient.java:272) [elasticsearch-rest-client-6.2.4.jar:6.2.4]
at org.elasticsearch.client.RestHighLevelClient.performRequestAsync(RestHighLevelClient.java:537) [elasticsearch-rest-high-level-client-6.2.4.jar:6.2.4]
at org.elasticsearch.client.RestHighLevelClient.performRequestAsyncAndParseEntity(RestHighLevelClient.java:515) [elasticsearch-rest-high-level-client-6.2.4.jar:6.2.4]
at org.elasticsearch.client.RestHighLevelClient.indexAsync(RestHighLevelClient.java:344) [elasticsearch-rest-high-level-client-6.2.4.jar:6.2.4]
at com.glocalme.css.analyse.elasticsearch.dao.VsimAssignLogDao.indexAsync(VsimAssignLogDao.java:233) [css-analyse-service-1.0.0.jar:?]
at com.glocalme.css.analyse.elasticsearch.dao.VsimAssignLogDao.index(VsimAssignLogDao.java:213) [css-analyse-service-1.0.0.jar:?]
at com.glocalme.css.analyse.task.OnlineUserMonitorTask.listen(OnlineUserMonitorTask.java:145) [css-analyse-service-1.0.0.jar:?]
at sun.reflect.GeneratedMethodAccessor56.invoke(Unknown Source) ~[?:?]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_144]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_144]
at com.google.common.eventbus.Subscriber.invokeSubscriberMethod(Subscriber.java:95) [guava-19.0.jar:?]
at com.google.common.eventbus.Subscriber$SynchronizedSubscriber.invokeSubscriberMethod(Subscriber.java:154) [guava-19.0.jar:?]
at com.google.common.eventbus.Subscriber$1.run(Subscriber.java:80) [guava-19.0.jar:?]
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) [guava-19.0.jar:?]
at com.google.common.eventbus.Subscriber.dispatchEvent(Subscriber.java:76) [guava-19.0.jar:?]
at com.google.common.eventbus.Dispatcher$PerThreadQueuedDispatcher.dispatch(Dispatcher.java:119) [guava-19.0.jar:?]
at com.google.common.eventbus.EventBus.post(EventBus.java:215) [guava-19.0.jar:?]
at com.glocalme.css.analyse.schedule.executors.ReclaimEventExecutor.execute(ReclaimEventExecutor.java:47) [css-analyse-service-1.0.0.jar:?]
at com.glocalme.css.common.kafka.AbstractMessageExecutor$1.run(AbstractMessageExecutor.java:88) [css-common-1.0.0.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_144]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_144]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_144]

java.io.IOException: listener timeout after waiting for [300000] ms
at org.elasticsearch.client.RestClient$SyncResponseListener.get(RestClient.java:665) ~[elasticsearch-rest-client-6.2.4.jar:6.2.4]
at org.elasticsearch.client.RestClient.performRequest(RestClient.java:223) ~[elasticsearch-rest-client-6.2.4.jar:6.2.4]
at org.elasticsearch.client.RestClient.performRequest(RestClient.java:195) ~[elasticsearch-rest-client-6.2.4.jar:6.2.4]
at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:488) ~[elasticsearch-rest-high-level-client-6.2.4.jar:6.2.4]
at org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:474) ~[elasticsearch-rest-high-level-client-6.2.4.jar:6.2.4]
at org.elasticsearch.client.RestHighLevelClient.index(RestHighLevelClient.java:335) ~[elasticsearch-rest-high-level-client-6.2.4.jar:6.2.4]
at com.glocalme.css.analyse.elasticsearch.dao.DispatchLogFullDao.insert(DispatchLogFullDao.java:56) [css-analyse-service-1.0.0.jar:?]
at com.glocalme.css.analyse.schedule.executors.DispatchLogExecutor.execute(DispatchLogExecutor.java:65) [css-analyse-service-1.0.0.jar:?]
at com.glocalme.css.common.kafka.AbstractMessageExecutor$1.run(AbstractMessageExecutor.java:88) [css-common-1.0.0.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_144]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_144]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_144]

3

What does the request that times out look like? How many indices and shards does it run against? How much data do those indices contain? What is the specification of your Elasticsearch cluster?

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.