We recently upgraded ELK stack from 6.5 to 7.5.0. Via Kibana i am unable to load older index like last 1 day or 2 days in new version of 7.5.0. Below is the ES error log while trying to load 2 days index.
Kibana Console Error Message
Error: Request to Elasticsearch failed: {"error":{}}
at http://172.26.61.212:5601/bundles/commons.bundle.js:3:4897411
at Function._module.service.Promise.try (http://172.26.61.212:5601/bundles/commons.bundle.js:3:2501410)
at http://172.26.61.212:5601/bundles/commons.bundle.js:3:2500784
at Array.map ()
at Function._module.service.Promise.map (http://172.26.61.212:5601/bundles/commons.bundle.js:3:2500741)
at callResponseHandlers (http://172.26.61.212:5601/bundles/commons.bundle.js:3:4895925)
at http://172.26.61.212:5601/bundles/commons.bundle.js:3:4878286
at processQueue (http://172.26.61.212:5601/built_assets/dlls/vendors.bundle.dll.js:435:204190)
at http://172.26.61.212:5601/built_assets/dlls/vendors.bundle.dll.js:435:205154
at Scope.$digest (http://172.26.61.212:5601/built_assets/dlls/vendors.bundle.dll.js:435:215159)
ElasticSearch Logs
[2020-03-24T11:11:39,481][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] [apvapp61212] Received ban for the parent [kIkB9XbbSdySNBWgOWa85Q:23732449] on the node [kIkB9XbbSdySNBWgOWa85Q], reason: [by user request]
[2020-03-24T11:11:39,665][DEBUG][o.e.a.s.TransportSearchAction] [apvapp61212] [214603] Failed to execute fetch phase
org.elasticsearch.transport.RemoteTransportException: [APVApp61216][172.26.61.216:9300][indices:data/read/search[phase/fetch/id]]
Caused by: java.lang.IllegalStateException: Task cancelled before it started: by user request
at org.elasticsearch.tasks.TaskManager.registerCancellableTask(TaskManager.java:141) ~[elasticsearch-7.5.0.jar:7.5.0]
at org.elasticsearch.tasks.TaskManager.register(TaskManager.java:122) ~[elasticsearch-7.5.0.jar:7.5.0]
at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:60) ~[elasticsearch-7.5.0.jar:7.5.0]
at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:264) ~[elasticsearch-7.5.0.jar:7.5.0]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.5.0.jar:7.5.0]
at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225) ~[elasticsearch-7.5.0.jar:7.5.0]
at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:185) [elasticsearch-7.5.0.jar:7.5.0]
at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:118) [elasticsearch-7.5.0.jar:7.5.0]
at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:102) [elasticsearch-7.5.0.jar:7.5.0]
at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:667) [elasticsearch-7.5.0.jar:7.5.0]
at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:62) [transport-netty4-client-7.5.0.jar:7.5.0]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:326) [netty-codec-4.1.43.Final.jar:4.1.43.Final]
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:300) [netty-codec-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241) [netty-handler-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:600) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:554) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) [netty-transport-4.1.43.Final.jar:4.1.43.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050) [netty-common-4.1.43.Final.jar:4.1.43.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.43.Final.jar:4.1.43.Final]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2020-03-24T11:11:39,668][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] [apvapp61212] Sending remove ban for tasks with the parent [kIkB9XbbSdySNBWgOWa85Q:23732449] to the node [4KT26SFVQRObFvp5qyU_2w]
[2020-03-24T11:11:39,668][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] [apvapp61212] Sending remove ban for tasks with the parent [kIkB9XbbSdySNBWgOWa85Q:23732449] to the node [K6o2-5ocTfCmtTTmfdq6xQ]
[2020-03-24T11:11:39,668][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] [apvapp61212] Sending remove ban for tasks with the parent [kIkB9XbbSdySNBWgOWa85Q:23732449] to the node [kIkB9XbbSdySNBWgOWa85Q]
[2020-03-24T11:11:39,668][DEBUG][o.e.a.a.c.n.t.c.TransportCancelTasksAction] [apvapp61212] Removing ban for the parent [kIkB9XbbSdySNBWgOWa85Q:23732449] on the node [kIkB9XbbSdySNBWgOWa85Q]