Hi,
In my internal single node setup, It works fine but often I am seeing transport client getting disconnected from the ES Node with general node connection failure]; nested: IllegalStateException[handshake failed]; nested: TransportException[connection reset];|
Can anyone help me understand why this exception happens and what can be done to avoid it
I have attached the logs below
[com.mhto.elastic.BulkProcessListener]|[INFO]|[97]: ExectutionID:455. indexing 2426 logs throught bulk index API...
[com.mhto.elastic.BulkProcessListener]|[INFO]|[342]: ExectutionID:455. indexed 2426 in 8425ms for ES|
[com.mhto.HostFailureListener]|[SEVERE]|[90]: Node Disconnected .Node name: [][127.0.0.1:9300] general node connection failure|
[com.mhto.HostFailureListener]|[SEVERE]|[90]: Printing Stacktrace: |
[SYSERR]|[INFO]|[90]: ConnectTransportException[[][127.0.0.1:9322] general node connection failure]; nested: IllegalStateException[handshake failed]; nested: TransportException[connection reset];|
[SYSERR]|[INFO]|[90]: at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:595)|
[SYSERR]|[INFO]|[90]: at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:117)|
[SYSERR]|[INFO]|[90]: at org.elasticsearch.transport.TransportService.openConnection(TransportService.java:361)|
[SYSERR]|[INFO]|[90]: at org.elasticsearch.client.transport.TransportClientNodesService$SimpleNodeSampler.doSample(TransportClientNodesService.java:407)|
[SYSERR]|[INFO]|[90]: at org.elasticsearch.client.transport.TransportClientNodesService$NodeSampler.sample(TransportClientNodesService.java:357)|
[SYSERR]|[INFO]|[90]: at org.elasticsearch.client.transport.TransportClientNodesService$ScheduledNodeSampler.run(TransportClientNodesService.java:390)|
[SYSERR]|[INFO]|[90]: at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:569)|
[SYSERR]|[INFO]|[90]: at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)|
[SYSERR]|[INFO]|[90]: at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)|
[SYSERR]|[INFO]|[90]: at java.lang.Thread.run(Thread.java:745)|
[SYSERR]|[INFO]|[90]: Caused by: java.lang.IllegalStateException: handshake failed|
[SYSERR]|[INFO]|[90]: at org.elasticsearch.transport.TcpTransport.executeHandshake(TcpTransport.java:1633)|
[SYSERR]|[INFO]|[90]: at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:577)|
[SYSERR]|[INFO]|[90]: ... 9 more|
[SYSERR]|[INFO]|[90]: Caused by: TransportException[connection reset]|
[SYSERR]|[INFO]|[90]: at org.elasticsearch.transport.TcpTransport.onChannelClosed(TcpTransport.java:1675)|
[SYSERR]|[INFO]|[90]: at org.elasticsearch.transport.TcpTransport.lambda$openConnection$1(TcpTransport.java:558)|
[SYSERR]|[INFO]|[90]: at org.elasticsearch.transport.TcpTransport$$Lambda$679/93402862.accept(Unknown Source)|
[SYSERR]|[INFO]|[90]: at org.elasticsearch.transport.netty4.Netty4Transport.lambda$connectToChannels$2(Netty4Transport.java:355)|
[SYSERR]|[INFO]|[90]: at org.elasticsearch.transport.netty4.Netty4Transport$$Lambda$680/1652295381.operationComplete(Unknown Source)|
[SYSERR]|[INFO]|[90]: at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:507)|
[SYSERR]|[INFO]|[90]: at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:481)|
[SYSERR]|[INFO]|[90]: at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:420)|
[SYSERR]|[INFO]|[90]: at io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:104)|
[SYSERR]|[INFO]|[90]: at io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:82)|
[SYSERR]|[INFO]|[90]: at io.netty.channel.AbstractChannel$CloseFuture.setClosed(AbstractChannel.java:1057)|
[SYSERR]|[INFO]|[90]: at io.netty.channel.AbstractChannel$AbstractUnsafe.doClose0(AbstractChannel.java:686)|
[SYSERR]|[INFO]|[90]: at io.netty.channel.AbstractChannel$AbstractUnsafe.close(AbstractChannel.java:664)|
[SYSERR]|[INFO]|[90]: at io.netty.channel.AbstractChannel$AbstractUnsafe.close(AbstractChannel.java:607)|
[SYSERR]|[INFO]|[90]: at io.netty.channel.DefaultChannelPipeline$HeadContext.close(DefaultChannelPipeline.java:1276)|
[SYSERR]|[INFO]|[90]: at io.netty.channel.AbstractChannelHandlerContext.invokeClose(AbstractChannelHandlerContext.java:624)|
[SYSERR]|[INFO]|[90]: at io.netty.channel.AbstractChannelHandlerContext.close(AbstractChannelHandlerContext.java:608)|
[SYSERR]|[INFO]|[90]: at io.netty.channel.AbstractChannelHandlerContext.close(AbstractChannelHandlerContext.java:465)|
[SYSERR]|[INFO]|[90]: at io.netty.handler.ssl.SslUtils.notifyHandshakeFailure(SslUtils.java:264)|
[SYSERR]|[INFO]|[90]: at io.netty.handler.ssl.SslHandler.notifyHandshakeFailure(SslHandler.java:1421)|
[SYSERR]|[INFO]|[90]: at io.netty.handler.ssl.SslHandler.access$1200(SslHandler.java:161)|
[SYSERR]|[INFO]|[90]: at io.netty.handler.ssl.SslHandler$5.run(SslHandler.java:1590)|
[SYSERR]|[INFO]|[90]: at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38)|
[SYSERR]|[INFO]|[90]: at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120)|
[SYSERR]|[INFO]|[90]: at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)|
[SYSERR]|[INFO]|[90]: at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:403)|
[SYSERR]|[INFO]|[90]: at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462)|
[SYSERR]|[INFO]|[90]: at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)|