Hi,
I am using Elastic Search 5.6.10 and Jdk 1.8.102, I was doing load testing this got failed and during Load testing(Only Search operation on Index) I am seeing lots of Thread wait on client logs/dump, any input how to fix this.
logs:
"Attach Listener" #922 daemon prio=9 os_prio=0 tid=0x00007fe358001000 nid=0xa1d3 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
Locked ownable synchronizers:
- None
"elasticsearch[client][generic][T#5]" #836 daemon prio=5 os_prio=0 tid=0x00007fdc80029000 nid=0x863c waiting on condition [0x00007fdde1ffc000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000060a14bfe8> (a org.elasticsearch.common.util.concurrent.EsExecutors$ExecutorScalingQueue)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:737)
at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:647)
at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1269)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Locked ownable synchronizers:
- None
.......................................Other trace from log...................................................................................
"elasticsearch[client][transport_client_boss][T#62]" #570 daemon prio=5 os_prio=0 tid=0x00007fddf001a800 nid=0x3da4 runnable [0x00007fdbdb8bf000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000005cf7e9140> (a sun.nio.ch.Util$3)
- locked <0x00000005cf7e9130> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000005cf7e9018> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:752)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:408)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
at java.lang.Thread.run(Thread.java:745)
Locked ownable synchronizers:
- None