Es version: 5.4.3
Problem:
We use tribe node as proxy to search cross multi clusters (6 cluster now). When add one specific cluster to the tribe node, we occasionally meet search failure (timeout) when the index belongs to this specific cluster. When this problem happened, we restarted tribe node and it solved. But it might appear again after a while. The other clusters never meet this problem.
The network latency between tribe node and the cluster caused the problem is a little higher (avg 30ms )than the other clusters(avg 3ms).
If we install a stand lone kibana (in the same network of tribe node) and connect to the cluster caused the problem, we never meet search failure.
Does any one meet this problem before? Thank you