one of my clients has a cluster configuration where the 3 nodes are spread across 2 data centers. For a while, they have been noticing the latency on search queries.
Based on network logs and cluster configuration we have recommended moving the ES cluster within the same data center.
Our basic assumption here is that the nodes spread across data centers will have latency in synchronization and as well as communication within-cluster, and likely the reason for searches to be slow.
Are there any recommendations or guidelines on high-performing cluster configuration?