We have a data of 300 million records , each with 600 fields in our elasticsearch cluster which is 5 nodes with 4 cpu's with replication 1.
When we run a GET query with fuzzy 1 or some time fuzzy 2 on some of its fields . Our performance / Latency is degrading with number of concurrent threads .
If we had a single threaded client sending requests sequentially our Latency is 300 millieconds .
But for 10 threads it is 1200 milliseconds and 20 threads it is 2500 milliseconds .
Since it is a 5 node 4 cpu cluster there are 20 cpu's available for concuurent processing . I would have thought even for 20 cpu's we should get the latency to be 300 milliseconds .
RAM on our systems is 32 GB .
Can any body throw some insights into why the performance could be degrading .
Or give some tips about optimizing the cluster .