Increase in Elasticsearch search latency after increasing instance memory to 64GB

Elastic Stack Elasticsearch
1

We are using ES 6.0.
We do not have any analysers in our index and all fields are "keyword" OR number OR date field.
Our search queries are also simple bool queries without any aggregation.

We are using EC2, and our past configuration was 8c/32GB machines(heap size 16GB) with 400GB EBS based SSD storage.
We recently switched to 8c/64GB(heap size 32GB ) which has better processor and to our surprise we found that our search latency increased from 40ms to 70ms.
I checked that Heap, GC & CPU metrics are fine, infact heap usage is very less.
I also checked that compressed oops pointer flag was true for the JVM.

Is there any possible explanation for this?
PS: Feel free to ask for any sort of clarifications. Any help would be great for me.

2

Heap should be no larger than around 30GB so that you benefit from compressed pointers. Try lowering it a bit to see if it makes a difference. Elasticsearch is s as Leo often limited by disk I/O rather than CPU, so more cores might not necessarily mean better latency unless you were CPU bound before.

3

As pointed in the details, I see that compressed oops pointer flag was true for the JVM.
So I don't think that is an issue.

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.