I'm experiencing slowness after upgrading Elasticsearch from 6.5.4 to 7.10.2.
I can reproduce it in my local (using the official docker images) and also in AWS' managed clusters.
Here are the index mappings in v6 and v7. Due to the removal of the mapping type in v7, they look a bit different. However, the list of fields and types are the same.
V6 mapping:
http://jsonblob.com/1120601989569593344
V7 mapping:
http://jsonblob.com/1120602233610977280
Here is the sample query (sorry for the long query). Pls note that there is a nested field, and there are a couple of bucket aggregations in the query.
Search request:
http://jsonblob.com/1120602638478753792
Finally, here are the search results in v6 and v7. Only the top of the response body is different as highlighted.
I have checked the v7 release note and this forum desperately. There were some posts about slowness after an upgrade, but I couldn't find any relevant posts to me. Thank you so much for having a look. If you need any other stuff, pls let me know. Cheers!
Thanks @dadoonet. Yes, I can reproduce it even with 7.17.10. Here's the result after I ran the attached search request with k6 & 5 iterations per version.
It was my mistake on k6 metric labelling. The test was run with 7.17. This is the response when I send a GET request to the root path of my local ES server.
I disabled the cache because we're less likely to run the same aggregation query in production. Our ES queries are dynamically created with different fields and values based on the user's filter selection. Regardless, I'm attaching the results w and w/o cache with 20 iterations.
Without cache (20 iterations),
Local - ElasticSearch 6.5.4....: avg=2104.75 min=2070 med=2097 max=2168 p(90)=2142.2 p(95)=2162.3
Local - ElasticSearch 7.17.10...: avg=4305.3 min=4227 med=4317.5 max=4375 p(90)=4362.8 p(95)=4370.25
With cache (20 iterations)
Local - ElasticSearch 6.5.4....: avg=142.6 min=1 med=1 max=2830 p(90)=2 p(95)=143.4
Local - ElasticSearch 7.17.10...: avg=231.35 min=2 med=3 max=4545 p(90)=10.3 p(95)=248.15
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.