We are using Elastic 5.5.2 and ingestion jobs are scheduled to run every day and each job lasts for around one hour. Once indexed, data is not mutated and the only action is to query data for our customers. Our data also has some geospatial fields. Our queries, perform some geospatial filtering, used to take around fifteen minutes per query on average few weeks ago but now it takes almost the double. After deep investigation on the issue, we found that the stats API for the indexes of the data, indexed after Feb 16, 2018, has the different response as compared to the previously indexed data.
You can find both responses in the attachment. The file named response_old contains the response of the stats API when called on the previously indexed data while response_new for the recently indexed data.
Any help will be appreciated.
Thanks
Mukrram Ur Rahman