We have created an index and are querying the index to display the complete dataset. However, we have encountered performance issues, as we are dealing with 1 million records in response to user search queries. To address this, we are making changes to show only the top 10,000 records and are explor…

Hi, Yes, you can limit your search results to the top 10,000 records. This is actually the default limit in Elasticsearch for a single query. If you need to retrieve more than 10,000 results, you would typically use the Scroll or Search After API, but in your case, it sounds like you want to avoid …

Welcome! I'm curious. Why a end user would need to see 10000 documents instead of just looking at the first ones?

Thank you @yago82 and @dadoonet for your reply. @yago82 we don't want to show all the 10k results at the same time we have the pagination feature. Hope this way we can not use the size set to 10k? that is the reason we are using the max window size of 10K even though the default value is 10K it d…

We are providing the info for all over the USA. If the user requires to see only VA info we have filters but for default we provide complete USA info. That is the reason we are seeing huge numbers of result sets.

We have the pagination feature. We don't display more than 500 records per page. The default page size is 10.

So how a user navigates to page 9990? By chance? Or does he click 9990 times on the next button?

I am sorry to say this, but yes we are using pagination to navigate. With that, we are trying to implement to receive top 10k results. Get the Filters for top 10K Perform Sorting if required for only the top 10K Can we achieve this?

I guess you can sort on the client side.

Thank you. How can I achieve the filters?

Max Window Size is Set to 10000 but the Terms aggregations is giving single filter value larger than max window size.

Elastic Stack Elasticsearch

dadoonet (David Pilato) December 19, 2023, 7:20pm 6

And what a user is going to do with 20000 documents for example? Are they consuming those documents in another tool? Or display all the documents on the result page? Are they going to paginate over the resultset?

Topic		Replies	Views
Limit the result of Elasticsearch query Elasticsearch	4	1008	July 11, 2016
Displaying top 1000 results only in elastic search Elasticsearch	5	7958	October 31, 2016
Result window is too large, from + size must be less than or equal to: [10000] but was [10050] Elasticsearch	8	25980	March 26, 2018
Limiting query results Elasticsearch	6	411	August 14, 2014
Pulling more than 10000 records from elasticsearch query Elasticsearch	1	32015	May 14, 2019

Max Window Size is Set to 10000 but the Terms aggregations is giving single filter value larger than max window size.

Related topics