Python ElasticSearch - How to increase query size limit

Elastic Stack Elasticsearch
1

Hi,

I'm currently writing a python script to extract out my elasticsearch documents and the following are my ES parameters that involves the sizing

Copy to clipboard

response = es.search(index= es_index_list,scroll='5m', size='10000', body=search_index, request_timeout=60 )

As you can see my current size is 10000 and my python script can't extract anything beyond it. Is there a way to go about this?

Regards

2

Above 10,000 results you would need to use the Scroll API or Search After.

You can also increase the limit but that is not recommended.

1 Like
3

Hi Aaron,

Thanks for answering.

Can you advise me how do I apply the usage of Scroll API/Search After in a python script?
Do you happen to have an example I can refer to?

Regards

4

I can't speak for these examples but found this and that.

5

Thanks for answering, will have a look at it.

1 Like
6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.