Python ElasticSearch - How to increase query size limit

Hi,

I'm currently writing a python script to extract out my elasticsearch documents and the following are my ES parameters that involves the sizing

Copy to clipboard

response = es.search(index= es_index_list,scroll='5m', size='10000', body=search_index, request_timeout=60 )

As you can see my current size is 10000 and my python script can't extract anything beyond it. Is there a way to go about this?

Regards

Above 10,000 results you would need to use the Scroll API or Search After.

You can also increase the limit but that is not recommended.

1 Like

Hi Aaron,

Thanks for answering.

Can you advise me how do I apply the usage of Scroll API/Search After in a python script?
Do you happen to have an example I can refer to?

Regards

I can't speak for these examples but found this and that.

Thanks for answering, will have a look at it.

1 Like