Python ElasticSearch - How to increase query size limit

[test_tester]

Hi,

I'm currently writing a python script to extract out my elasticsearch documents and the following are my ES parameters that involves the sizing

Copy to clipboard

response = es.search(index= es_index_list,scroll='5m', size='10000', body=search_index, request_timeout=60 )

As you can see my current size is 10000 and my python script can't extract anything beyond it. Is there a way to go about this?

Regards

[aaron-nimocks]

Above 10,000 results you would need to use the Scroll API or Search After.

You can also increase the limit but that is not recommended.

[test_tester]

Hi Aaron,

Thanks for answering.

Can you advise me how do I apply the usage of Scroll API/Search After in a python script?
Do you happen to have an example I can refer to?

Regards

[aaron-nimocks]

I can't speak for these examples but found this and that.

[test_tester]

Thanks for answering, will have a look at it.