Increase size limit - Python ElasticSearch

Elastic Stack Elasticsearch
1

Hi,

I'm currently writing a python script to extract out my elasticsearch documents and the following are my ES parameters that involves the sizing

response = es.search(index= es_index_list,scroll='5m', size='10000', body=search_index, request_timeout=60 )

As you can see my current size is 10000 and my python script can't extract anything beyond it. Is there a way to go about this?

Regards

1 Like
2

How many results do you want to get?

3

About 170k.

4

Am I still talking to the same person here? :stuck_out_tongue:

5

Hello warkolm.

I have about 140,000 documents in one index which I was hoping to extract all in one go.

Regards

6

Then don't use a search, use scan and scroll.

7

Do you perhaps have an reference I can use to integrate into a python script?

8

Elasticsearch and Scroll in Python | ObjectRocket looks like it should work.

9

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.