Elasticsearch Result Size

Elastic Stack Elasticsearch
2

You want to do a scan and scroll search. I've just had to do the same thing in python, it might look something like this for you

es = Elasticsearch([{'host': 'localhost', 'port': 9200}])
res = es.search(index="college", doc_type='people', body=doc, scroll='60s', search_type='scan')

results = []
scroll_size = res['hits']['total']

while (scroll_size > 0):
    try:
        scroll_id = res['_scroll_id']
        res = es.scroll(scroll_id=scroll_id, scroll='60s')
        results += res['hits']['hits']
        scroll_size = len(res['hits']['hits'])
    except: 
        break

You could also look at using the scan helper

2 Likes