I have to parse a document which has more than 10000 hits. The natural choice was to opt for scroll api.
I have read the documentation from elastic and have done the following:
This gave me a scroll id.
I have stored that scrollID in a variable and did the following:
response = requests.post(SearchExp)
However, everytime I run the program, I get the same 100 results [since size=100].
What should I do to get the next set of results and read the full document above 10000 ??