Hi @skv325
Check this topic there's already a reply about your error and how to solve it.
May be. May be not that longer that you can imagine.
I think it's wrong. The opposite is true. I mean that loading on the coordinated node 10k docs instead of 1m of docs for example will consume much less memory.
Once you get back 10k docs in your application, just stream them to the other process/destination you want.
What kind of error? You mean elasticsearch does not work anymore? Then you need to fix the root of the problem not trying to work around it.
I think you are talking about so…
And here the documentation about pagination if you want to read more about:
There's more explanation on stackoverflow and on this forum if you search about your error:
elasticsearch