Please format your code, logs or configuration files using </>
icon as explained in this guide and not the citation button. It will make your post more readable.
Or use markdown style like:
```
CODE
```
This is the icon to use if you are not using markdown format:
That's a huge difference indeed.
I'd may be try to decrease the size
for search_after
. But for your use case anyway, I'd use the scroll API as your goal is to extract everything.
Pinging @jimczi as he might know what is happening.