I am trying to reindex data (around 150gb). it works for sometime and throws an error search_context_missing_exception. i tried logstash with elastcsearch as input and had similar issue.
i tried to reingest in chunks of 10mins. hardly 200000 events. it reingested for an hr without any issues but it failed for a very small chunk of size 80k. what are the scenarios it will loose scroll id? Please help.
Thanks.