I'm trying to reindex documents of widely variable size (from a few bytes
to a few outliers over 200 MB). I want to keep my scroll size as high as
possible to maximize throughput, but I need to keep the returned result set
under a memory threshold, so when those outliers show up I want the scroll
size temporarily tapered. Is that possible? Could it be implemented in the
future? I discovered that a scroll cannot be "retried" if it comes back too
large - once some documents are returned, they can never be returned again
for the same scroll - but in a 2011 comment Shay alluded it might be doable:
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to email@example.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/19b14ae0-4caf-46b3-a804-8b8634cea055%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.