Scroll query concurrently

Elastic Stack Elasticsearch
1

Can I share a scroll id between multiple clients? If two clients ask the
next batch of the scroll at the same time, will they get different results
or is there a danger they will get duplicates? If there is no possibility
of duplicates, I could share a scroll id across machines and process all
records in my index in parallel...

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/a8a50d19-8a36-4f06-ae46-bff91091daf3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

FYI, the answer is no.

I did a simple test using pmap to to make multiple scroll queries in
parallel. Out of 500 results, there were only 221 distinct values, so more
than half were duplicates :slight_smile:

On Wednesday, January 28, 2015 at 12:56:21 PM UTC+1, David Smith wrote:

Can I share a scroll id between multiple clients? If two clients ask the
next batch of the scroll at the same time, will they get different results
or is there a danger they will get duplicates? If there is no possibility
of duplicates, I could share a scroll id across machines and process all
records in my index in parallel...

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/aec67ece-1c26-4de9-a6fb-dbe4dbb9af42%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.