Does Scan API support doc key sort order

Elastic Stack Elasticsearch
1

Hello,

I need to compare ES with source data and I would like to do it in one pass
if possible which means I need to pull my data from ES in the doc key
order.
Is it possible to do it with SCAN API or scan order is undefined (based on
how it is stored in lucene segments?)

thank you,
Alex

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/058dbe1a-2e17-487a-b31a-0dc4b8112d22%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

2

Hi Alex,

The Scan API indeed works based on the order of documents in the lucene
segments. This is the most efficient way to get bulks of data which is the
intended use case of this API.

Once 1.1 is released you'd be able to efficiently scroll while maintaining
order (see this
issue: Improve scroll search by using Lucene's IndexSearcher#searchAfter(...) · Issue #4940 · elastic/elasticsearch · GitHub )

Cheers,
Boaz

On Monday, March 3, 2014 3:35:08 PM UTC+1, AlexR wrote:

Hello,

I need to compare ES with source data and I would like to do it in one
pass if possible which means I need to pull my data from ES in the doc key
order.
Is it possible to do it with SCAN API or scan order is undefined (based
on how it is stored in lucene segments?)

thank you,
Alex

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/fb70812e-298a-4b74-b1f5-4c3c38e18adc%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.