Paging via Lucene TopDocs.searchAfter() method


(Brett Wooldridge) #1

Does ES support the "new" Lucene (3.5, 4.0) paging API described here under
the covers?

https://issues.apache.org/jira/browse/LUCENE-2215

It seems like this is the only scalable way to support paging. I notice
that ES has a "scroll" operation, but the documentation also states:

"Scrolling is not intended for real time user requests, it is intended for
cases like scrolling over large portions of data that exists within
elasticsearch to reindex it for example."

The 'search' operation's from() and to() options, from my educated guess,
uses a skipping type method, which is likely to fall over for large results
(this was the reason the new paging API was created).

Brett


(system) #2