Pagination of continuously updating data

Elastic Stack Elasticsearch
#1

I am new to ES and have a requirement to store real-time data streams. This
is time-stamp based data.

Can anyone advise on the best way to support pagination given that the
results set will be updating continuously?

I understand that Twitter and Facebook etc use cursor based pagination. I
was wondering if there was a similar concept within ES?

Many thanks, Ben.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

#2

Hi Ben,
you can use a scroll search and keep in memory a certain point-in-time
snapshot of the index so that you get consistent pagination. It might be
expensive though. Check it out:
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-request-scroll.html
.

On Sunday, November 3, 2013 7:33:20 PM UTC+1, Ben wrote:

I am new to ES and have a requirement to store real-time data streams.
This is time-stamp based data.

Can anyone advise on the best way to support pagination given that the
results set will be updating continuously?

I understand that Twitter and Facebook etc use cursor based pagination. I
was wondering if there was a similar concept within ES?

Many thanks, Ben.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

#3

Thanks Luca.

I noticed on that page:

Scrolling is not intended for real time user requests

Unfortunately that's exactly what I require i.e. user driven request via
another API. I think I may have to look for some sort of time based
pagination instead.

Regards, Ben.

On Monday, November 4, 2013 5:27:19 PM UTC, Luca Cavanna wrote:

Hi Ben,
you can use a scroll search and keep in memory a certain point-in-time
snapshot of the index so that you get consistent pagination. It might be
expensive though. Check it out:
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-request-scroll.html.

On Sunday, November 3, 2013 7:33:20 PM UTC+1, Ben wrote:

I am new to ES and have a requirement to store real-time data streams.
This is time-stamp based data.

Can anyone advise on the best way to support pagination given that the
results set will be updating continuously?

I understand that Twitter and Facebook etc use cursor based pagination. I
was wondering if there was a similar concept within ES?

Many thanks, Ben.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

#4

Any luck Ben?

Looks like I posted a similar question.

https://groups.google.com/forum/#!topic/elasticsearch/mUwfSQvKnDw

On Sunday, November 3, 2013 1:33:20 PM UTC-5, Ben wrote:

I am new to ES and have a requirement to store real-time data streams.
This is time-stamp based data.

Can anyone advise on the best way to support pagination given that the
results set will be updating continuously?

I understand that Twitter and Facebook etc use cursor based pagination. I
was wondering if there was a similar concept within ES?

Many thanks, Ben.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1fe5a16e-4df0-4436-8e8d-153212e336f7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

#5