Ordering record inserts via global counter, datetime stamp?


(byuva) #1

I would like to do some asynchronous, incremental processing of documents once they are inserted into the index. I would like to be able to query ES and essentially ask "give me all the documents added since this 'point in time' or since this 'global counter' to which I've already processed"). Is the only way to do this by supplying client side timestamps to each indexed record and making sure to keep all the client clocks in sync?

-b


(Shay Banon) #2

Yes, you need to provide timestamps and then use them when you query.

On Wed, Dec 22, 2010 at 9:14 PM, byuva brian@merrells.org wrote:

I would like to do some asynchronous, incremental processing of documents
once they are inserted into the index. I would like to be able to query
ES
and essentially ask "give me all the documents added since this 'point in
time' or since this 'global counter' to which I've already processed"). Is
the only way to do this by supplying client side timestamps to each indexed
record and making sure to keep all the client clocks in sync?

-b

View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/Ordering-record-inserts-via-global-counter-datetime-stamp-tp2133000p2133000.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.


(system) #3