Thank you for the additional options Jörg
On Saturday, December 7, 2013 3:40:49 AM UTC-8, Jörg Prante wrote:
There are more alternatives:
"sliding window" - organize index names to create incremental indexing
each 15 minutes. By selecting the index name by timestamp, you do not need
to dump anything for getting a subset."versioning" - use explicit versioning for detecting modifications.
Versions are long values, so they could also represent timestamps. With
scan/scroll, examine document versions if they match a criteria for being
"new". This approach does not scale well with index size."logging" - another method would be to add logging statements, maybe near
the translog, collect the logs and process them externally. This requires a
few additional code to the ES core. Collecting logs may be tedious.Jörg
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/05eff500-d3e0-4aa6-b020-11b970268d83%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.