Timestamps

Elastic Stack Elasticsearch
1

Hi,

Are there any timestamps (at the index level) that can be used to
synchronize an index with its external "source"? For example, creation and
last update timestamps. I could manage them myself (using "_meta"), but I'm
wondering if es already provides something I could use.

Thanks,
Philippe

2

Do you mean per document or per whole index? Not sure I understand...
On Wednesday, April 27, 2011 at 6:45 PM, Philippe Laflamme wrote:

Hi,

Are there any timestamps (at the index level) that can be used to synchronize an index with its external "source"? For example, creation and last update timestamps. I could manage them myself (using "_meta"), but I'm wondering if es already provides something I could use.

Thanks,
Philippe

3

Hi,

Ideally, I'd have timestamps for both, but at least the ones for the whole
index. Having a "last update" on the index that would tell me when the last
write operation occurred (whatever it was).

I'd also have these at the document level, but I had planned to manage these
myself.

I'm indexing something that may change over time and I have timestamps on
that (created, last updated). I'd like to synchronize the source and its
index. I can store the source's timestamps in a "_meta" field of the mapping
and a document's timestamps in one of its fields. This way, I would know if
the index is up to date and, if not, which documents need to be updated.

Does that help understand what I'm trying to achieve?
Philippe

On Wed, Apr 27, 2011 at 13:15, Shay Banon shay.banon@elasticsearch.comwrote:

Do you mean per document or per whole index? Not sure I understand...

On Wednesday, April 27, 2011 at 6:45 PM, Philippe Laflamme wrote:

Hi,

Are there any timestamps (at the index level) that can be used to
synchronize an index with its external "source"? For example, creation and
last update timestamps. I could manage them myself (using "_meta"), but I'm
wondering if es already provides something I could use.

Thanks,
Philippe

4

Yes, and you can try and store latest timestamp in the _meta, sure. Another option is to use the statistical facet on the relevant timestamp field in the doc.
On Wednesday, April 27, 2011 at 8:34 PM, Philippe Laflamme wrote:

Hi,

Ideally, I'd have timestamps for both, but at least the ones for the whole index. Having a "last update" on the index that would tell me when the last write operation occurred (whatever it was).

I'd also have these at the document level, but I had planned to manage these myself.

I'm indexing something that may change over time and I have timestamps on that (created, last updated). I'd like to synchronize the source and its index. I can store the source's timestamps in a "_meta" field of the mapping and a document's timestamps in one of its fields. This way, I would know if the index is up to date and, if not, which documents need to be updated.

Does that help understand what I'm trying to achieve?
Philippe

On Wed, Apr 27, 2011 at 13:15, Shay Banon shay.banon@elasticsearch.com wrote:

Do you mean per document or per whole index? Not sure I understand...
On Wednesday, April 27, 2011 at 6:45 PM, Philippe Laflamme wrote:

Hi,

Are there any timestamps (at the index level) that can be used to synchronize an index with its external "source"? For example, creation and last update timestamps. I could manage them myself (using "_meta"), but I'm wondering if es already provides something I could use.

Thanks,
Philippe