Creation and update timestamps for each doc?

Elastic Stack Elasticsearch
2

You could try to create an ingest pipeline for setting the created and updated timestamps, in a pipeline you can both add new document fields and modify old ones. Ref:

https://www.elastic.co/guide/en/elasticsearch/reference/5.5/put-pipeline-api.html

You can create fairly complex scripts using the painless scripting language inside such pipelines. Here's an example of a pipeline we use at my company for setting the processing time on our documents:

{
"description" : "Sets the document processingtime",
"processors" : [
{
"script" : {
"lang" : "painless",
"inline" : "DateFormat df = new SimpleDateFormat("yyyy-MM-dd'T'HH:mm:ss.SSS'Z'");\ndf.setTimeZone(TimeZone.getTimeZone("UTC"));\nDate date = new Date();\nctx.processingtime = df.format(date);"
}
}
]
}

It's fairly efficient too as we run millions of docs through this pipeline every day without any noticeable delays in our indexing.

Good luck!

1 Like