How to keep enrich index updated

Elastic Stack Elasticsearch
1

hi,

When we create a enrich index to use in enrich policy, is there a way to keep the enrich index updated based on changes happening in source index from which enrich index was created?

If I have to constantly update the enrich index, lets once a day, what would be the recommended way to do it?

Thanks!

2

How are you creating the enrich index? What is the relationship between the enrich index and the source index?

3

I created a enrich policy

PUT _enrich/policy/policy-myenrich1
{
  "match" : {
   "indices" : "my_index",
   "match_field" : "someidfield",
   "enrich_fields" : ["field1","field2","field3"]
  }
}

Then I executed the policy to create the enrich index. Then I created a enrich pipeline with this policy to populate the fields during indexing.

The enrich index has some user attributes. It will have 1 to 1 value from count perspective. But only have limited fields that I will use for data enrichment.

The field that I am using for match will be an user id field. So there will be cases, when there are new users added or some of these attributes changes for the users over period of time.

On the incoming payload, we will only have user id. So plan is to use the user id from input payload to populate remaining fields using enrich policy. But for this to work seamlessly, I need to ensure that enrich index is updated once a day so that its up to date.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.