# Enrich-Policy with daily changes in reference data

**URL:** <https://discuss.elastic.co/t/enrich-policy-with-daily-changes-in-reference-data/269474>\
**Category:** Elasticsearch\
**Created:** [April 7, 2021, 1:42pm UTC](https://discuss.elastic.co/t/enrich-policy-with-daily-changes-in-reference-data/269474 "2021-04-07T13:42:24Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Oren\_Zomer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/oren_zomer/32/86688_2.png) [@Oren\_Zomer](https://discuss.elastic.co/u/Oren_Zomer)\
**Post date:** [April 7, 2021, 1:42pm UTC](https://discuss.elastic.co/t/enrich-policy-with-daily-changes-in-reference-data/269474/1 "2021-04-07T13:42:24Z")

</div>

We are trying to create an enrich-processor to add more data to our event documents, based on an existing reference data that may contain ~10k documents.  
I've read the example in:

> **[Introducing the enrich processor for Elasticsearch ingest nodes | Elastic Blog](https://www.elastic.co/blog/introducing-the-enrich-processor-for-elasticsearch-ingest-nodes)**
>
> Learn how to use the new enrich processor for ingest node. This new feature allows you to enrich Elasticsearch documents while they're indexed using reference data.

However, in my case the reference data changes, at least once a day. Following the [execute enrich policy api](https://www.elastic.co/guide/en/elasticsearch/reference/7.5/execute-enrich-policy-api.html#execute-enrich-policy-api-desc) , I understand that every time the reference data changes I should re-execute the enrich-policy to recreate the enrich-index.

Is this a scalable solution? Will re-executing the enrich-policy 10-20 times a day be too costly? Should I use this feature for this purpose or should we enrich the data in our own platform?

Thanks

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [April 7, 2021, 1:56pm UTC](https://discuss.elastic.co/t/enrich-policy-with-daily-changes-in-reference-data/269474/2 "2021-04-07T13:56:38Z")

</div>

10/20 times a day for a simple 10k docs index? That looks very fine to me.

---

<div class="post-metadata">

**Author:** ![Oren\_Zomer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/oren_zomer/32/86688_2.png) [@Oren\_Zomer](https://discuss.elastic.co/u/Oren_Zomer)\
**Post date:** [April 7, 2021, 1:57pm UTC](https://discuss.elastic.co/t/enrich-policy-with-daily-changes-in-reference-data/269474/3 "2021-04-07T13:57:44Z")

</div>

Thanks

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 5, 2021, 1:58pm UTC](https://discuss.elastic.co/t/enrich-policy-with-daily-changes-in-reference-data/269474/4 "2021-05-05T13:58:42Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.