# ES 7.4 rollups jobs for new created indexes

**URL:** <https://discuss.elastic.co/t/es-7-4-rollups-jobs-for-new-created-indexes/226287>\
**Category:** Elasticsearch\
**Created:** [April 2, 2020, 9:10pm UTC](https://discuss.elastic.co/t/es-7-4-rollups-jobs-for-new-created-indexes/226287 "2020-04-02T21:10:09Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![marianok](https://avatars.discourse-cdn.com/v4/letter/m/848f3c/32.png) [@marianok](https://discuss.elastic.co/u/marianok)\
**Post date:** [April 2, 2020, 9:10pm UTC](https://discuss.elastic.co/t/es-7-4-rollups-jobs-for-new-created-indexes/226287/1 "2020-04-02T21:10:09Z")

</div>

Hi,

we're looking to use the rollups functionality (on ES 7.4) in order the reduce size of the data for our search queries.  
We have a monthly lifecycle strategy for our data: each month data is stored in a separated index with a naming `[index_name]_[year]-[month]`. We usually execute search queries using a group of these indices, and want to replace this searches using a rollup index plus 1 or 2 indexes.  
In order to do this, we are trying to create a rollup job using as "index\_pattern": `[index_name]_*`. The documents for existent indices are processed by the job, but no document included on a new index created after the job.  
If we create another job after the new index is created, these new documents are processed.  
We also wanted to use data filtered using a filter alias, created with similar naming pattern on each index, and using a similar value for "index\_pattern", but same issue.

Is it possible for a rollup job configured with a "index\_pattern" to process data for future indices to be created (that apply in the same "index\_pattern")? Or only it processed new data for the existent indices when the job was created?

Any suggestion to what we are trying to accomplish? Create for each new index a new rollup job using same "rollup\_index"? Or there could be some issue to use same rollup index for different rollup jobs?

Thanks,  
Mariano

---

<div class="post-metadata">

**Author:** ![marianok](https://avatars.discourse-cdn.com/v4/letter/m/848f3c/32.png) [@marianok](https://discuss.elastic.co/u/marianok)\
**Post date:** [April 8, 2020, 8:58pm UTC](https://discuss.elastic.co/t/es-7-4-rollups-jobs-for-new-created-indexes/226287/2 "2020-04-08T20:58:19Z")

</div>

An update: I tried using a new rollup job for each index, all with the same rollup index. And I found a weird behavior: on first job I can see the results for the index correctly (using `_rolllup_search` endpoint). But, after I start a second job for another index the result for the same query dissapear from the `_rolllup_search` endpoint. If I use `_search` directly into the rollup index, the docs are still there. It seems that `_rolllup_search` started to ignore them.

Any ideas?

Thanks!

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 6, 2020, 8:58pm UTC](https://discuss.elastic.co/t/es-7-4-rollups-jobs-for-new-created-indexes/226287/3 "2020-05-06T20:58:19Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.