# \#rollups **URL:** https://discuss.elastic.co/tag/rollups/77.md [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) --- ## [How to query rollup jobs progress](https://discuss.elastic.co/t/how-to-query-rollup-jobs-progress/369176)
**Author:** [@marcosrobles-qo](https://discuss.elastic.co/u/marcosrobles-qo)\ **Replies:** 0\ **Last updated:** [October 21, 2024, 6:09pm UTC](https://discuss.elastic.co/t/how-to-query-rollup-jobs-progress/369176 "2024-10-21T18:09:08Z")
Hello Elastic Community, I am currently working with Elasticsearch and I need some assistance with monitoring the progress of my rollup jobs. I have set up a rollup job with the following configuration: { "config": {… --- ## [Solution: Unable to delete rollup job due to spaces in job ID](https://discuss.elastic.co/t/solution-unable-to-delete-rollup-job-due-to-spaces-in-job-id/362032)
**Author:** [@Akshay\_Kulkarni](https://discuss.elastic.co/u/Akshay_Kulkarni)\ **Replies:** 0\ **Last updated:** [June 25, 2024, 2:20pm UTC](https://discuss.elastic.co/t/solution-unable-to-delete-rollup-job-due-to-spaces-in-job-id/362032 "2024-06-25T14:20:30Z")
Hi, Posting solution for below issue. Solution: Get all tasks. GET /\_tasks Identify rollup task. ctrl + f \> rollup Kill the roll up task by task id. Note: Dont copy value from "id" field. Use entire Id mention… --- ## [Stable ELK version from 7.11.2 to what next?](https://discuss.elastic.co/t/stable-elk-version-from-7-11-2-to-what-next/358639)
**Author:** [@Manoilayans](https://discuss.elastic.co/u/Manoilayans)\ **Replies:** 2\ **Last updated:** [May 2, 2024, 12:46pm UTC](https://discuss.elastic.co/t/stable-elk-version-from-7-11-2-to-what-next/358639 "2024-05-02T12:46:38Z")
We have ELK stack version 7.11.2 with Enterprise license.. Planning to upgrade and I wish to know what should be ELK version we need to upgrade into. Since, we have customers with ELK features, SSO, ElastAlert, Visualiz… --- ## [Use ilm for rollup indices](https://discuss.elastic.co/t/use-ilm-for-rollup-indices/356904)
**Author:** [@lstoneir](https://discuss.elastic.co/u/lstoneir)\ **Replies:** 0\ **Last updated:** [April 6, 2024, 12:38pm UTC](https://discuss.elastic.co/t/use-ilm-for-rollup-indices/356904 "2024-04-06T12:38:04Z")
Hi everybody, Is there any way to use ilm in rollup indices !? --- ## [Rollup or downsampling](https://discuss.elastic.co/t/rollup-or-downsampling/350342)
**Author:** [@EdRayQO](https://discuss.elastic.co/u/EdRayQO)\ **Replies:** 0\ **Last updated:** [January 3, 2024, 11:17pm UTC](https://discuss.elastic.co/t/rollup-or-downsampling/350342 "2024-01-03T23:17:07Z")
I'm trying to compress log data I have in a monitoring cluster and that is configured to be erased after 7 days, and I'm not sure which path should I follow between rollup jobs and down sampling in order to compress that… --- ## [Why data is inserting in index in delete phase, why not new index ... are we missing any configuration?](https://discuss.elastic.co/t/why-data-is-inserting-in-index-in-delete-phase-why-not-new-index-are-we-missing-any-configuration/350054)
**Author:** [@Shahzaib\_Khan](https://discuss.elastic.co/u/Shahzaib_Khan)\ **Replies:** 3\ **Last updated:** [January 1, 2024, 7:06am UTC](https://discuss.elastic.co/t/why-data-is-inserting-in-index-in-delete-phase-why-not-new-index-are-we-missing-any-configuration/350054 "2024-01-01T07:06:07Z")
I am facing an issue with Elasticsearch where, even after the rollover phase is successfully completed and a new index is created, data continues to be inserted into the old rollover index instead of the newly created in… --- ## [Is it possible to use custom interval using ilm on downsample](https://discuss.elastic.co/t/is-it-possible-to-use-custom-interval-using-ilm-on-downsample/350052)
**Author:** [@yuswanul](https://discuss.elastic.co/u/yuswanul)\ **Replies:** 0\ **Last updated:** [December 28, 2023, 7:32am UTC](https://discuss.elastic.co/t/is-it-possible-to-use-custom-interval-using-ilm-on-downsample/350052 "2023-12-28T07:32:09Z")
i see in the documentation that said rollups are deprecated and will be removed in a future version. and as a replacement, I can use downsampling instead. but I think the downsample didn't fulfill my use case. i have cre… --- ## [Index rollover due to policy does not copy mapping](https://discuss.elastic.co/t/index-rollover-due-to-policy-does-not-copy-mapping/348932)
**Author:** [@twilight](https://discuss.elastic.co/u/twilight)\ **Replies:** 15\ **Last updated:** [December 9, 2023, 3:18pm UTC](https://discuss.elastic.co/t/index-rollover-due-to-policy-does-not-copy-mapping/348932 "2023-12-09T15:18:39Z")
Hello, I have setup an index with a 'date' field in milliseconds (epoch\_millis), I did set this explicitly while creating the index. Then I attached a policy to rollover after x days. After x days, a new index is creat… --- ## [Maximum document for rollup job](https://discuss.elastic.co/t/maximum-document-for-rollup-job/346169)
**Author:** [@yuswanul](https://discuss.elastic.co/u/yuswanul)\ **Replies:** 0\ **Last updated:** [November 1, 2023, 4:05am UTC](https://discuss.elastic.co/t/maximum-document-for-rollup-job/346169 "2023-11-01T04:05:45Z")
Hello there, I want to ask about rollup job. Currently, i've been created a rollup job with 1s interval and 5 fields on terms and 2 fields for metrics and 60.000 page size. And the total document for the production inde… --- ## [Rollup vs Transform](https://discuss.elastic.co/t/rollup-vs-transform/340537)
**Author:** [@ajitesh](https://discuss.elastic.co/u/ajitesh)\ **Replies:** 1\ **Last updated:** [August 14, 2023, 3:23pm UTC](https://discuss.elastic.co/t/rollup-vs-transform/340537 "2023-08-14T15:23:09Z")
I have a use case where I have a nested aggregation query, now I want to ingest the data for all the aggregation results into a new index. I was going through the Elasticsearch documents and found out that Aggregation do… --- ## [Combine data older then x days](https://discuss.elastic.co/t/combine-data-older-then-x-days/339804)
**Author:** [@Soren\_vdc](https://discuss.elastic.co/u/Soren_vdc)\ **Replies:** 0\ **Last updated:** [August 1, 2023, 1:53pm UTC](https://discuss.elastic.co/t/combine-data-older-then-x-days/339804 "2023-08-01T13:53:18Z")
Hi, I want to combine network data (based on scr/dst/port) to an aggregated index after 20 days. This to decrease the disk usage of this indices but still have the combined data available for specific searches. I'm che… --- ## [Rollup job is not working if page size is greater than 65000](https://discuss.elastic.co/t/rollup-job-is-not-working-if-page-size-is-greater-than-65000/339367)
**Author:** [@akhil\_reddy](https://discuss.elastic.co/u/akhil_reddy)\ **Replies:** 0\ **Last updated:** [July 27, 2023, 3:08am UTC](https://discuss.elastic.co/t/rollup-job-is-not-working-if-page-size-is-greater-than-65000/339367 "2023-07-27T03:08:48Z")
Hi, I am facing an issue with rollup jobs. If I give the page size as 100000 it is not working and if I give the size as 65000 it works. I tried with different numbers like 70000, 50000 - when the number is greater than… --- ## [How to use terms as filter item?](https://discuss.elastic.co/t/how-to-use-terms-as-filter-item/335417)
**Author:** [@kain\_su](https://discuss.elastic.co/u/kain_su)\ **Replies:** 4\ **Last updated:** [June 16, 2023, 5:41am UTC](https://discuss.elastic.co/t/how-to-use-terms-as-filter-item/335417 "2023-06-16T05:41:31Z")
When I just filter terms\_A : \*, lens returns this error response, but I can show count of terms\_A records, does anyone knows what happened? --- ## [Rollup Job - New data not Rolled Up](https://discuss.elastic.co/t/rollup-job-new-data-not-rolled-up/330006)
**Author:** [@Vitor\_Nilson](https://discuss.elastic.co/u/Vitor_Nilson)\ **Replies:** 3\ **Last updated:** [April 19, 2023, 11:17am UTC](https://discuss.elastic.co/t/rollup-job-new-data-not-rolled-up/330006 "2023-04-19T11:17:27Z")
Hello, I'm currently creating a rollup job to reduce storage costs in my company. The rollup job worked well, grouped by the fields that I specified. The problem is that only data older than 7 days is being rolled up t… --- ## [Rollup - date histogram issues](https://discuss.elastic.co/t/rollup-date-histogram-issues/328509)
**Author:** [@JeroenK](https://discuss.elastic.co/u/JeroenK)\ **Replies:** 5\ **Last updated:** [April 14, 2023, 3:47pm UTC](https://discuss.elastic.co/t/rollup-date-histogram-issues/328509 "2023-04-14T15:47:42Z")
I have a rollup job with the following settings: "groups": { "date\_histogram": { "field": "timestamp", "time\_zone": "Europe/Stockholm", "calendar\_interval"… --- ## [Inaccuracy and noises in elastic search rollup data](https://discuss.elastic.co/t/inaccuracy-and-noises-in-elastic-search-rollup-data/328014)
**Author:** [@Mehrab\_Azad](https://discuss.elastic.co/u/Mehrab_Azad)\ **Replies:** 3\ **Last updated:** [March 28, 2023, 7:13am UTC](https://discuss.elastic.co/t/inaccuracy-and-noises-in-elastic-search-rollup-data/328014 "2023-03-28T07:13:38Z")
I am new to the ELK stack and Elasticsearch. I am currently storing nginx logs in Elasticsearch and using Kibana to visualize the total bytes over time. The purpose of this is to monitor traffic. To reduce storage requir… --- ## [Rollup Job when one of the Terms field is array of objects](https://discuss.elastic.co/t/rollup-job-when-one-of-the-terms-field-is-array-of-objects/328451)
**Author:** [@jiri\_whale](https://discuss.elastic.co/u/jiri_whale)\ **Replies:** 1\ **Last updated:** [March 24, 2023, 8:30pm UTC](https://discuss.elastic.co/t/rollup-job-when-one-of-the-terms-field-is-array-of-objects/328451 "2023-03-24T20:30:56Z")
I am trying to create a RollUp job from Kibana. In the Terms field where I have given multiple fields, in which one of the fields is of an array type (actually array of objects). How can I define which item/object of the… --- ## [Kibana rollup for MAX values](https://discuss.elastic.co/t/kibana-rollup-for-max-values/328228)
**Author:** [@thirty2](https://discuss.elastic.co/u/thirty2)\ **Replies:** 0\ **Last updated:** [March 22, 2023, 9:55am UTC](https://discuss.elastic.co/t/kibana-rollup-for-max-values/328228 "2023-03-22T09:55:19Z")
Hi, i have this problem with Kibana rollups: i have raw data each 5minutes, as you can see the MAX value from 19:00 till 20:00 is 155.775 When i configured rollup job with Interval 60m in the roollup index as MAX v… --- ## [Is it okay to keep too frequent rollups?](https://discuss.elastic.co/t/is-it-okay-to-keep-too-frequent-rollups/322909)
**Author:** [@mafia-task-pasta](https://discuss.elastic.co/u/mafia-task-pasta)\ **Replies:** 0\ **Last updated:** [January 11, 2023, 10:48am UTC](https://discuss.elastic.co/t/is-it-okay-to-keep-too-frequent-rollups/322909 "2023-01-11T10:48:21Z")
I have a lots of data in elasticsearch for which I am adding a new rollups. It is taking a lot of time to catch up on all historical data. I am running it at 1 hour interval using the cron expression and the page size if… --- ## [Rollup Jobs Performance](https://discuss.elastic.co/t/rollup-jobs-performance/321019)
**Author:** [@mguggi](https://discuss.elastic.co/u/mguggi)\ **Replies:** 5\ **Last updated:** [December 23, 2022, 12:29pm UTC](https://discuss.elastic.co/t/rollup-jobs-performance/321019 "2022-12-23T12:29:18Z")
I'm having issues with the performance of Rollup Jobs on my system. The Data Quantity is quite large Job(1): rough 2,5M docs in 15 minutes / 300gb per day Job(2): rough 250T docs in 15 minutes / 40gb per day I'm tryin… --- ## [Conflict occur with rollup job](https://discuss.elastic.co/t/conflict-occur-with-rollup-job/319817)
**Author:** [@Nitin08bisht](https://discuss.elastic.co/u/Nitin08bisht)\ **Replies:** 4\ **Last updated:** [December 13, 2022, 6:50pm UTC](https://discuss.elastic.co/t/conflict-occur-with-rollup-job/319817 "2022-12-13T18:50:39Z")
Hi Team, I am using elasticsearch and kibana 7.16.2 and I'm facing conflicts on index pattern while creating process wise Visualization dashboard. Below I have describe two scenario, In which I faced conflict on scenar… --- ## [Rollup Index Empty Data](https://discuss.elastic.co/t/rollup-index-empty-data/320860)
**Author:** [@Ingram\_Gultom](https://discuss.elastic.co/u/Ingram_Gultom)\ **Replies:** 0\ **Last updated:** [December 9, 2022, 6:37am UTC](https://discuss.elastic.co/t/rollup-index-empty-data/320860 "2022-12-09T06:37:05Z")
Hi I created rollup jobs for my index xxx\_113 but the rollups index is empty { - "jobs": \[ - { - "config": { - "id": "test\_rollup", "index\_pattern": "xxx\_113", "rollup\_index": "… --- ## [Rollup Jobs losing data](https://discuss.elastic.co/t/rollup-jobs-losing-data/320072)
**Author:** [@nicfr9](https://discuss.elastic.co/u/nicfr9)\ **Replies:** 1\ **Last updated:** [November 30, 2022, 9:09am UTC](https://discuss.elastic.co/t/rollup-jobs-losing-data/320072 "2022-11-30T09:09:01Z")
Hi everybody, I have a big problem with rollup jobs. When I try to execute a rollup job of 51 million recors, I don't get the expected result. I have various terms and metrics to aggregate; down below you can check th… --- ## [How can we roll up all the aggregation data indices have?](https://discuss.elastic.co/t/how-can-we-roll-up-all-the-aggregation-data-indices-have/317436)
**Author:** [@Nitin08bisht](https://discuss.elastic.co/u/Nitin08bisht)\ **Replies:** 5\ **Last updated:** [October 31, 2022, 2:13am UTC](https://discuss.elastic.co/t/how-can-we-roll-up-all-the-aggregation-data-indices-have/317436 "2022-10-31T02:13:30Z")
How can we roll up all the aggregation data indices have? And If we do rollup of all the aggregation which indices have than will there be any difference between the size of actual and rollup indices or not? --- ## [Rollup with max/min aggregation on @timestamp field typed as "float"](https://discuss.elastic.co/t/rollup-with-max-min-aggregation-on-timestamp-field-typed-as-float/317735)
**Author:** [@ISim](https://discuss.elastic.co/u/ISim)\ **Replies:** 3\ **Last updated:** [November 11, 2022, 1:46pm UTC](https://discuss.elastic.co/t/rollup-with-max-min-aggregation-on-timestamp-field-typed-as-float/317735 "2022-11-11T13:46:44Z")
Hello all, I have a index with accounting events with @timestamp (type "date"). There is a high volume of events so I created rollup job (elasticsearch 7.17.3) with "date\_histogram" : { "d… --- ## [Missing terms in rollup\_search terms aggregations](https://discuss.elastic.co/t/missing-terms-in-rollup-search-terms-aggregations/318314)
**Author:** [@sam.hession](https://discuss.elastic.co/u/sam.hession)\ **Replies:** 0\ **Last updated:** [November 7, 2022, 10:27am UTC](https://discuss.elastic.co/t/missing-terms-in-rollup-search-terms-aggregations/318314 "2022-11-07T10:27:09Z")
Hello, This is a request for a follow-up on a previously posted topic, also documented and acknowledged in an issue on the ElasticSearch repo. My team has encountered this known issue with rollup\_search terms aggregati… --- ## [ES 7.16 Rolling up multiple date fields](https://discuss.elastic.co/t/es-7-16-rolling-up-multiple-date-fields/316510)
**Author:** [@sam.hession](https://discuss.elastic.co/u/sam.hession)\ **Replies:** 1\ **Last updated:** [November 7, 2022, 9:53am UTC](https://discuss.elastic.co/t/es-7-16-rolling-up-multiple-date-fields/316510 "2022-11-07T09:53:27Z")
Hello Team, I'm currently working with rollup jobs in ES 7.16.2 and I'm looking to group on multiple date properties. It seems that this isn't currently possible with the API only supporting a single data\_histogram fiel… --- ## [Is there any way to do automation for rollup job creation?](https://discuss.elastic.co/t/is-there-any-way-to-do-automation-for-rollup-job-creation/317767)
**Author:** [@Nitin08bisht](https://discuss.elastic.co/u/Nitin08bisht)\ **Replies:** 1\ **Last updated:** [October 31, 2022, 1:57am UTC](https://discuss.elastic.co/t/is-there-any-way-to-do-automation-for-rollup-job-creation/317767 "2022-10-31T01:57:29Z")
Hi, I want to know that is there any way to do automation for rollup job creation? Because creation of rollup job is taking much time when we have to create jobs for taking rollup of each month data separately. --- ## [How can we get data of specific month from rollup index?](https://discuss.elastic.co/t/how-can-we-get-data-of-specific-month-from-rollup-index/317487)
**Author:** [@Nitin08bisht](https://discuss.elastic.co/u/Nitin08bisht)\ **Replies:** 1\ **Last updated:** [October 31, 2022, 1:49am UTC](https://discuss.elastic.co/t/how-can-we-get-data-of-specific-month-from-rollup-index/317487 "2022-10-31T01:49:10Z")
Rollup index store months or years of data. And if we want specific month data from that rollup index then how we can get it from? --- ## [ES 7.17.6 Is it possible to update a rollup job?](https://discuss.elastic.co/t/es-7-17-6-is-it-possible-to-update-a-rollup-job/316001)
**Author:** [@ld\_pvl](https://discuss.elastic.co/u/ld_pvl)\ **Replies:** 1\ **Last updated:** [October 25, 2022, 6:14pm UTC](https://discuss.elastic.co/t/es-7-17-6-is-it-possible-to-update-a-rollup-job/316001 "2022-10-25T18:14:26Z")
Hi Team, I'm trying to update the page\_size of an existing rollup job but I don't see an API available for that. Is it possible? [Next page](https://discuss.elastic.co/tag/rollups/77.md?match_all_tags=true&page=1&tags%5B%5D=rollups)