Is it okay to keep too frequent rollups?

I have a lots of data in elasticsearch for which I am adding a new rollups. It is taking a lot of time to catch up on all historical data. I am running it at 1 hour interval using the cron expression and the page size if 10k. I am afraid that if two different rollup processes overlap, there could be incorrect intersection between two processes.

Is this something that is taken care of internally by elastic software, or do I need to ensure that the interval is large enough for each run of the rollup to not overlap.

My objective is to keep rollups as frequent as possible so that I can get it finished on older data at the earliest.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.