# Rollup Jobs extremly high CPU USage

**URL:** <https://discuss.elastic.co/t/rollup-jobs-extremly-high-cpu-usage/249359>\
**Category:** Elasticsearch\
**Created:** [September 21, 2020, 12:45pm UTC](https://discuss.elastic.co/t/rollup-jobs-extremly-high-cpu-usage/249359 "2020-09-21T12:45:36Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![michaelpietzsch](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/michaelpietzsch/32/72828_2.png) [@michaelpietzsch](https://discuss.elastic.co/u/michaelpietzsch)\
**Post date:** [September 21, 2020, 12:45pm UTC](https://discuss.elastic.co/t/rollup-jobs-extremly-high-cpu-usage/249359/1 "2020-09-21T12:45:36Z")

</div>

Hi Guys and Gals,

i've got a rollup job running on my cluster. Once its active CPU Spikes extremely. The cluster consists of 6 Dedicated data nodes. How can this happen?

Regards Michael

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [September 21, 2020, 9:32pm UTC](https://discuss.elastic.co/t/rollup-jobs-extremly-high-cpu-usage/249359/2 "2020-09-21T21:32:24Z")

</div>

I guess that depends on a bunch of things.  
What does the rollup job look like?  
How much data does it involve?  
How many shards and indices do you have?  
What are your node specs?

---

<div class="post-metadata">

**Author:** ![michaelpietzsch](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/michaelpietzsch/32/72828_2.png) [@michaelpietzsch](https://discuss.elastic.co/u/michaelpietzsch)\
**Post date:** [September 22, 2020, 7:20am UTC](https://discuss.elastic.co/t/rollup-jobs-extremly-high-cpu-usage/249359/3 "2020-09-22T07:20:35Z")

</div>

Hi, @warkolm  
We got 3nodes for Master purpuses only and 6 Worker nodes that have all other tasks  
Each node has  
8 Cores / 64 GB RAM / 6TB Fast storage

We are talking about 14 Days of data. Spread over multiple indices that are 50gb in size.  
Each index has 1 shard and 1 replica. And contains about 111116130 docs. We got about 50 indexes in those 14 days

```
{
      "index_pattern": "pingdirectory*",
      "rollup_index": "rolled-daily.pingdirectory",
      "cron": "*/30 * * * * ?",
      "page_size": 10000,
      "groups": {
        "date_histogram": {
          "fixed_interval": "24h",
          "field": "@timestamp",
          "delay": "5m",
          "time_zone": "UTC"
        },
        "terms": {
          "fields": [
            "messageType",
            "disconnectReason",
            "hostname",
            "operationType",
            "directorytype",
            "environment",
            "connectionID",
            "fromAddress.keyword",
            "requesterDN.keyword",
            "requesterIP.keyword"
          ]
        }
      },
      "metrics": [
        {
          "field": "processingTimeMillis",
          "metrics": [
            "value_count",
            "avg",
            "max",
            "min"
          ]
        },
        {
          "field": "entriesReturned",
          "metrics": [
            "value_count",
            "avg"
          ]
        }
      ]
}
```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 20, 2020, 7:20am UTC](https://discuss.elastic.co/t/rollup-jobs-extremly-high-cpu-usage/249359/4 "2020-10-20T07:20:39Z")

</div>

Closed on October 20, 2020, 7:20am UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.