How to query rollup jobs progress

Elastic Stack Elasticsearch
1

Hello Elastic Community,

I am currently working with Elasticsearch and I need some assistance with monitoring the progress of my rollup jobs. I have set up a rollup job with the following configuration:

{
  "config": {
    "id": "elastic-nodes-disk-usage-rollup20",
    "index_pattern": ".monitoring-*",
    "rollup_index": "rollup-nodes-disk-usage20",
    "cron": "0 0 * * * ?",
    "groups": {
      "date_histogram": {
        "fixed_interval": "7d",
        "field": "@timestamp",
        "time_zone": "UTC"
      },
      "terms": {
        "fields": [
          "elasticsearch.cluster.id",
          "elasticsearch.node.name"
        ]
      }
    },
    "metrics": [
      {
        "field": "elasticsearch.node.stats.fs.total.available_in_bytes",
        "metrics": [
          "avg",
          "max"
        ]
      },
      {
        "field": "elasticsearch.node.stats.fs.total.total_in_bytes",
        "metrics": [
          "max",
          "avg"
        ]
      }
    ],
    "timeout": "20s",
    "page_size": 1000
  },
  "status": {
    "job_state": "started"
  },
  "stats": {
    "pages_processed": 3,
    "documents_processed": 0,
    "rollups_indexed": 0,
    "trigger_count": 3,
    "index_time_in_ms": 0,
    "index_total": 0,
    "index_failures": 0,
    "search_time_in_ms": 1344,
    "search_total": 3,
    "search_failures": 0,
    "processing_time_in_ms": 0,
    "processing_total": 3
  }
}

I used the following query to check the status of the rollup job:

GET _rollup/job/elastic-nodes-disk-usage-rollup20

However, I noticed that the documents_processed count is still 0 even after waiting for a considerable amount of time. Here are the current stats:

  • Pages Processed: 3
  • Documents Processed: 0
  • Rollups Indexed: 0
  • Trigger Count: 3
  • Search Time in ms: 1344
  • Search Total: 3

I would appreciate any guidance on why the documents_processed count remains 0 and what steps I can take to resolve this issue.

Additionally, I am wondering if there is any method to estimate the time the rollup job will take to generate results. Any guidance or examples would be greatly appreciated.

Thank you!