Hello Elastic Community,
I am currently working with Elasticsearch and I need some assistance with monitoring the progress of my rollup jobs. I have set up a rollup job with the following configuration:
{
"config": {
"id": "elastic-nodes-disk-usage-rollup20",
"index_pattern": ".monitoring-*",
"rollup_index": "rollup-nodes-disk-usage20",
"cron": "0 0 * * * ?",
"groups": {
"date_histogram": {
"fixed_interval": "7d",
"field": "@timestamp",
"time_zone": "UTC"
},
"terms": {
"fields": [
"elasticsearch.cluster.id",
"elasticsearch.node.name"
]
}
},
"metrics": [
{
"field": "elasticsearch.node.stats.fs.total.available_in_bytes",
"metrics": [
"avg",
"max"
]
},
{
"field": "elasticsearch.node.stats.fs.total.total_in_bytes",
"metrics": [
"max",
"avg"
]
}
],
"timeout": "20s",
"page_size": 1000
},
"status": {
"job_state": "started"
},
"stats": {
"pages_processed": 3,
"documents_processed": 0,
"rollups_indexed": 0,
"trigger_count": 3,
"index_time_in_ms": 0,
"index_total": 0,
"index_failures": 0,
"search_time_in_ms": 1344,
"search_total": 3,
"search_failures": 0,
"processing_time_in_ms": 0,
"processing_total": 3
}
}
I used the following query to check the status of the rollup job:
GET _rollup/job/elastic-nodes-disk-usage-rollup20
However, I noticed that the documents_processed count is still 0 even after waiting for a considerable amount of time. Here are the current stats:
- Pages Processed: 3
- Documents Processed: 0
- Rollups Indexed: 0
- Trigger Count: 3
- Search Time in ms: 1344
- Search Total: 3
I would appreciate any guidance on why the documents_processed count remains 0 and what steps I can take to resolve this issue.
Additionally, I am wondering if there is any method to estimate the time the rollup job will take to generate results. Any guidance or examples would be greatly appreciated.
Thank you!