Rollup Job doesn't Run

Elastic Stack Elasticsearch
1

I've successfully created and started a rollup job but it never runs. I've tried removing the delay, setting the cron expression to every minute (0 * 0 ? * * *) still it always shows "documents_processed: 0" and there are no docs in the rollup-test index. The log shows no issues and we definitely have loads of data in our access-test index.

{
    "jobs": [
        {
            "config": {
                "id": "accessPerformance4",
                "index_pattern": "access-test",
                "rollup_index": "rollup-test",
                "cron": "0 * 0 ? * * *",
                "groups": {
                    "date_histogram": {
                        "interval": "1d",
                        "field": "timestamp",
                        "time_zone": "UTC"
                    },
                    "terms": {
                        "fields": [
                            "category",
                            "subcategory",
                            "method"
                        ]
                    }
                },
                "metrics": [
                    {
                        "field": "timeTaken",
                        "metrics": [
                            "min",
                            "max",
                            "avg"
                        ]
                    }
                ],
                "timeout": "20s",
                "page_size": 100
            },
            "status": {
                "job_state": "started"
            },
            "stats": {
                "pages_processed": 0,
                "documents_processed": 0,
                "rollups_indexed": 0,
                "trigger_count": 0
            }
        }
    ]
}
2

OK, it seems my cron job expression generator let me down. When I use "0 * * * * ? *" it starts.

3

As an aside we might need to make it more clear in the documentation that Rollup uses Watcher's cron parser, which is slightly different from most cron parsers (it supports seconds, and some other advanced features).

4

@polyfractal I also found it difficult to understand the documentation. I'm not running X-Pack subscription so I haven't had to figure out Watcher and I couldn't find the relevant documentation in the Watcher section of the docs. It took a bit of trial and error before I figured it out, would be great if this was less ambiguous or a clear link to the Watcher explanation of the parameters.

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.