# Deleted Rollup Job but cannot re-create it **URL:** \ **Category:** Elasticsearch\ **Created:** [August 28, 2018, 8:47am UTC](https://discuss.elastic.co/t/deleted-rollup-job-but-cannot-re-create-it/146294 "2018-08-28T08:47:54Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![cawoodm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cawoodm/32/14083_2.png) [@cawoodm](https://discuss.elastic.co/u/cawoodm)\ **Post date:** [August 28, 2018, 8:47am UTC](https://discuss.elastic.co/t/deleted-rollup-job-but-cannot-re-create-it/146294/1 "2018-08-28T08:47:54Z")
After creating a rollup job and deleting it we are unable to create a job again with the same id. ``` POST /_xpack/rollup/job/foo { "error": { "root_cause": [ { "type": "status_exception", "reason": "Cannot create rollup job [foo] because job was previously created (existing metadata)." } ], "type": "status_exception", "reason": "Cannot create rollup job [foo] because job was previously created (existing metadata)." }, "status": 409 } ``` We've read through the [docs](https://www.elastic.co/guide/en/elasticsearch/reference/current/rollup-delete-job.html) but the following does not help: ``` POST /rollup-test/_delete_by_query { "query": { "term": { "_rollup.id": "foo" } } } ``` Here is the creation script: ``` POST /_xpack/rollup/job/foo { "index_pattern": "access-test", "rollup_index": "rollup-test", "cron": "0 0 1 * * ?", "page_size": 100, "groups": { "date_histogram": { "field": "timestamp", "interval": "1d" }, "terms": { "fields": ["category", "subcategory", "method"] } }, "metrics": [ { "field": "timeTaken", "metrics": ["min", "max", "avg"] } ] } ``` We want to delete and re-create the job because there doesn't seem to be a way to change/update a rollup job once it's created. Only GET, CREATE and DELETE. How can we delete the metadata so we can re-create the job? ---
**Author:** ![jimczi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jimczi/32/47985_2.png) [@jimczi](https://discuss.elastic.co/u/jimczi)\ **Post date:** [August 28, 2018, 12:37pm UTC](https://discuss.elastic.co/t/deleted-rollup-job-but-cannot-re-create-it/146294/2 "2018-08-28T12:37:28Z")
The rollup data is not removed when a job is deleted so you need to delete the data manually or use a different `rollup_index`. ---
**Author:** ![polyfractal](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/polyfractal/32/48162_2.png) [@polyfractal](https://discuss.elastic.co/u/polyfractal)\ **Post date:** [August 28, 2018, 3:26pm UTC](https://discuss.elastic.co/t/deleted-rollup-job-but-cannot-re-create-it/146294/3 "2018-08-28T15:26:51Z")
Is there any other data in the rollup index, or does it hold only a single rollup job? If it's a single job, and you don't want the job anymore, it's simplest to just delete the entire rollup index as @jimczi mentioned > [@cawoodm](#): > > How can we delete the metadata so we can re-create the job? If the index contains multiple jobs, and you want to reuse it, you'll need to edit the [`_meta` field of the index](https://www.elastic.co/guide/en/elasticsearch/reference/current/mapping-meta-field.html) using a Put Mapping API. Basically, you'll need to remove the job's metadata from the `_meta`, which is what we use to determine what jobs a particular index holds. This is pretty user-unfriendly and prone to error. 😕 We have a ticket open to enhance the DeleteJob API to do this for you: [[Rollup] Add ability to delete rollup data · Issue #31347 · elastic/elasticsearch · GitHub](https://github.com/elastic/elasticsearch/issues/31347) ---
**Author:** ![cawoodm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cawoodm/32/14083_2.png) [@cawoodm](https://discuss.elastic.co/u/cawoodm)\ **Post date:** [August 29, 2018, 6:17am UTC](https://discuss.elastic.co/t/deleted-rollup-job-but-cannot-re-create-it/146294/4 "2018-08-29T06:17:53Z")
> [@jimczi](#): > > The rollup data is not removed when a job is deleted so you need to delete the data manually or use a different `rollup_index` . But where is the data? We did a `POST /rollup-test/_delete_by_query` so that index was empty (docs deleted). We also cannot re-create foo even if foo never ran and had no documents. Currently we have to re-create foo1, foo2, foo3 each time we need to make a change. ---
**Author:** ![polyfractal](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/polyfractal/32/48162_2.png) [@polyfractal](https://discuss.elastic.co/u/polyfractal)\ **Post date:** [August 29, 2018, 6:06pm UTC](https://discuss.elastic.co/t/deleted-rollup-job-but-cannot-re-create-it/146294/5 "2018-08-29T18:06:46Z")
@cawoodm see my explanation above. The `_meta` on the index is the issue here. For example, if I create a job: ```auto PUT _xpack/rollup/job/foo { "index_pattern": "foo", "rollup_index": "rollup", "cron": "*/30 * * * * ?", "page_size": 10, "groups": { "date_histogram": { "field": "timestamp", "interval": "1h" }, "terms": { "fields": [ "partition" ] } }, "metrics": [ { "field": "price", "metrics": [ "max" ] } ] } ``` And go look at the index that is created, you'll see that it contains metadata on the index: ```auto GET rollup/ ``` ```auto { "rollup": { "aliases": {}, "mappings": { "_doc": { "_meta": { "_rollup": { "foo": { "cron": "*/30 * * * * ?", "rollup_index": "rollup", "groups": { "date_histogram": { "field": "timestamp", "interval": "1h", "time_zone": "UTC" }, "terms": { "fields": [ "partition" ] } }, "id": "foo", "metrics": [ { "field": "price", "metrics": [ "max" ] } ], "index_pattern": "foo", "timeout": "20s", "page_size": 10 } }, "rollup-version": "7.0.0-alpha1" }, "dynamic_templates": [ { "strings": { "match_mapping_type": "string", "mapping": { "type": "keyword" } } }, { "date_histograms": { "path_match": "*.date_histogram.timestamp", "mapping": { "type": "date" } } } ] } }, "settings": { "index": { "creation_date": "1535565697662", "number_of_shards": "1", "number_of_replicas": "1", "uuid": "5NaceDtdSKiw92VR6gEqqQ", "version": { "created": "7000001" }, "provided_name": "rollup" } } } } ``` The metadata on the index is what Rollup checks to make sure we don't duplicate jobs/recreate a job with different settings. The delete-by-query doesn't remove the metadata, which is the cause of the issues you're seeing. If you don't care about the data in the rollup index (e.g. it's test data, or empty) just delete the index itself after deleting the job: ```json DELETE _xpack/rollup/job/foo DELETE rollup/ ``` And then you can recreate the job: ```auto PUT _xpack/rollup/job/foo { "index_pattern": "foo", "rollup_index": "rollup", "cron": "*/30 * * * * ?", "page_size": 10, "groups": { "date_histogram": { "field": "timestamp", "interval": "1h" }, "terms": { "fields": [ "partition" ] } }, "metrics": [ { "field": "price", "metrics": [ "max" ] } ] } ``` ```auto { "acknowledged": true } ``` ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [September 26, 2018, 6:06pm UTC](https://discuss.elastic.co/t/deleted-rollup-job-but-cannot-re-create-it/146294/6 "2018-09-26T18:06:51Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.