# Watcher upgrade API run required (7.10)

**URL:** <https://discuss.elastic.co/t/watcher-upgrade-api-run-required-7-10/256751>\
**Category:** Elasticsearch\
**Tags:** elastic-stack-alerting\
**Created:** [November 26, 2020, 10:24am UTC](https://discuss.elastic.co/t/watcher-upgrade-api-run-required-7-10/256751 "2020-11-26T10:24:05Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![mutt13y](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mutt13y/32/74962_2.png) [@mutt13y](https://discuss.elastic.co/u/mutt13y)\
**Post date:** [November 26, 2020, 10:24am UTC](https://discuss.elastic.co/t/watcher-upgrade-api-run-required-7-10/256751/1 "2020-11-26T10:24:06Z")

</div>

Hi  
I have

```auto
not starting watcher, upgrade API run required: .watches[false]

```

in my logs on 7.10

This

> [@Watchers Issue(S)](https://discuss.elastic.co/t/watchers-issue-s/123232):
>
> While attempting to setup Watchers received a 500 error in Kibana. Log entry from Kibana: Mar 09 08:36:58 kibana[8532]: {"type":"response","@timestamp":"2018-03-09T08:36:58Z","tags": [],"pid":8532,"method":"get","statusCode":500,"req": {"url":"/api/watcher/watches","method":"get","headers": {"host":"removed","connection":"keep-alive","accept":"application/json, text/plain, /","kbn- version":"6.1.1","user-agent":"Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) C…

Implies that the issue occurs between 5x and 6x but this cluster was built this year and has never been 5x or 6x

how do I get out of this ?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [November 30, 2020, 4:49am UTC](https://discuss.elastic.co/t/watcher-upgrade-api-run-required-7-10/256751/2 "2020-11-30T04:49:14Z")

</div>

Can you please post more of the log.

---

<div class="post-metadata">

**Author:** ![mutt13y](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mutt13y/32/74962_2.png) [@mutt13y](https://discuss.elastic.co/u/mutt13y)\
**Post date:** [November 30, 2020, 7:55am UTC](https://discuss.elastic.co/t/watcher-upgrade-api-run-required-7-10/256751/3 "2020-11-30T07:55:07Z")

</div>

There is not much more of it but here it is. I just splatted the hostname

```auto
[2020-11-23T23:21:20,978][WARN][o.e.x.w.WatcherService] [xxxxxxxxxx] not starting watcher, upgrade API run required: .watches[false], .triggered_watches[true]                                                                                                             
[2020-11-23T23:21:21,442][WARN][o.e.x.w.WatcherService] [xxxxxxxxxx] not starting watcher, upgrade API run required: .watches[false], .triggered_watches[true]                                                                                                             
[2020-11-23T23:21:29,616][WARN][o.e.x.w.WatcherService] [xxxxxxxxxx] not starting watcher, upgrade API run required: .watches[false], .triggered_watches[true]                                                                                                             
[2020-11-23T23:22:14,502][WARN][o.e.x.w.WatcherService] [xxxxxxxxxx] not starting watcher, upgrade API run required: .watches[false], .triggered_watches[true]                                                                                                             
[2020-11-23T23:22:21,034][INFO][o.e.m.j.JvmGcMonitorService] [xxxxxxxxxx] [gc][65637] overhead, spent [331ms] collecting in the last [1s]                                                                                                                                     
[2020-11-23T23:23:14,978][WARN][o.e.x.w.WatcherService] [xxxxxxxxxx] not starting watcher, upgrade API run required: .watches[false], .triggered_watches[true]                                                                                                             
[2020-11-23T23:23:26,619][WARN][o.e.x.w.WatcherService] [xxxxxxxxxx] not starting watcher, upgrade API run required: .watches[false], .triggered_watches[true]                                                                                                             
[2020-11-23T23:24:12,068][WARN][o.e.x.w.WatcherService] [xxxxxxxxxx] not starting watcher, upgrade API run required: .watches[false], .triggered_watches[true]                                                                                                             
[2020-11-23T23:24:17,747][WARN][o.e.x.w.WatcherService] [xxxxxxxxxx] not starting watcher, upgrade API run required: .watches[false], .triggered_watches[true]                                                                                                             
[2020-11-23T23:25:20,021][WARN][o.e.x.w.WatcherService] [xxxxxxxxxx] not starting watcher, upgrade API run required: .watches[false], .triggered_watches[true]

```

This has magically stopped now. It stopped suddenly like this

```auto

[2020-11-26T05:19:36,007][WARN][o.e.x.w.WatcherService] [xxxxxxxxxx] not starting watcher, upgrade API run required: .watches[false], .triggered_watches[true]
[2020-11-26T05:20:00,497][INFO][o.e.m.j.JvmGcMonitorService] [xxxxxxxxxx] [gc][259561] overhead, spent [491ms] collecting in the last [1s]
[2020-11-26T05:20:58,446][WARN][o.e.x.w.WatcherService] [xxxxxxxxxx] not starting watcher, upgrade API run required: .watches[false], .triggered_watches[true]
[2020-11-26T05:20:58,665][WARN][o.e.x.w.WatcherService] [xxxxxxxxxx] not starting watcher, upgrade API run required: .watches[false], .triggered_watches[true]
[2020-11-26T05:22:05,547][INFO][o.e.m.j.JvmGcMonitorService] [xxxxxxxxxx] [gc][259686] overhead, spent [270ms] collecting in the last [1s]
[2020-11-26T05:24:34,678][WARN][o.e.m.j.JvmGcMonitorService] [xxxxxxxxxx] [gc][259835] overhead, spent [520ms] collecting in the last [1s]
[2020-11-26T05:30:50,359][INFO][o.e.m.j.JvmGcMonitorService] [xxxxxxxxxx] [gc][260210] overhead, spent [510ms] collecting in the last [1s]
[2020-11-26T05:30:59,362][INFO][o.e.m.j.JvmGcMonitorService] [xxxxxxxxxx] [gc][260219] overhead, spent [380ms] collecting in the last [1s]
[2020-11-26T05:35:29,254][INFO][o.e.m.j.JvmGcMonitorService] [xxxxxxxxxx] [gc][260488] overhead, spent [478ms] collecting in the last [1.2s]
[2020-11-26T05:43:13,890][INFO][o.e.m.j.JvmGcMonitorServ

```

Maybe its only complaining when watches are triggered.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [November 30, 2020, 7:56am UTC](https://discuss.elastic.co/t/watcher-upgrade-api-run-required-7-10/256751/4 "2020-11-30T07:56:30Z")

</div>

What's the output from `_cat/indices/.watch*?v`?

---

<div class="post-metadata">

**Author:** ![mutt13y](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mutt13y/32/74962_2.png) [@mutt13y](https://discuss.elastic.co/u/mutt13y)\
**Post date:** [November 30, 2020, 8:17am UTC](https://discuss.elastic.co/t/watcher-upgrade-api-run-required-7-10/256751/5 "2020-11-30T08:17:00Z")

</div>

```auto
health status index uuid pri rep docs.count docs.deleted store.size pri.store.size
green open .watches T2c6tGtDSPib7PwxNoXD3A 1 1 6 0 516.8kb 258.4kb

```

---

<div class="post-metadata">

**Author:** ![leozoeckler](https://avatars.discourse-cdn.com/v4/letter/l/f19dbf/32.png) [@leozoeckler](https://discuss.elastic.co/u/leozoeckler)\
**Post date:** [December 16, 2020, 8:30pm UTC](https://discuss.elastic.co/t/watcher-upgrade-api-run-required-7-10/256751/6 "2020-12-16T20:30:45Z")

</div>

I'm also running into this issue on a cluster that's never been anything but 7x (upgraded from 7.9 to 7.10), but my issue didn't resolve itself. What should I do to debug this?

The output from `_cat/indices/.watch*?v` is:

```auto
health status index uuid pri rep docs.count docs.deleted store.size pri.store.size
green open .watches 46BRfq43TRah1qPTlZgbQg 1 1 0 0 39.2kb 19.6kb

```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [January 13, 2021, 8:31pm UTC](https://discuss.elastic.co/t/watcher-upgrade-api-run-required-7-10/256751/7 "2021-01-13T20:31:01Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
