ES/Kibana/XPack 6.2.1: issue assigning unassigned indexes

root@test1:/opt/estest# curl -XGET localhost:9200/_cat/shards?h=index,shard,prirep,state,unassigned.reason| grep UNASSIGNED
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  2175  100  2175    0     0  42384      0 --:--:-- --:--:-- --:--:-- 44387
.watcher-history-7-2018.02.12   0  r UNASSIGNED CLUSTER_RECOVERED
.watcher-history-7-2018.02.10   0  r UNASSIGNED CLUSTER_RECOVERED
.watcher-history-7-2018.02.09   0  r UNASSIGNED CLUSTER_RECOVERED
.watcher-history-7-2018.02.11   0  r UNASSIGNED CLUSTER_RECOVERED
root@test1:/opt/estest# curl -H'Content-Type: application/json' -XPUT 'localhost:9200/_settings' -d '{"index": {"number_of_replicas":0 }}';echo ""
{"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"unknown setting [archived.index.xpack.watcher.template.version] did you mean [index.xpack.watcher.template.version]?"}],"type":"illegal_argument_exception","reason":"unknown setting [archived.index.xpack.watcher.template.version] did you mean [index.xpack.watcher.template.version]?"},"status":400}

Expected behavior: getting rid of unassinged indexes. Using same commands since 5.0 without any issues.

You've run into a variation of this Elasticsearch issue: https://github.com/elastic/elasticsearch/issues/28026

You should be able to fix it up by updating the seetings to set archived.* to null.

Thanks for your reply.

curl -XPUT -H "Content-Type: application/json" -s localhost:9200/_cluster/settings -d '{"transient": { "archived.indices.*":null } }'

Doesn't fix the issue. I btw didn't upgrade from 5.x to 6: I did a clean system install instead (6.0.1) and re-created the dataset from scratch. And I am not runnng in cluster mode.

Any other suggestions? Thanks!

Detailed log info:

[2018-02-13T21:49:19,304][DEBUG][o.e.a.a.i.s.p.TransportUpdateSettingsAction] [testes] failed to update settings on indices [[[sources/H5BUqQnGS2KLfrA7uOY8PA], [.watcher-history-7-2018.02.12/Q-QUVW_CQ9640d9BmeKUKg], [.watcher-history-7-2018.02.10/mNx7Z5B2Td6Q-0UhuOBvCQ], [.watcher-history-6-2017.12.08/4bNF9DxxStGp6ooVrJNnXw], [.watches/kvYGzhvFT06TJwY6-mG46A], [.monitoring-kibana-6-2018.02.13/CpzqLsPOQjuOarVAReGr3A], [.monitoring-kibana-6-2018.02.12/26fiZu0NQdGQZMahvWxIfw], [.monitoring-alerts-6/o_g_WTH-S2yNSk6qtWGxjA], [.monitoring-es-6-2018.02.11/ZZyxBKdNT5elrEA3aMjeAg], [.kibana/c-Biw5jeTRmbe8ji4-9P8Q], [debug/_XG-FSFUTOKOscAO1JxFZg], [.watcher-history-7-2018.02.09/AwJpmGSmTmKfiTEUbigC0g], [.monitoring-es-6-2018.02.12/k-pbYi6DQXKUWgNvyYoF6A], [p/QuaHGYcwRIqPVcQzo3IzNA], [.monitoring-kibana-6-2018.02.11/0s2AjsPYTZGOTxth1EY4SA], [.watcher-history-7-2018.02.11/h6zQMkGkSem5ZrxlN_tWqg], [.monitoring-es-6-2018.02.13/jmHWX-3tTXGbLcm5kjTAGg], [.triggered_watches/rPyVm8LeSN2ZLvLNbcd_SA]]]
java.lang.IllegalArgumentException: unknown setting [archived.index.xpack.watcher.template.version] did you mean [index.xpack.watcher.template.version]?
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:346) ~[elasticsearch-6.2.1.jar:6.2.1]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:310) ~[elasticsearch-6.2.1.jar:6.2.1]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:284) ~[elasticsearch-6.2.1.jar:6.2.1]
        at org.elasticsearch.cluster.metadata.MetaDataUpdateSettingsService$2.execute(MetaDataUpdateSettingsService.java:248) ~[elasticsearch-6.2.1.jar:6.2.1]
        at org.elasticsearch.cluster.ClusterStateUpdateTask.execute(ClusterStateUpdateTask.java:45) ~[elasticsearch-6.2.1.jar:6.2.1]
        at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:643) ~[elasticsearch-6.2.1.jar:6.2.1]
        at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:273) ~[elasticsearch-6.2.1.jar:6.2.1]
        at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:198) [elasticsearch-6.2.1.jar:6.2.1]
        at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:133) [elasticsearch-6.2.1.jar:6.2.1]
        at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-6.2.1.jar:6.2.1]
        at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-6.2.1.jar:6.2.1]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:566) [elasticsearch-6.2.1.jar:6.2.1]
        at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:244) [elasticsearch-6.2.1.jar:6.2.1]
        at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:207) [elasticsearch-6.2.1.jar:6.2.1]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_151]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_151]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_151]

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.