ES 7.16.0 and 7.16.1 Upgrade single node health yellow

Hello boys and girls

I have a single ES node which has one index turn yellow

curl -XGET localhost:9200/_cat/health
1639519203 22:00:03 ndelastic yellow 1 1 317 317 0 0 1 0 - 99.7%


curl -XGET localhost:9200/_cluster/allocation/explain?pretty
{
  "note" : "No shard was specified in the explain API request, so this response explains a randomly chosen unassigned shard. There may be other unassigned shards in this cluster which cannot be assigned for different reasons. It may not be possible to assign this shard until one of the other shards is assigned correctly. To explain the allocation of other shards (whether assigned or unassigned) you must specify the target shard in the request to this API.",
  "index" : ".ds-.logs-deprecation.elasticsearch-default-2021.12.12-000001",
  "shard" : 0,
  "primary" : false,
  "current_state" : "unassigned",
  "unassigned_info" : {
    "reason" : "CLUSTER_RECOVERED",
    "at" : "2021-12-14T21:58:19.216Z",
    "last_allocation_status" : "no_attempt"
  },
  "can_allocate" : "no",
  "allocate_explanation" : "cannot allocate because allocation is not permitted to any of the nodes",
  "node_allocation_decisions" : [
    {
      "node_id" : "Xdcc349SRBK5kn7xp67WIQ",
      "node_name" : "ndelastic",
      "transport_address" : "127.0.0.1:9300",
      "node_attributes" : {
        "ml.machine_memory" : "16791539712",
        "xpack.installed" : "true",
        "transform.node" : "true",
        "ml.max_open_jobs" : "512",
        "ml.max_jvm_size" : "8589934592"
      },
      "node_decision" : "no",
      "deciders" : [
        {
          "decider" : "same_shard",
          "decision" : "NO",
          "explanation" : "a copy of this shard is already allocated to this node [[.ds-.logs-deprecation.elasticsearch-default-2021.12.12-000001][0], node[Xdcc349SRBK5kn7xp67WIQ], [P], s[STARTED], a[id=WO9hmvCSQlKAuk0GnR8N8g]]"
        }
      ]
    }
  ]
}

I have manually changed the above index to have zero replicas and it turned green, however after that my filebeat index turn yellow

Does this setting not working anymore? I've looked through breaking changes but can't seem to find it

curl -XGET localhost:9200/_template/default?pretty
{
  "default" : {
    "order" : 1,
    "index_patterns" : [
      "*"
    ],
    "settings" : {
      "index" : {
        "number_of_shards" : "1",
        "number_of_replicas" : "0"
      }
    },
    "mappings" : { },
    "aliases" : { }
  }
}


As always, many thanks

1 Like

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

This is might be related to this issue: Deprecation log datastream is missing settings after upgrade · Issue #80265 · elastic/elasticsearch · GitHub and appears to be affecting any node pre-7.16.0 that is being upgraded to 7.16.x.
The issue is fixed for all node upgrades 7.16.0+.