ILM Hot to Warm: node does not match index setting

Running Elasticsearch 7.7.17. I have an issue moving the indexes to the warm node.
The indexes are on a healthy status (5 shards, 0 replicas) are in the right warm phase but I don't know why they don't move:

GET /network-000212/_ilm/explain

  "indices" : {
    "network-000212" : {
      "index" : "network-000212",
      "managed" : true,
      "policy" : "network",
      "lifecycle_date_millis" : 1598432918315,
      "age" : "4.78d",
      "phase" : "warm",
      "phase_time_millis" : 1598530888787,
      "action" : "allocate",
      "action_time_millis" : 1598530888787,
      "step" : "check-allocation",
      "step_time_millis" : 1598530892134,
      "step_info" : {
        "message" : "Waiting for [5] shards to be allocated to nodes matching the given filters",
        "shards_left_to_allocate" : 5,
        "all_shards_active" : true,
        "actual_replicas" : 0
      },
      "phase_execution" : {
        "policy" : "network",
        "phase_definition" : {
          "min_age" : "2d",
          "actions" : {
            "allocate" : {
              "number_of_replicas" : 1,
              "include" : { },
              "exclude" : { },
              "require" : {
                "box_type" : "warm"
              }
            }
          }
        },
        "version" : 6,
        "modified_date_in_millis" : 1598610582875
      }
    }
  }
}

GET /_cluster/allocation/explain { "index": "network-000212", "shard": 1, "primary": true }

  "index" : "network-000212",
  "shard" : 1,
  "primary" : true,
  "current_state" : "started",
  "current_node" : {
    "id" : "z1AKYXOTQgSHJ1MNF7rh_A",
    "name" : "authmattix",
    "transport_address" : "1.2.3.4:9300",
    "attributes" : {
      "xpack.installed" : "true",
      "box_type" : "hot",
      "transform.node" : "true"
    }
  },
  "can_remain_on_current_node" : "no",
  "can_remain_decisions" : [
    {
      "decider" : "filter",
      "decision" : "NO",
      "explanation" : """node does not match index setting [index.routing.allocation.require] filters [box_type:"warm"]"""
    }
  ],
  "can_move_to_other_node" : "no",
  "move_explanation" : "cannot move shard to another node, even though it is not allowed to remain on its current node"
}

So the error says it can't move it be cause of:
decision" : "NO", "explanation" : """node does not match index setting [index.routing.allocation.require] filters [box_type:"warm"]

But the warm node has the right attribute as shown from:

GET _cat/nodeattrs

elastic02 1.2.3.4 1.2.3.4 box_type warm

What am I missing here? Running out of ideas on how to troubleshoot this.
Thanks in advance for any feedback

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.