ILM Hot to Warm: node does not match index setting

Running Elasticsearch 7.7.17. I have an issue moving the indexes to the warm node.
The indexes are on a healthy status (5 shards, 0 replicas) are in the right warm phase but I don't know why they don't move:

GET /network-000212/_ilm/explain

  "indices" : {
    "network-000212" : {
      "index" : "network-000212",
      "managed" : true,
      "policy" : "network",
      "lifecycle_date_millis" : 1598432918315,
      "age" : "4.78d",
      "phase" : "warm",
      "phase_time_millis" : 1598530888787,
      "action" : "allocate",
      "action_time_millis" : 1598530888787,
      "step" : "check-allocation",
      "step_time_millis" : 1598530892134,
      "step_info" : {
        "message" : "Waiting for [5] shards to be allocated to nodes matching the given filters",
        "shards_left_to_allocate" : 5,
        "all_shards_active" : true,
        "actual_replicas" : 0
      },
      "phase_execution" : {
        "policy" : "network",
        "phase_definition" : {
          "min_age" : "2d",
          "actions" : {
            "allocate" : {
              "number_of_replicas" : 1,
              "include" : { },
              "exclude" : { },
              "require" : {
                "box_type" : "warm"
              }
            }
          }
        },
        "version" : 6,
        "modified_date_in_millis" : 1598610582875
      }
    }
  }
}

GET /_cluster/allocation/explain { "index": "network-000212", "shard": 1, "primary": true }

  "index" : "network-000212",
  "shard" : 1,
  "primary" : true,
  "current_state" : "started",
  "current_node" : {
    "id" : "z1AKYXOTQgSHJ1MNF7rh_A",
    "name" : "authmattix",
    "transport_address" : "1.2.3.4:9300",
    "attributes" : {
      "xpack.installed" : "true",
      "box_type" : "hot",
      "transform.node" : "true"
    }
  },
  "can_remain_on_current_node" : "no",
  "can_remain_decisions" : [
    {
      "decider" : "filter",
      "decision" : "NO",
      "explanation" : """node does not match index setting [index.routing.allocation.require] filters [box_type:"warm"]"""
    }
  ],
  "can_move_to_other_node" : "no",
  "move_explanation" : "cannot move shard to another node, even though it is not allowed to remain on its current node"
}

So the error says it can't move it be cause of:
decision" : "NO", "explanation" : """node does not match index setting [index.routing.allocation.require] filters [box_type:"warm"]

But the warm node has the right attribute as shown from:

GET _cat/nodeattrs

elastic02 1.2.3.4 1.2.3.4 box_type warm

What am I missing here? Running out of ideas on how to troubleshoot this.
Thanks in advance for any feedback

1 Like

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.