Elastic ILM does not work as expected after upgrading Elastic

[Ali_Nazemian (Ali)]

After I have upgraded my Elasticsearch cluster from 7.9 to 7.10.1 my ILM for filebeat does not work as expected. I can see that the corresponding indices are being marked as Warm when I check the index management, but I noticed that they are still stored on hot nodes. After I did a bit investigation, I noticed that for "warm" indices still the value for index.routing.allocation.require.data is "hot". If I manually update the index by running the following request it works and it's moved to the "warm" node, but I'm not sure why it keeps producing the "warm" indices with an incorrect routing value.

PUT filebeat-2021.01.13*/_settings
{
  "index.routing.allocation.require.data": "warm"
}

[warkolm (Mark Walkom)]

Sharing your policy would be helpful

[Ali_Nazemian (Ali)]

The policy seems entirely fine and it in fact works as expected on another cluster:

{
  "policy": {
    "phases": {
      "hot": {
        "min_age": "0ms",
        "actions": {
          "rollover": {
            "max_size": "10gb",
            "max_age": "1d"
          }
        }
      },
      "warm": {
        "min_age": "3d",
        "actions": {
          "allocate": {
            "include": {},
            "exclude": {},
            "require": {
              "data": "warm"
            }
          },
          "shrink": {
            "number_of_shards": 1
          }
        }
      },
      "delete": {
        "min_age": "30d",
        "actions": {
          "delete": {
            "delete_searchable_snapshot": true
          }
        }
      }
    }
  }
}