Kibana: Cold indices not showing when using filter in index management

[basiltitus]

I have a two node cluster with a master/hot and a single data node defined in cold tier. I have created few indices for testing data tier. But when I apply "lifecycle phase" filter the indices supposed to be in cold tier is not listing, at the same time 'hot' are listing if I change filter value to 'hot'. If I don't use any filter all indices are listed including 'hot' and 'cold'. The reason I say they are cold tier is that If I query GET /_cat/shards/ using Dev tools I can see it's residing in cold node. If I click any one of the cold index I can see there is no errors and current phase showing as 'completed'. What can be the reason it's not showing in filter when select 'cold' or am I missing something?

PUT _ilm/policy/hex_rollover
{
  "policy": {
    "phases": {
      "hot": {
        "min_age": "0ms",
        "actions": {
          "rollover": {
            "max_docs": 5
          },
          "set_priority": {
            "priority": 100
          }
        }
      },
      "cold": {
        "min_age": "1h",
        "actions": {
          "allocate": {
            "include": {},
            "exclude": {},
            "require": {
              "node_type": "cold"
            }
          },
          "set_priority": {
            "priority": 0
          }
        }
      }
    }
  }
}

[yago82]

Hi,

In your case, the "min_age" for the cold phase is set to "1h", which means the cold phase actions (like moving the index to the cold node) start 1 hour after the index enters the hot phase. However, the index is still considered to be in the hot tier until these actions are completed.

If you want to see the indices in the cold tier when you apply the "lifecycle phase" filter, you might need to wait until the cold phase actions have been completed. You can check the status of these actions by looking at the ILM explain API.

Regards

[basiltitus]

The indices are already in cold node which I can see using GET /_cat/shards/ and also these indices are created and rolled over days ago. When I apply 'hot' filter only the current write index is listed. None of other phase is listing rest of indices but when I remove filter all indices are listed. In below image db2 is my cold node.

[leandrojmp (Leandro Pereira)]

Can you share a screenshot of what you are seeing in Index Management?

It is really not clear what is your issue, but if filter by the lifecycle phase and choose hot, only the index in the hot phase will be shown, indices already in other lifecycle phases, like rolled over indices, will not be shown.

[basiltitus]

Here when I select 'cold' why indices in the cold node are not listed. If you see my my previous screenshot there you can see except '000007' write index all indices are on db2 which is my cold node.

[yago82]

Hi,

Could you execute this command:

GET _cat/nodes?v

[leandrojmp (Leandro Pereira)]

Please share the elasticsearch.yml of both of your nodes.

Also, run the request GET <target>/_ilm/explain for one of your old indices and share the result.

Like GET hex-data-000001/_ilm/explain

[basiltitus]

GET hex-data-000001/_ilm/explain gives this

{
  "indices" : {
    "hex-data-000001" : {
      "index" : "hex-data-000001",
      "managed" : true,
      "policy" : "hex_rollover",
      "lifecycle_date_millis" : 1703211314319,
      "age" : "13.04d",
      "phase" : "completed",
      "phase_time_millis" : 1703214920429,
      "action" : "completed",
      "action_time_millis" : 1703214920429,
      "step" : "completed",
      "step_time_millis" : 1703214920429,
      "phase_execution" : {
        "policy" : "hex_rollover",
        "version" : 1,
        "modified_date_in_millis" : 1703140459345
      }
    }
  }
}

[leandrojmp (Leandro Pereira)]

You didn't share the elasticsearch.yml of your nodes as asked.