Cold phase staying in data/data_hot node

Hello,

I am trying to setup an elasticsearch cluster.

I setted up 9 nodes with these roles :

master-1 [master]
master-2 [master]
master-3 [master]
data-1 [data, data_hot]
data-2 [data_warm]
data-3 [data_warm]
data-4 [data_cold]
data-5 [data_cold]
data-6 [data_cold]

To store the elastic _security index, we must have a node with data role in it.

But, after some investigations, indexes that should be in warm or cold node are staying in the data/data_hot node.

Why is it staying in it ? How to moove indexes in the right nodes ?

Can you share a bit more information on that please.

Consider looking at GET /_cluster/allocation/explain.

Hi,

thank you for your answer.

Can you share a bit more information on that please.

Yes, I have setted up the monitoring and one disk is filling very fast (the data/data_hot one). I checked up the indexes, clicked on one and verifed the Current Phase in the Index Management of Kibana. The current Phase is cold.

Consider looking at GET /_cluster/allocation/explain .

Thank u for this. I am seeing that there are some interesting informations in it but I don't know what means :

  • cannot allocate because allocation is not permitted to any of the nodes

  • index has a preference for tiers [data_content] and node does not meet the required [data_content] tier

      {
        "index" : "logs-2021.01.22",
        "shard" : 0,
        "primary" : false,
        "current_state" : "unassigned",
        "unassigned_info" : {
          "reason" : "INDEX_CREATED",
          "at" : "2021-01-22T00:59:26.049Z",
          "last_allocation_status" : "no_attempt"
        },
        "can_allocate" : "no",
        "allocate_explanation" : "cannot allocate because allocation is not permitted to any of the nodes",
        "node_allocation_decisions" : [
          {
            "node_id" : "ID-1",
            "node_name" : "es-warm-2",
            "transport_address" : "192.168.1.9:9300",
            "node_attributes" : {
              "rack" : "r1",
              "xpack.installed" : "true",
              "transform.node" : "false"
            },
            "node_decision" : "no",
            "weight_ranking" : 1,
            "deciders" : [
              {
                "decider" : "data_tier",
                "decision" : "NO",
                "explanation" : "index has a preference for tiers [data_content] and node does not meet the required [data_content] tier"
              }
            ]
          },
          {
            "node_id" : "ID-2",
            "node_name" : "es-warm-1",
            "transport_address" : "192.168.1.8:9300",
            "node_attributes" : {
              "rack" : "r1",
              "xpack.installed" : "true",
              "transform.node" : "false"
            },
            "node_decision" : "no",
            "weight_ranking" : 2,
            "deciders" : [
              {
                "decider" : "data_tier",
                "decision" : "NO",
                "explanation" : "index has a preference for tiers [data_content] and node does not meet the required [data_content] tier"
              }
            ]
          },
          {
            "node_id" : "ID-3",
            "node_name" : "es-cold-2",
            "transport_address" : "192.168.1.11:9300",
            "node_attributes" : {
              "rack" : "r1",
              "xpack.installed" : "true",
              "transform.node" : "false"
            },
            "node_decision" : "no",
            "weight_ranking" : 3,
            "deciders" : [
              {
                "decider" : "data_tier",
                "decision" : "NO",
                "explanation" : "index has a preference for tiers [data_content] and node does not meet the required [data_content] tier"
              }
            ]
          },
          {
            "node_id" : "ID-4",
            "node_name" : "es-cold-3",
            "transport_address" : "192.168.1.12:9300",
            "node_attributes" : {
              "rack" : "r1",
              "xpack.installed" : "true",
              "transform.node" : "false"
            },
            "node_decision" : "no",
            "weight_ranking" : 4,
            "deciders" : [
              {
                "decider" : "data_tier",
                "decision" : "NO",
                "explanation" : "index has a preference for tiers [data_content] and node does not meet the required [data_content] tier"
              }
            ]
          },
          {
            "node_id" : "ID-5",
            "node_name" : "es-cold-1",
            "transport_address" : "192.168.1.10:9300",
            "node_attributes" : {
              "rack" : "r1",
              "xpack.installed" : "true",
              "transform.node" : "false"
            },
            "node_decision" : "no",
            "weight_ranking" : 5,
            "deciders" : [
              {
                "decider" : "data_tier",
                "decision" : "NO",
                "explanation" : "index has a preference for tiers [data_content] and node does not meet the required [data_content] tier"
              }
            ]
          },
          {
            "node_id" : "ID-6",
            "node_name" : "es-hot-1",
            "transport_address" : "192.168.1.7:9300",
            "node_attributes" : {
              "rack" : "r1",
              "xpack.installed" : "true",
              "transform.node" : "false"
            },
            "node_decision" : "no",
            "weight_ranking" : 6,
            "deciders" : [
              {
                "decider" : "same_shard",
                "decision" : "NO",
                "explanation" : "a copy of this shard is already allocated to this node [[logs--2021.01.22][0], node[ID-6], [P], s[STARTED], a[id=blop]]"
              }
            ]
          }
        ]
      }

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.