Cold phase staying in data/data_hot node

Elastic Stack Elasticsearch
1

Hello,

I am trying to setup an elasticsearch cluster.

I setted up 9 nodes with these roles :

master-1 [master]
master-2 [master]
master-3 [master]
data-1 [data, data_hot]
data-2 [data_warm]
data-3 [data_warm]
data-4 [data_cold]
data-5 [data_cold]
data-6 [data_cold]

To store the elastic _security index, we must have a node with data role in it.

But, after some investigations, indexes that should be in warm or cold node are staying in the data/data_hot node.

Why is it staying in it ? How to moove indexes in the right nodes ?

2

Can you share a bit more information on that please.

Consider looking at GET /_cluster/allocation/explain.

3

Hi,

thank you for your answer.

Can you share a bit more information on that please.

Yes, I have setted up the monitoring and one disk is filling very fast (the data/data_hot one). I checked up the indexes, clicked on one and verifed the Current Phase in the Index Management of Kibana. The current Phase is cold.

Consider looking at GET /_cluster/allocation/explain .

Thank u for this. I am seeing that there are some interesting informations in it but I don't know what means :

  • cannot allocate because allocation is not permitted to any of the nodes

  • index has a preference for tiers [data_content] and node does not meet the required [data_content] tier

      {
    "index" : "logs-2021.01.22",
    "shard" : 0,
    "primary" : false,
    "current_state" : "unassigned",
    "unassigned_info" : {
      "reason" : "INDEX_CREATED",
      "at" : "2021-01-22T00:59:26.049Z",
      "last_allocation_status" : "no_attempt"
    },
    "can_allocate" : "no",
    "allocate_explanation" : "cannot allocate because allocation is not permitted to any of the nodes",
    "node_allocation_decisions" : [
      {
        "node_id" : "ID-1",
        "node_name" : "es-warm-2",
        "transport_address" : "192.168.1.9:9300",
        "node_attributes" : {
          "rack" : "r1",
          "xpack.installed" : "true",
          "transform.node" : "false"
        },
        "node_decision" : "no",
        "weight_ranking" : 1,
        "deciders" : [
          {
            "decider" : "data_tier",
            "decision" : "NO",
            "explanation" : "index has a preference for tiers [data_content] and node does not meet the required [data_content] tier"
          }
        ]
      },
      {
        "node_id" : "ID-2",
        "node_name" : "es-warm-1",
        "transport_address" : "192.168.1.8:9300",
        "node_attributes" : {
          "rack" : "r1",
          "xpack.installed" : "true",
          "transform.node" : "false"
        },
        "node_decision" : "no",
        "weight_ranking" : 2,
        "deciders" : [
          {
            "decider" : "data_tier",
            "decision" : "NO",
            "explanation" : "index has a preference for tiers [data_content] and node does not meet the required [data_content] tier"
          }
        ]
      },
      {
        "node_id" : "ID-3",
        "node_name" : "es-cold-2",
        "transport_address" : "192.168.1.11:9300",
        "node_attributes" : {
          "rack" : "r1",
          "xpack.installed" : "true",
          "transform.node" : "false"
        },
        "node_decision" : "no",
        "weight_ranking" : 3,
        "deciders" : [
          {
            "decider" : "data_tier",
            "decision" : "NO",
            "explanation" : "index has a preference for tiers [data_content] and node does not meet the required [data_content] tier"
          }
        ]
      },
      {
        "node_id" : "ID-4",
        "node_name" : "es-cold-3",
        "transport_address" : "192.168.1.12:9300",
        "node_attributes" : {
          "rack" : "r1",
          "xpack.installed" : "true",
          "transform.node" : "false"
        },
        "node_decision" : "no",
        "weight_ranking" : 4,
        "deciders" : [
          {
            "decider" : "data_tier",
            "decision" : "NO",
            "explanation" : "index has a preference for tiers [data_content] and node does not meet the required [data_content] tier"
          }
        ]
      },
      {
        "node_id" : "ID-5",
        "node_name" : "es-cold-1",
        "transport_address" : "192.168.1.10:9300",
        "node_attributes" : {
          "rack" : "r1",
          "xpack.installed" : "true",
          "transform.node" : "false"
        },
        "node_decision" : "no",
        "weight_ranking" : 5,
        "deciders" : [
          {
            "decider" : "data_tier",
            "decision" : "NO",
            "explanation" : "index has a preference for tiers [data_content] and node does not meet the required [data_content] tier"
          }
        ]
      },
      {
        "node_id" : "ID-6",
        "node_name" : "es-hot-1",
        "transport_address" : "192.168.1.7:9300",
        "node_attributes" : {
          "rack" : "r1",
          "xpack.installed" : "true",
          "transform.node" : "false"
        },
        "node_decision" : "no",
        "weight_ranking" : 6,
        "deciders" : [
          {
            "decider" : "same_shard",
            "decision" : "NO",
            "explanation" : "a copy of this shard is already allocated to this node [[logs--2021.01.22][0], node[ID-6], [P], s[STARTED], a[id=blop]]"
          }
        ]
      }
    ]
  }
4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.