Index is not getting rolled over

Elastic Stack Elasticsearch
1

Hi,
I have installed the ELK 8.2 but seems rollover is not working well. index size reached to 2+ Tb.

when I tried to rollover using command line

POST some-index-name/_rollover
{
  "conditions": {
    "max_age":   "30d",
    "max_size":  "200gb"
  }
}

It gave the following error

{
  "error" : {
    "root_cause" : [
      {
        "type" : "illegal_argument_exception",
        "reason" : "rollover target is a [concrete index] but one of [alias,data_stream] was expected"
      }
    ],
    "type" : "illegal_argument_exception",
    "reason" : "rollover target is a [concrete index] but one of [alias,data_stream] was expected"
  },
  "status" : 400
}

I tried the following as well

POST /_aliases
{
    "actions" : [
        { "add" : { "index" : "some-index-name-v1-000001", "alias" : "some-index-name" } }
    ]
}

but still error.

{
  "error" : {
    "root_cause" : [
      {
        "type" : "aliases_not_found_exception",
        "reason" : "aliases [some-index-name-v1-000001-0001] missing",
        "resource.type" : "aliases",
        "resource.id" : "some-index-name-v1-000001-0001"
      }
    ],
    "type" : "aliases_not_found_exception",
    "reason" : "aliases [some-index-name-v1-000001] missing",
    "resource.type" : "aliases",
    "resource.id" : "some-index-name-v1-000001"
  },
  "status" : 404
}

Could someone please help to understand what is wrong here.

Thanks!

2

Can you share your entire ILM policy?

3

Thanks for the reply. Here is the policy.

GET _ilm/policy/delete_30_days_rollover_indices

{
  "delete_30_days_rollover_indices" : {
    "version" : 9,
    "modified_date" : "2022-08-05T20:26:37.272Z",
    "policy" : {
      "phases" : {
        "hot" : {
          "min_age" : "0ms",
          "actions" : {
            "rollover" : {
              "max_primary_shard_size" : "50gb",
              "max_age" : "30d"
            },
            "set_priority" : {
              "priority" : 97
            },
            "shrink" : {
              "number_of_shards" : 1
            }
          }
        },
        "delete" : {
          "min_age" : "30d",
          "actions" : {
            "delete" : {
              "delete_searchable_snapshot" : true
            }
          }
        }
      }
    },
    "in_use_by" : {
      "indices" : [
        "some-index-name",
        "some-index-name-proxy-msg",
        "some-index-name-msg-failed",
        ".ds-other-index-name-2022.07.31-000002",
        "some-index-name-v1-000001",
        ".ds-other-index-2022.07.24-000001"
      ],
      "data_streams" : [ ],
      "composable_templates" : [ ]
    }
  }
}
4

Can you run an explain on it as well? Explain lifecycle API | Elasticsearch Guide [8.3] | Elastic

5 
GET some-index-name-v1-000001/_ilm/explain

{
  "indices" : {
    "some-index-name-v1-000001" : {
      "index" : "some-index-name-v1-000001",
      "managed" : true,
      "policy" : "delete_30_days_rollover_indices",
      "index_creation_date_millis" : 1660608388012,
      "time_since_index_creation" : "44.03m",
      "lifecycle_date_millis" : 1660608388012,
      "age" : "44.03m",
      "phase" : "hot",
      "phase_time_millis" : 1660609957226,
      "action" : "rollover",
      "action_time_millis" : 1660608388263,
      "step" : "ERROR",
      "step_time_millis" : 1660610557079,
      "failed_step" : "check-rollover-ready",
      "is_auto_retryable_error" : true,
      "failed_step_retry_count" : 1,
      "step_info" : {
        "type" : "illegal_argument_exception",
        "reason" : "index.lifecycle.rollover_alias [some-index-name] does not point to index [some-index-name-v1-000001]"
      },
      "phase_execution" : {
        "policy" : "delete_30_days_rollover_indices",
        "phase_definition" : {
          "min_age" : "0ms",
          "actions" : {
            "rollover" : {
              "max_primary_shard_size" : "50gb",
              "max_age" : "30d"
            },
            "set_priority" : {
              "priority" : 97
            },
            "shrink" : {
              "number_of_shards" : 1
            }
          }
        },
        "version" : 9,
        "modified_date_in_millis" : 1659731197272
      }
    }
  }
}
6

Check out Troubleshooting index lifecycle management errors | Elasticsearch Guide [8.3] | Elastic

7

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.