Filtering indices with index.lifecycle.name removing from list

Elastic Stack Elasticsearch
1

Hello,

While I was testing the curator I encounter the below problem.

Curator Config
       Preformatted textclient:
      hosts:
        - 127.0.0.1
      port: 9200
      http_auth: "elastic:elastic"
      url_prefix:
      use_ssl: False
      certificate:
      client_cert:
      client_key:
      ssl_no_validate: False
      timeout: 30
      master_only: False
    logging:
      loglevel: DEBUG
      logfile: /var/log/curator.log
      logformat: default
      blacklist: ['elasticsearch', 'urllib3']

Action file:

    actions:
      1:
        action: shrink
        description: >-
          Shrink logstash indices older than 1 days on the node with the most
          available space, excluding the node named 'not_this_node'.
          Delete each source index after successful shrink, then reroute the shrunk
          index with the provided parameters.
        options:
          disable_action: False
          ignore_empty_list: True
          allow_ilm_indices: False
          shrink_node: DETERMINISTIC
          node_filters:
            permit_masters: False
            exclude_nodes: ['not_this_node']
          number_of_shards: 1
          number_of_replicas: 1
          shrink_prefix:
          shrink_suffix: '-shrink'
          delete_after: True
          post_allocation:
            allocation_type: include
            key: node_tag
            value: cold
          wait_for_active_shards: 1
          extra_settings:
            settings:
              index.codec: best_compression
          wait_for_completion: True
          wait_for_rebalance: True
          wait_interval: 9
          max_wait: -1
        filters:
        - filtertype: pattern
          kind: prefix
          value: filebeat-
        - filtertype: age
          source: creation_date
          direction: older
          unit: minutes
          unit_count: 15

Logs:

2020-05-21 13:30:44,626 DEBUG     curator.validators.SchemaCheck               __init__:27   "filter" config: {'filtertype': 'ilm'}
2020-05-21 13:30:44,626 DEBUG          curator.indexlist        iterate_filters:1234 Parsed filter args: {'filtertype': 'ilm'}
2020-05-21 13:30:44,626 DEBUG          curator.indexlist             filter_ilm:1180 Filtering indices with index.lifecycle.name
2020-05-21 13:30:44,643 DEBUG          curator.indexlist       __not_actionable:39   Index filebeat-2020.05.21-000002 is not actionable, removing from list.
2020-05-21 13:30:44,643 DEBUG          curator.indexlist            __excludify:58   Removed from actionable list: filebeat-2020.05.21-000002 has index.lifecycle.name filebeat
2020-05-21 13:30:44,643 DEBUG          curator.indexlist       __not_actionable:39   Index filebeat-2020.05.20-000001 is not actionable, removing from list.
2020-05-21 13:30:44,643 DEBUG          curator.indexlist            __excludify:58   Removed from actionable list: filebeat-2020.05.20-000001 has index.lifecycle.name filebeat
2020-05-21 13:30:44,643 DEBUG          curator.indexlist       __not_actionable:39   Index filebeat-netflow-2020.05.21t11 is not actionable, removing from list.
2020-05-21 13:30:44,643 DEBUG          curator.indexlist            __excludify:58   Removed from actionable list: filebeat-netflow-2020.05.21t11 has index.lifecycle.name filebeat
2020-05-21 13:30:44,643 DEBUG          curator.indexlist       __not_actionable:39   Index filebeat-7.6.2-2020.05.18-000001 is not actionable, removing from list.
2020-05-21 13:30:44,643 DEBUG          curator.indexlist            __excludify:58   Removed from actionable list: filebeat-7.6.2-2020.05.18-000001 has index.lifecycle.name filebeat
2020-05-21 13:30:44,643 DEBUG          curator.indexlist       __not_actionable:39   Index filebeat-7.6.2-2020.05.21-000002 is not actionable, removing from list.
2020-05-21 13:30:44,643 DEBUG          curator.indexlist            __excludify:58   Removed from actionable list: filebeat-7.6.2-2020.05.21-000002 has index.lifecycle.name filebeat
2020-05-21 13:30:44,643 DEBUG          curator.indexlist       __not_actionable:39   Index filebeat-cisco-2020.05.21 is not actionable, removing from list.
2020-05-21 13:30:44,643 DEBUG          curator.indexlist            __excludify:58   Removed from actionable list: filebeat-cisco-2020.05.21 has index.lifecycle.name filebeat
2020-05-21 13:30:44,644 DEBUG          curator.indexlist       __not_actionable:39   Index filebeat-cisco-2020.05.21t12 is not actionable, removing from list.
2020-05-21 13:30:44,644 DEBUG          curator.indexlist            __excludify:58   Removed from actionable list: filebeat-cisco-2020.05.21t12 has index.lifecycle.name filebeat
2020-05-21 13:30:44,644 DEBUG          curator.indexlist       __not_actionable:39   Index filebeat-netflow-2020.05.21t10 is not actionable, removing from list.
2020-05-21 13:30:44,644 DEBUG          curator.indexlist            __excludify:58   Removed from actionable list: filebeat-netflow-2020.05.21t10 has index.lifecycle.name filebeat
2020-05-21 13:30:44,644 DEBUG          curator.indexlist       __not_actionable:39   Index filebeat-cisco-2020.05.21t13 is not actionable, removing from list.
2020-05-21 13:30:44,644 DEBUG          curator.indexlist            __excludify:58   Removed from actionable list: filebeat-cisco-2020.05.21t13 has index.lifecycle.name filebeat
2020-05-21 13:30:44,644 DEBUG     curator.actions.shrink  _merge_extra_settings:2049 Adding extra_settings to shrink body: {'settings': {'index.codec': 'best_compression'}}

but it does not work because of ILM filter

How can I disable this filter?

2

The clue is already in your configuration:

Change that to true and this action will be good to go. This is described in the official documentation.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.