A curator_cli show-indices KeyError question

Hi there,

I've installed elasticsearch 8.14.3 on RHEL 8 and am testing elasticsearch-curator 8.0.16.

When I try to run the show-indices command I get the following error:

[root@elasticsearch ~]# /usr/local/bin/curator_cli show-indices
Traceback (most recent call last):
  File "/usr/local/bin/curator_cli", line 8, in <module>
    sys.exit(curator_cli())
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/decorators.py", line 33, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/curator/cli_singletons/show.py", line 43, in show_indices
    allbytes.append(byte_size(action.list_object.index_info[idx]['size_in_bytes']))
KeyError: '.ds-logs-generic-default-2024.08.27-000001'

These are the versions of some things:

[root@elasticsearch ~]# rpm -qa|grep elastic
elasticsearch-8.14.3-1.x86_64
[root@elasticsearch ~]# pip3 list|grep curator
elasticsearch-curator 8.0.16
[root@elasticsearch ~]# /usr/local/bin/curator_cli --version
curator_cli, version 8.0.16
[root@elasticsearch ~]# cat /etc/redhat-release
Red Hat Enterprise Linux release 8.7 (Ootpa)

Can anyone help me with this issue please?

Thanks,

Dave

Can you turn on DEBUG logging? That should be as simple as --loglevel DEBUG before show-indices. I want to see what else might be going on.

Thanks, here it is:

[root@elasticsearch ~]# /usr/local/bin/curator_cli --loglevel DEBUG show-indices
DEBUG: Overriding configuration file setting loglevel=INFO with command-line option loglevel=DEBUG
2024-08-29 00:46:42,529 DEBUG     es_client.helpers.schemacheck               __init__:60   Schema: {'other_settings': {'master_only': <function Boolean at 0x7f28178c63a0>, 'skip_version_test': <function Boolean at 0x7f28178c6550>, 'username': Any(None, <class 'str'>, msg=None), 'password': Any(None, <class 'str'>, msg=None), 'api_key': {'id': Any(None, <class 'str'>, msg=None), 'api_key': Any(None, <class 'str'>, msg=None), 'token': Any(None, <class 'str'>, msg=None)}}, 'client': {'hosts': Any(None, <class 'list'>, <class 'str'>, msg=None), 'cloud_id': Any(None, <class 'str'>, msg=None), 'api_key': Any(None, <class 'tuple'>, msg=None), 'basic_auth': Any(None, <class 'tuple'>, msg=None), 'bearer_auth': Any(None, <class 'str'>, msg=None), 'opaque_id': Any(None, <class 'str'>, msg=None), 'headers': Any(None, <class 'dict'>, msg=None), 'connections_per_node': Any(None, All(Coerce(int, msg=None), Range(min=1, max=100, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'http_compress': <function Boolean at 0x7f28178cf280>, 'verify_certs': <function Boolean at 0x7f28178cf3a0>, 'ca_certs': Any(None, <class 'str'>, msg=None), 'client_cert': Any(None, <class 'str'>, msg=None), 'client_key': Any(None, <class 'str'>, msg=None), 'ssl_assert_hostname': Any(None, <class 'str'>, msg=None), 'ssl_assert_fingerprint': Any(None, <class 'str'>, msg=None), 'ssl_version': Any(None, <class 'str'>, msg=None), 'ssl_context': Any(None, <class 'str'>, msg=None), 'ssl_show_warn': <function Boolean at 0x7f281790c670>, 'transport_class': Any(None, <class 'str'>, msg=None), 'request_timeout': Any(None, All(Coerce(float, msg=None), Range(min=0.1, max=86400.0, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'node_class': Any(None, <class 'str'>, msg=None), 'node_pool_class': Any(None, <class 'str'>, msg=None), 'randomize_nodes_in_pool': <function Boolean at 0x7f2817920ee0>, 'node_selector_class': Any(None, <class 'str'>, msg=None), 'dead_node_backoff_factor': Any(None, <class 'float'>, msg=None), 'max_dead_node_backoff': Any(None, <class 'float'>, msg=None), 'serializer': Any(None, <class 'str'>, msg=None), 'serializers': Any(None, <class 'dict'>, msg=None), 'default_mimetype': Any(None, <class 'str'>, msg=None), 'max_retries': Any(None, All(Coerce(int, msg=None), Range(min=1, max=100, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'retry_on_status': Any(None, <class 'tuple'>, msg=None), 'retry_on_timeout': <function Boolean at 0x7f2817920f70>, 'sniff_on_start': <function Boolean at 0x7f2817920ca0>, 'sniff_before_requests': <function Boolean at 0x7f2817920b80>, 'sniff_on_node_failure': <function Boolean at 0x7f28179209d0>, 'sniff_timeout': Any(None, All(Coerce(float, msg=None), Range(min=0.1, max=100.0, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'min_delay_between_sniffing': Any(None, All(Coerce(float, msg=None), Range(min=1, max=100.0, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'sniffed_node_callback': Any(None, <class 'str'>, msg=None), 'meta_header': <function Boolean at 0x7f2817920700>, 'host_info_callback': Any(None, <class 'str'>, msg=None), '_transport': Any(None, <class 'str'>, msg=None)}}
2024-08-29 00:46:42,530 DEBUG     es_client.helpers.schemacheck               __init__:62   "Elasticsearch Configuration" config: {'client': {'hosts': ['http://127.0.0.1:9200']}, 'other_settings': {}}
2024-08-29 00:46:42,530 DEBUG     curator.cli_singletons.cli_action.show_indices          check_filters:155  Validating provided filters: [{'filtertype': 'none'}]
2024-08-29 00:46:42,531 DEBUG     es_client.helpers.schemacheck               __init__:60   Schema: <function validfilters.<locals>.func at 0x7f28178e2a60>
2024-08-29 00:46:42,531 DEBUG     es_client.helpers.schemacheck               __init__:64   "filters" config: [{'filtertype': 'none'}]
2024-08-29 00:46:42,532 DEBUG     es_client.helpers.schemacheck               __init__:60   Schema: {'filtertype': Any(In(['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'size', 'space', 'state']), msg="filtertype must be one of ['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'size', 'space', 'state']")}
2024-08-29 00:46:42,532 DEBUG     es_client.helpers.schemacheck               __init__:62   "filter" config: {'filtertype': 'none'}
2024-08-29 00:46:42,532 DEBUG     curator.validators.filter_functions                   func:78   Filter #0: {'filtertype': 'none'}
2024-08-29 00:46:42,534 DEBUG          es_client.builder    process_config_opts:192  Using configdict values: {'elasticsearch': {'client': {'hosts': ['http://127.0.0.1:9200']}, 'other_settings': {'skip_version_test': False, 'api_key': {}, 'master_only': False}}}
2024-08-29 00:46:42,536 DEBUG     es_client.helpers.schemacheck               __init__:60   Schema: {'other_settings': {'master_only': <function Boolean at 0x7f2817885040>, 'skip_version_test': <function Boolean at 0x7f28178851f0>, 'username': Any(None, <class 'str'>, msg=None), 'password': Any(None, <class 'str'>, msg=None), 'api_key': {'id': Any(None, <class 'str'>, msg=None), 'api_key': Any(None, <class 'str'>, msg=None), 'token': Any(None, <class 'str'>, msg=None)}}, 'client': {'hosts': Any(None, <class 'list'>, <class 'str'>, msg=None), 'cloud_id': Any(None, <class 'str'>, msg=None), 'api_key': Any(None, <class 'tuple'>, msg=None), 'basic_auth': Any(None, <class 'tuple'>, msg=None), 'bearer_auth': Any(None, <class 'str'>, msg=None), 'opaque_id': Any(None, <class 'str'>, msg=None), 'headers': Any(None, <class 'dict'>, msg=None), 'connections_per_node': Any(None, All(Coerce(int, msg=None), Range(min=1, max=100, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'http_compress': <function Boolean at 0x7f2817885ee0>, 'verify_certs': <function Boolean at 0x7f2817888040>, 'ca_certs': Any(None, <class 'str'>, msg=None), 'client_cert': Any(None, <class 'str'>, msg=None), 'client_key': Any(None, <class 'str'>, msg=None), 'ssl_assert_hostname': Any(None, <class 'str'>, msg=None), 'ssl_assert_fingerprint': Any(None, <class 'str'>, msg=None), 'ssl_version': Any(None, <class 'str'>, msg=None), 'ssl_context': Any(None, <class 'str'>, msg=None), 'ssl_show_warn': <function Boolean at 0x7f2817888430>, 'transport_class': Any(None, <class 'str'>, msg=None), 'request_timeout': Any(None, All(Coerce(float, msg=None), Range(min=0.1, max=86400.0, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'node_class': Any(None, <class 'str'>, msg=None), 'node_pool_class': Any(None, <class 'str'>, msg=None), 'randomize_nodes_in_pool': <function Boolean at 0x7f2817888790>, 'node_selector_class': Any(None, <class 'str'>, msg=None), 'dead_node_backoff_factor': Any(None, <class 'float'>, msg=None), 'max_dead_node_backoff': Any(None, <class 'float'>, msg=None), 'serializer': Any(None, <class 'str'>, msg=None), 'serializers': Any(None, <class 'dict'>, msg=None), 'default_mimetype': Any(None, <class 'str'>, msg=None), 'max_retries': Any(None, All(Coerce(int, msg=None), Range(min=1, max=100, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'retry_on_status': Any(None, <class 'tuple'>, msg=None), 'retry_on_timeout': <function Boolean at 0x7f2817888d30>, 'sniff_on_start': <function Boolean at 0x7f2817888e50>, 'sniff_before_requests': <function Boolean at 0x7f2817888f70>, 'sniff_on_node_failure': <function Boolean at 0x7f281788f0d0>, 'sniff_timeout': Any(None, All(Coerce(float, msg=None), Range(min=0.1, max=100.0, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'min_delay_between_sniffing': Any(None, All(Coerce(float, msg=None), Range(min=1, max=100.0, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'sniffed_node_callback': Any(None, <class 'str'>, msg=None), 'meta_header': <function Boolean at 0x7f281788f3a0>, 'host_info_callback': Any(None, <class 'str'>, msg=None), '_transport': Any(None, <class 'str'>, msg=None)}}
2024-08-29 00:46:42,536 DEBUG     es_client.helpers.schemacheck               __init__:62   "Elasticsearch Configuration" config: {'client': {'hosts': ['http://127.0.0.1:9200']}, 'other_settings': {'skip_version_test': False, 'api_key': {}, 'master_only': False}}
2024-08-29 00:46:42,543 DEBUG          es_client.builder         _check_version:367  Detected version 8.14.3
2024-08-29 00:46:42,607 DEBUG     curator.cli_singletons.cli_action.show_indices               __init__:119  Connection result: {'name': 'elasticsearch', 'cluster_name': 'VAGRANTDEV', 'cluster_uuid': 'ZiY09-ixSlqkgPLfNP-jqg', 'version': {'number': '8.14.3', 'build_flavor': 'default', 'build_type': 'rpm', 'build_hash': 'd55f984299e0e88dee72ebd8255f7ff130859ad0', 'build_date': '2024-07-07T22:04:49.882652950Z', 'build_snapshot': False, 'lucene_version': '9.10.0', 'minimum_wire_compatibility_version': '7.17.0', 'minimum_index_compatibility_version': '7.0.0'}, 'tagline': 'You Know, for Search'}
2024-08-29 00:46:42,608 DEBUG          curator.indexlist          __get_indices:69   Getting indices matching search_pattern: "_all"
2024-08-29 00:46:43,030 DEBUG     curator.helpers.getters            get_indices:92   All indices: ['.internal.alerts-observability.apm.alerts-default-000001', '.internal.alerts-ml.anomaly-detection.alerts-default-000001', '.kibana-observability-ai-assistant-conversations-000001', '.internal.alerts-observability.metrics.alerts-default-000001', '.internal.alerts-observability.uptime.alerts-default-000001', '.kibana-observability-ai-assistant-kb-000001', '.internal.alerts-ml.anomaly-detection-health.alerts-default-000001', '.internal.alerts-observability.threshold.alerts-default-000001', '.ds-logs-generic-default-2024.08.27-000001', '.internal.alerts-default.alerts-default-000001', '.internal.alerts-observability.logs.alerts-default-000001', '.internal.alerts-transform.health.alerts-default-000001', '.internal.alerts-security.alerts-default-000001', '.internal.alerts-stack.alerts-default-000001', '.internal.alerts-observability.slo.alerts-default-000001', 'ecs-logstash-2024.08.28-000001']
2024-08-29 00:46:43,030 DEBUG     curator.cli_singletons.cli_action.show_indices             do_filters:169  Running filters and testing for empty list object
2024-08-29 00:46:43,030 DEBUG          curator.indexlist        iterate_filters:1218 Iterating over a list of filters
2024-08-29 00:46:43,030 DEBUG          curator.indexlist        iterate_filters:1223 All filters: [{'filtertype': 'none'}]
2024-08-29 00:46:43,030 DEBUG          curator.indexlist        iterate_filters:1225 Top of the loop: ['.internal.alerts-observability.apm.alerts-default-000001', '.internal.alerts-ml.anomaly-detection.alerts-default-000001', '.kibana-observability-ai-assistant-conversations-000001', '.internal.alerts-observability.metrics.alerts-default-000001', '.internal.alerts-observability.uptime.alerts-default-000001', '.kibana-observability-ai-assistant-kb-000001', '.internal.alerts-ml.anomaly-detection-health.alerts-default-000001', '.internal.alerts-observability.threshold.alerts-default-000001', '.ds-logs-generic-default-2024.08.27-000001', '.internal.alerts-default.alerts-default-000001', '.internal.alerts-observability.logs.alerts-default-000001', '.internal.alerts-transform.health.alerts-default-000001', '.internal.alerts-security.alerts-default-000001', '.internal.alerts-stack.alerts-default-000001', '.internal.alerts-observability.slo.alerts-default-000001', 'ecs-logstash-2024.08.28-000001']
2024-08-29 00:46:43,031 DEBUG          curator.indexlist        iterate_filters:1226 Un-parsed filter args: {'filtertype': 'none'}
2024-08-29 00:46:43,032 DEBUG     es_client.helpers.schemacheck               __init__:60   Schema: {'aliases': Any(<class 'list'>, <class 'str'>, msg=None), 'allocation_type': Any(<class 'str'>, msg=None), 'count': Coerce(int, msg=None), 'date_from': Any(None, <class 'str'>, msg=None), 'date_from_format': Any(None, <class 'str'>, msg=None), 'date_to': Any(None, <class 'str'>, msg=None), 'date_to_format': Any(None, <class 'str'>, msg=None), 'direction': Any(<class 'str'>, msg=None), 'disk_space': <class 'float'>, 'epoch': Any(Coerce(int, msg=None), None, msg=None), 'exclude': Any(None, <class 'bool'>, <class 'int'>, <class 'str'>, msg=None), 'field': Any(None, <class 'str'>, msg=None), 'intersect': Any(None, <class 'bool'>, <class 'int'>, <class 'str'>, msg=None), 'key': Any(<class 'str'>, msg=None), 'kind': Any(<class 'str'>, msg=None), 'max_num_segments': Coerce(int, msg=None), 'number_of_shards': Coerce(int, msg=None), 'pattern': Any(<class 'str'>, msg=None), 'period_type': Any(<class 'str'>, msg=None), 'reverse': Any(None, <class 'bool'>, <class 'int'>, <class 'str'>, msg=None), 'range_from': Coerce(int, msg=None), 'range_to': Coerce(int, msg=None), 'shard_filter_behavior': Any(<class 'str'>, msg=None), 'size_behavior': Any(<class 'str'>, msg=None), 'size_threshold': Any(Coerce(float, msg=None), msg=None), 'source': Any(<class 'str'>, msg=None), 'state': Any(<class 'str'>, msg=None), 'stats_result': Any(None, <class 'str'>, msg=None), 'timestring': Any(None, <class 'str'>, msg=None), 'threshold_behavior': Any(<class 'str'>, msg=None), 'unit': Any(<class 'str'>, msg=None), 'unit_count': Coerce(int, msg=None), 'unit_count_pattern': Any(<class 'str'>, msg=None), 'use_age': <function Boolean at 0x7f28178b9ca0>, 'value': Any(<class 'int'>, <class 'float'>, <class 'bool'>, <class 'str'>, msg=None), 'week_starts_on': Any(None, <class 'str'>, msg=None), 'filtertype': Any(In(['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'size', 'space', 'state']), msg="filtertype must be one of ['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'size', 'space', 'state']")}
2024-08-29 00:46:43,032 DEBUG     es_client.helpers.schemacheck               __init__:62   "filter" config: {'filtertype': 'none'}
2024-08-29 00:46:43,032 DEBUG          curator.indexlist        iterate_filters:1231 Parsed filter args: {'filtertype': 'none'}
2024-08-29 00:46:43,032 DEBUG          curator.indexlist            filter_none:889  "None" filter selected.  No filtering will be done.
2024-08-29 00:46:43,032 DEBUG          curator.indexlist       empty_list_check:400  Checking for empty list
Traceback (most recent call last):
  File "/usr/local/bin/curator_cli", line 8, in <module>
    sys.exit(curator_cli())
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/decorators.py", line 33, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/curator/cli_singletons/show.py", line 43, in show_indices
    allbytes.append(byte_size(action.list_object.index_info[idx]['size_in_bytes']))
KeyError: '.ds-logs-generic-default-2024.08.27-000001'

Added curator

Curious. It doesn't seem to think this index exists, and yet it gets found all the same.

What happens if you run the following in the Dev Tools console (or make the REST call manually using curl or something)?

GET .ds-logs-generic-default-2024.08.27-000001/_stats/?filter_path=_all.total.store

The next question is what happens if you add --allow_ilm_indices after show-indices? That data stream index is managed by ILM, ostensibly, so it may possibly have been filtered as a result. I do not think it should be, but please check since I don't have time to check the code right now.

Like this?

[root@elasticsearch ~]# curl http://127.0.0.1:9200/.ds-logs-generic-default-2024.08.27-000001/_stats/?filter_path=_all.total.store;echo
{"_all":{"total":{"store":{"size_in_bytes":6944655,"total_data_set_size_in_bytes":6944655,"reserved_in_bytes":0}}}}
[root@elasticsearch ~]# /usr/local/bin/curator_cli show-indices --allow_ilm_indices
Traceback (most recent call last):
  File "/usr/local/bin/curator_cli", line 8, in <module>
    sys.exit(curator_cli())
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/decorators.py", line 33, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/curator/cli_singletons/show.py", line 43, in show_indices
    allbytes.append(byte_size(action.list_object.index_info[idx]['size_in_bytes']))
KeyError: '.kibana-observability-ai-assistant-conversations-000001'
[root@elasticsearch ~]# /usr/local/bin/curator_cli --loglevel DEBUG show-indices --allow_ilm_indices
DEBUG: Overriding configuration file setting loglevel=INFO with command-line option loglevel=DEBUG
2024-08-29 06:43:50,469 DEBUG     es_client.helpers.schemacheck               __init__:60   Schema: {'other_settings': {'master_only': <function Boolean at 0x7f1c5653b3a0>, 'skip_version_test': <function Boolean at 0x7f1c5653b550>, 'username': Any(None, <class 'str'>, msg=None), 'password': Any(None, <class 'str'>, msg=None), 'api_key': {'id': Any(None, <class 'str'>, msg=None), 'api_key': Any(None, <class 'str'>, msg=None), 'token': Any(None, <class 'str'>, msg=None)}}, 'client': {'hosts': Any(None, <class 'list'>, <class 'str'>, msg=None), 'cloud_id': Any(None, <class 'str'>, msg=None), 'api_key': Any(None, <class 'tuple'>, msg=None), 'basic_auth': Any(None, <class 'tuple'>, msg=None), 'bearer_auth': Any(None, <class 'str'>, msg=None), 'opaque_id': Any(None, <class 'str'>, msg=None), 'headers': Any(None, <class 'dict'>, msg=None), 'connections_per_node': Any(None, All(Coerce(int, msg=None), Range(min=1, max=100, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'http_compress': <function Boolean at 0x7f1c56545280>, 'verify_certs': <function Boolean at 0x7f1c565453a0>, 'ca_certs': Any(None, <class 'str'>, msg=None), 'client_cert': Any(None, <class 'str'>, msg=None), 'client_key': Any(None, <class 'str'>, msg=None), 'ssl_assert_hostname': Any(None, <class 'str'>, msg=None), 'ssl_assert_fingerprint': Any(None, <class 'str'>, msg=None), 'ssl_version': Any(None, <class 'str'>, msg=None), 'ssl_context': Any(None, <class 'str'>, msg=None), 'ssl_show_warn': <function Boolean at 0x7f1c56582a60>, 'transport_class': Any(None, <class 'str'>, msg=None), 'request_timeout': Any(None, All(Coerce(float, msg=None), Range(min=0.1, max=86400.0, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'node_class': Any(None, <class 'str'>, msg=None), 'node_pool_class': Any(None, <class 'str'>, msg=None), 'randomize_nodes_in_pool': <function Boolean at 0x7f1c56596ee0>, 'node_selector_class': Any(None, <class 'str'>, msg=None), 'dead_node_backoff_factor': Any(None, <class 'float'>, msg=None), 'max_dead_node_backoff': Any(None, <class 'float'>, msg=None), 'serializer': Any(None, <class 'str'>, msg=None), 'serializers': Any(None, <class 'dict'>, msg=None), 'default_mimetype': Any(None, <class 'str'>, msg=None), 'max_retries': Any(None, All(Coerce(int, msg=None), Range(min=1, max=100, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'retry_on_status': Any(None, <class 'tuple'>, msg=None), 'retry_on_timeout': <function Boolean at 0x7f1c565968b0>, 'sniff_on_start': <function Boolean at 0x7f1c56596c10>, 'sniff_before_requests': <function Boolean at 0x7f1c56596d30>, 'sniff_on_node_failure': <function Boolean at 0x7f1c56596940>, 'sniff_timeout': Any(None, All(Coerce(float, msg=None), Range(min=0.1, max=100.0, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'min_delay_between_sniffing': Any(None, All(Coerce(float, msg=None), Range(min=1, max=100.0, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'sniffed_node_callback': Any(None, <class 'str'>, msg=None), 'meta_header': <function Boolean at 0x7f1c56596670>, 'host_info_callback': Any(None, <class 'str'>, msg=None), '_transport': Any(None, <class 'str'>, msg=None)}}
2024-08-29 06:43:50,470 DEBUG     es_client.helpers.schemacheck               __init__:62   "Elasticsearch Configuration" config: {'client': {'hosts': ['http://127.0.0.1:9200']}, 'other_settings': {}}
2024-08-29 06:43:50,470 DEBUG     curator.cli_singletons.cli_action.show_indices          check_filters:155  Validating provided filters: [{'filtertype': 'none'}]
2024-08-29 06:43:50,471 DEBUG     es_client.helpers.schemacheck               __init__:60   Schema: <function validfilters.<locals>.func at 0x7f1c56558a60>
2024-08-29 06:43:50,471 DEBUG     es_client.helpers.schemacheck               __init__:64   "filters" config: [{'filtertype': 'none'}]
2024-08-29 06:43:50,471 DEBUG     es_client.helpers.schemacheck               __init__:60   Schema: {'filtertype': Any(In(['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'size', 'space', 'state']), msg="filtertype must be one of ['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'size', 'space', 'state']")}
2024-08-29 06:43:50,471 DEBUG     es_client.helpers.schemacheck               __init__:62   "filter" config: {'filtertype': 'none'}
2024-08-29 06:43:50,471 DEBUG     curator.validators.filter_functions                   func:78   Filter #0: {'filtertype': 'none'}
2024-08-29 06:43:50,472 DEBUG          es_client.builder    process_config_opts:192  Using configdict values: {'elasticsearch': {'client': {'hosts': ['http://127.0.0.1:9200']}, 'other_settings': {'api_key': {}, 'master_only': False, 'skip_version_test': False}}}
2024-08-29 06:43:50,475 DEBUG     es_client.helpers.schemacheck               __init__:60   Schema: {'other_settings': {'master_only': <function Boolean at 0x7f1c564fb040>, 'skip_version_test': <function Boolean at 0x7f1c564fb1f0>, 'username': Any(None, <class 'str'>, msg=None), 'password': Any(None, <class 'str'>, msg=None), 'api_key': {'id': Any(None, <class 'str'>, msg=None), 'api_key': Any(None, <class 'str'>, msg=None), 'token': Any(None, <class 'str'>, msg=None)}}, 'client': {'hosts': Any(None, <class 'list'>, <class 'str'>, msg=None), 'cloud_id': Any(None, <class 'str'>, msg=None), 'api_key': Any(None, <class 'tuple'>, msg=None), 'basic_auth': Any(None, <class 'tuple'>, msg=None), 'bearer_auth': Any(None, <class 'str'>, msg=None), 'opaque_id': Any(None, <class 'str'>, msg=None), 'headers': Any(None, <class 'dict'>, msg=None), 'connections_per_node': Any(None, All(Coerce(int, msg=None), Range(min=1, max=100, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'http_compress': <function Boolean at 0x7f1c564fbee0>, 'verify_certs': <function Boolean at 0x7f1c564ff040>, 'ca_certs': Any(None, <class 'str'>, msg=None), 'client_cert': Any(None, <class 'str'>, msg=None), 'client_key': Any(None, <class 'str'>, msg=None), 'ssl_assert_hostname': Any(None, <class 'str'>, msg=None), 'ssl_assert_fingerprint': Any(None, <class 'str'>, msg=None), 'ssl_version': Any(None, <class 'str'>, msg=None), 'ssl_context': Any(None, <class 'str'>, msg=None), 'ssl_show_warn': <function Boolean at 0x7f1c564ff430>, 'transport_class': Any(None, <class 'str'>, msg=None), 'request_timeout': Any(None, All(Coerce(float, msg=None), Range(min=0.1, max=86400.0, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'node_class': Any(None, <class 'str'>, msg=None), 'node_pool_class': Any(None, <class 'str'>, msg=None), 'randomize_nodes_in_pool': <function Boolean at 0x7f1c564ff790>, 'node_selector_class': Any(None, <class 'str'>, msg=None), 'dead_node_backoff_factor': Any(None, <class 'float'>, msg=None), 'max_dead_node_backoff': Any(None, <class 'float'>, msg=None), 'serializer': Any(None, <class 'str'>, msg=None), 'serializers': Any(None, <class 'dict'>, msg=None), 'default_mimetype': Any(None, <class 'str'>, msg=None), 'max_retries': Any(None, All(Coerce(int, msg=None), Range(min=1, max=100, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'retry_on_status': Any(None, <class 'tuple'>, msg=None), 'retry_on_timeout': <function Boolean at 0x7f1c564ffd30>, 'sniff_on_start': <function Boolean at 0x7f1c564ffe50>, 'sniff_before_requests': <function Boolean at 0x7f1c564fff70>, 'sniff_on_node_failure': <function Boolean at 0x7f1c565050d0>, 'sniff_timeout': Any(None, All(Coerce(float, msg=None), Range(min=0.1, max=100.0, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'min_delay_between_sniffing': Any(None, All(Coerce(float, msg=None), Range(min=1, max=100.0, min_included=True, max_included=True, msg=None), msg=None), msg=None), 'sniffed_node_callback': Any(None, <class 'str'>, msg=None), 'meta_header': <function Boolean at 0x7f1c565053a0>, 'host_info_callback': Any(None, <class 'str'>, msg=None), '_transport': Any(None, <class 'str'>, msg=None)}}
2024-08-29 06:43:50,475 DEBUG     es_client.helpers.schemacheck               __init__:62   "Elasticsearch Configuration" config: {'client': {'hosts': ['http://127.0.0.1:9200']}, 'other_settings': {'api_key': {}, 'master_only': False, 'skip_version_test': False}}
2024-08-29 06:43:50,495 DEBUG          es_client.builder         _check_version:367  Detected version 8.14.3
2024-08-29 06:43:50,561 DEBUG     curator.cli_singletons.cli_action.show_indices               __init__:119  Connection result: {'name': 'elasticsearch', 'cluster_name': 'VAGRANTDEV', 'cluster_uuid': 'ZiY09-ixSlqkgPLfNP-jqg', 'version': {'number': '8.14.3', 'build_flavor': 'default', 'build_type': 'rpm', 'build_hash': 'd55f984299e0e88dee72ebd8255f7ff130859ad0', 'build_date': '2024-07-07T22:04:49.882652950Z', 'build_snapshot': False, 'lucene_version': '9.10.0', 'minimum_wire_compatibility_version': '7.17.0', 'minimum_index_compatibility_version': '7.0.0'}, 'tagline': 'You Know, for Search'}
2024-08-29 06:43:50,562 DEBUG          curator.indexlist          __get_indices:69   Getting indices matching search_pattern: "_all"
2024-08-29 06:43:50,884 DEBUG     curator.helpers.getters            get_indices:92   All indices: ['.internal.alerts-observability.apm.alerts-default-000001', '.internal.alerts-ml.anomaly-detection.alerts-default-000001', '.kibana-observability-ai-assistant-conversations-000001', '.internal.alerts-observability.metrics.alerts-default-000001', '.internal.alerts-observability.uptime.alerts-default-000001', '.kibana-observability-ai-assistant-kb-000001', '.internal.alerts-ml.anomaly-detection-health.alerts-default-000001', '.internal.alerts-observability.threshold.alerts-default-000001', '.ds-logs-generic-default-2024.08.27-000001', '.internal.alerts-default.alerts-default-000001', '.internal.alerts-observability.logs.alerts-default-000001', '.internal.alerts-transform.health.alerts-default-000001', '.internal.alerts-security.alerts-default-000001', '.internal.alerts-stack.alerts-default-000001', '.internal.alerts-observability.slo.alerts-default-000001', 'ecs-logstash-2024.08.28-000001']
2024-08-29 06:43:50,884 DEBUG     curator.cli_singletons.cli_action.show_indices             do_filters:169  Running filters and testing for empty list object
2024-08-29 06:43:50,884 DEBUG          curator.indexlist        iterate_filters:1218 Iterating over a list of filters
2024-08-29 06:43:50,884 DEBUG          curator.indexlist        iterate_filters:1223 All filters: [{'filtertype': 'none'}, {'filtertype': 'ilm', 'exclude': True}]
2024-08-29 06:43:50,884 DEBUG          curator.indexlist        iterate_filters:1225 Top of the loop: ['.internal.alerts-observability.apm.alerts-default-000001', '.internal.alerts-ml.anomaly-detection.alerts-default-000001', '.kibana-observability-ai-assistant-conversations-000001', '.internal.alerts-observability.metrics.alerts-default-000001', '.internal.alerts-observability.uptime.alerts-default-000001', '.kibana-observability-ai-assistant-kb-000001', '.internal.alerts-ml.anomaly-detection-health.alerts-default-000001', '.internal.alerts-observability.threshold.alerts-default-000001', '.ds-logs-generic-default-2024.08.27-000001', '.internal.alerts-default.alerts-default-000001', '.internal.alerts-observability.logs.alerts-default-000001', '.internal.alerts-transform.health.alerts-default-000001', '.internal.alerts-security.alerts-default-000001', '.internal.alerts-stack.alerts-default-000001', '.internal.alerts-observability.slo.alerts-default-000001', 'ecs-logstash-2024.08.28-000001']
2024-08-29 06:43:50,885 DEBUG          curator.indexlist        iterate_filters:1226 Un-parsed filter args: {'filtertype': 'none'}
2024-08-29 06:43:50,886 DEBUG     es_client.helpers.schemacheck               __init__:60   Schema: {'aliases': Any(<class 'list'>, <class 'str'>, msg=None), 'allocation_type': Any(<class 'str'>, msg=None), 'count': Coerce(int, msg=None), 'date_from': Any(None, <class 'str'>, msg=None), 'date_from_format': Any(None, <class 'str'>, msg=None), 'date_to': Any(None, <class 'str'>, msg=None), 'date_to_format': Any(None, <class 'str'>, msg=None), 'direction': Any(<class 'str'>, msg=None), 'disk_space': <class 'float'>, 'epoch': Any(Coerce(int, msg=None), None, msg=None), 'exclude': Any(None, <class 'bool'>, <class 'int'>, <class 'str'>, msg=None), 'field': Any(None, <class 'str'>, msg=None), 'intersect': Any(None, <class 'bool'>, <class 'int'>, <class 'str'>, msg=None), 'key': Any(<class 'str'>, msg=None), 'kind': Any(<class 'str'>, msg=None), 'max_num_segments': Coerce(int, msg=None), 'number_of_shards': Coerce(int, msg=None), 'pattern': Any(<class 'str'>, msg=None), 'period_type': Any(<class 'str'>, msg=None), 'reverse': Any(None, <class 'bool'>, <class 'int'>, <class 'str'>, msg=None), 'range_from': Coerce(int, msg=None), 'range_to': Coerce(int, msg=None), 'shard_filter_behavior': Any(<class 'str'>, msg=None), 'size_behavior': Any(<class 'str'>, msg=None), 'size_threshold': Any(Coerce(float, msg=None), msg=None), 'source': Any(<class 'str'>, msg=None), 'state': Any(<class 'str'>, msg=None), 'stats_result': Any(None, <class 'str'>, msg=None), 'timestring': Any(None, <class 'str'>, msg=None), 'threshold_behavior': Any(<class 'str'>, msg=None), 'unit': Any(<class 'str'>, msg=None), 'unit_count': Coerce(int, msg=None), 'unit_count_pattern': Any(<class 'str'>, msg=None), 'use_age': <function Boolean at 0x7f1c5652fca0>, 'value': Any(<class 'int'>, <class 'float'>, <class 'bool'>, <class 'str'>, msg=None), 'week_starts_on': Any(None, <class 'str'>, msg=None), 'filtertype': Any(In(['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'size', 'space', 'state']), msg="filtertype must be one of ['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'size', 'space', 'state']")}
2024-08-29 06:43:50,886 DEBUG     es_client.helpers.schemacheck               __init__:62   "filter" config: {'filtertype': 'none'}
2024-08-29 06:43:50,886 DEBUG          curator.indexlist        iterate_filters:1231 Parsed filter args: {'filtertype': 'none'}
2024-08-29 06:43:50,886 DEBUG          curator.indexlist            filter_none:889  "None" filter selected.  No filtering will be done.
2024-08-29 06:43:50,886 DEBUG          curator.indexlist        iterate_filters:1225 Top of the loop: ['.internal.alerts-observability.apm.alerts-default-000001', '.internal.alerts-ml.anomaly-detection.alerts-default-000001', '.kibana-observability-ai-assistant-conversations-000001', '.internal.alerts-observability.metrics.alerts-default-000001', '.internal.alerts-observability.uptime.alerts-default-000001', '.kibana-observability-ai-assistant-kb-000001', '.internal.alerts-ml.anomaly-detection-health.alerts-default-000001', '.internal.alerts-observability.threshold.alerts-default-000001', '.ds-logs-generic-default-2024.08.27-000001', '.internal.alerts-default.alerts-default-000001', '.internal.alerts-observability.logs.alerts-default-000001', '.internal.alerts-transform.health.alerts-default-000001', '.internal.alerts-security.alerts-default-000001', '.internal.alerts-stack.alerts-default-000001', '.internal.alerts-observability.slo.alerts-default-000001', 'ecs-logstash-2024.08.28-000001']
2024-08-29 06:43:50,886 DEBUG          curator.indexlist        iterate_filters:1226 Un-parsed filter args: {'filtertype': 'ilm', 'exclude': True}
2024-08-29 06:43:50,887 DEBUG     es_client.helpers.schemacheck               __init__:60   Schema: {'aliases': Any(<class 'list'>, <class 'str'>, msg=None), 'allocation_type': Any(<class 'str'>, msg=None), 'count': Coerce(int, msg=None), 'date_from': Any(None, <class 'str'>, msg=None), 'date_from_format': Any(None, <class 'str'>, msg=None), 'date_to': Any(None, <class 'str'>, msg=None), 'date_to_format': Any(None, <class 'str'>, msg=None), 'direction': Any(<class 'str'>, msg=None), 'disk_space': <class 'float'>, 'epoch': Any(Coerce(int, msg=None), None, msg=None), 'exclude': Any(None, <class 'bool'>, <class 'int'>, <class 'str'>, msg=None), 'field': Any(None, <class 'str'>, msg=None), 'intersect': Any(None, <class 'bool'>, <class 'int'>, <class 'str'>, msg=None), 'key': Any(<class 'str'>, msg=None), 'kind': Any(<class 'str'>, msg=None), 'max_num_segments': Coerce(int, msg=None), 'number_of_shards': Coerce(int, msg=None), 'pattern': Any(<class 'str'>, msg=None), 'period_type': Any(<class 'str'>, msg=None), 'reverse': Any(None, <class 'bool'>, <class 'int'>, <class 'str'>, msg=None), 'range_from': Coerce(int, msg=None), 'range_to': Coerce(int, msg=None), 'shard_filter_behavior': Any(<class 'str'>, msg=None), 'size_behavior': Any(<class 'str'>, msg=None), 'size_threshold': Any(Coerce(float, msg=None), msg=None), 'source': Any(<class 'str'>, msg=None), 'state': Any(<class 'str'>, msg=None), 'stats_result': Any(None, <class 'str'>, msg=None), 'timestring': Any(None, <class 'str'>, msg=None), 'threshold_behavior': Any(<class 'str'>, msg=None), 'unit': Any(<class 'str'>, msg=None), 'unit_count': Coerce(int, msg=None), 'unit_count_pattern': Any(<class 'str'>, msg=None), 'use_age': <function Boolean at 0x7f1c5652b1f0>, 'value': Any(<class 'int'>, <class 'float'>, <class 'bool'>, <class 'str'>, msg=None), 'week_starts_on': Any(None, <class 'str'>, msg=None), 'filtertype': Any(In(['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'size', 'space', 'state']), msg="filtertype must be one of ['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'size', 'space', 'state']")}
2024-08-29 06:43:50,887 DEBUG     es_client.helpers.schemacheck               __init__:62   "filter" config: {'filtertype': 'ilm', 'exclude': True}
2024-08-29 06:43:50,888 DEBUG          curator.indexlist        iterate_filters:1231 Parsed filter args: {'filtertype': 'ilm', 'exclude': True}
2024-08-29 06:43:50,888 DEBUG          curator.indexlist        iterate_filters:1237 Filter args: {'exclude': True}
2024-08-29 06:43:50,888 DEBUG          curator.indexlist        iterate_filters:1238 Pre-instance: ['.internal.alerts-observability.apm.alerts-default-000001', '.internal.alerts-ml.anomaly-detection.alerts-default-000001', '.kibana-observability-ai-assistant-conversations-000001', '.internal.alerts-observability.metrics.alerts-default-000001', '.internal.alerts-observability.uptime.alerts-default-000001', '.kibana-observability-ai-assistant-kb-000001', '.internal.alerts-ml.anomaly-detection-health.alerts-default-000001', '.internal.alerts-observability.threshold.alerts-default-000001', '.ds-logs-generic-default-2024.08.27-000001', '.internal.alerts-default.alerts-default-000001', '.internal.alerts-observability.logs.alerts-default-000001', '.internal.alerts-transform.health.alerts-default-000001', '.internal.alerts-security.alerts-default-000001', '.internal.alerts-stack.alerts-default-000001', '.internal.alerts-observability.slo.alerts-default-000001', 'ecs-logstash-2024.08.28-000001']
2024-08-29 06:43:50,888 DEBUG          curator.indexlist             filter_ilm:1180 Filtering indices with index.lifecycle.name
2024-08-29 06:43:50,997 DEBUG          curator.indexlist       __not_actionable:44   Index .internal.alerts-observability.apm.alerts-default-000001 is not actionable, removing from list.
2024-08-29 06:43:50,998 DEBUG          curator.indexlist            __excludify:63   Removed from actionable list: .internal.alerts-observability.apm.alerts-default-000001 has index.lifecycle.name .alerts-ilm-policy
2024-08-29 06:43:50,998 DEBUG          curator.indexlist       __not_actionable:44   Index .internal.alerts-ml.anomaly-detection.alerts-default-000001 is not actionable, removing from list.
2024-08-29 06:43:50,998 DEBUG          curator.indexlist            __excludify:63   Removed from actionable list: .internal.alerts-ml.anomaly-detection.alerts-default-000001 has index.lifecycle.name .alerts-ilm-policy
2024-08-29 06:43:50,998 DEBUG          curator.indexlist           __actionable:41   Index .kibana-observability-ai-assistant-conversations-000001 is actionable and remains in the list.
2024-08-29 06:43:50,998 DEBUG          curator.indexlist            __excludify:63   Remains in actionable list: index.lifecycle.name is not set for index .kibana-observability-ai-assistant-conversations-000001
2024-08-29 06:43:50,998 DEBUG          curator.indexlist       __not_actionable:44   Index .internal.alerts-observability.metrics.alerts-default-000001 is not actionable, removing from list.
2024-08-29 06:43:50,998 DEBUG          curator.indexlist            __excludify:63   Removed from actionable list: .internal.alerts-observability.metrics.alerts-default-000001 has index.lifecycle.name .alerts-ilm-policy
2024-08-29 06:43:50,998 DEBUG          curator.indexlist       __not_actionable:44   Index .internal.alerts-observability.uptime.alerts-default-000001 is not actionable, removing from list.
2024-08-29 06:43:50,998 DEBUG          curator.indexlist            __excludify:63   Removed from actionable list: .internal.alerts-observability.uptime.alerts-default-000001 has index.lifecycle.name .alerts-ilm-policy
2024-08-29 06:43:50,998 DEBUG          curator.indexlist           __actionable:41   Index .kibana-observability-ai-assistant-kb-000001 is actionable and remains in the list.
2024-08-29 06:43:50,998 DEBUG          curator.indexlist            __excludify:63   Remains in actionable list: index.lifecycle.name is not set for index .kibana-observability-ai-assistant-kb-000001
2024-08-29 06:43:50,998 DEBUG          curator.indexlist       __not_actionable:44   Index .internal.alerts-ml.anomaly-detection-health.alerts-default-000001 is not actionable, removing from list.
2024-08-29 06:43:50,998 DEBUG          curator.indexlist            __excludify:63   Removed from actionable list: .internal.alerts-ml.anomaly-detection-health.alerts-default-000001 has index.lifecycle.name .alerts-ilm-policy
2024-08-29 06:43:50,998 DEBUG          curator.indexlist       __not_actionable:44   Index .internal.alerts-observability.threshold.alerts-default-000001 is not actionable, removing from list.
2024-08-29 06:43:50,998 DEBUG          curator.indexlist            __excludify:63   Removed from actionable list: .internal.alerts-observability.threshold.alerts-default-000001 has index.lifecycle.name .alerts-ilm-policy
2024-08-29 06:43:50,998 DEBUG          curator.indexlist       __not_actionable:44   Index .ds-logs-generic-default-2024.08.27-000001 is not actionable, removing from list.
2024-08-29 06:43:50,998 DEBUG          curator.indexlist            __excludify:63   Removed from actionable list: .ds-logs-generic-default-2024.08.27-000001 has index.lifecycle.name logs
2024-08-29 06:43:50,998 DEBUG          curator.indexlist       __not_actionable:44   Index .internal.alerts-default.alerts-default-000001 is not actionable, removing from list.
2024-08-29 06:43:50,998 DEBUG          curator.indexlist            __excludify:63   Removed from actionable list: .internal.alerts-default.alerts-default-000001 has index.lifecycle.name .alerts-ilm-policy
2024-08-29 06:43:50,998 DEBUG          curator.indexlist       __not_actionable:44   Index .internal.alerts-observability.logs.alerts-default-000001 is not actionable, removing from list.
2024-08-29 06:43:50,998 DEBUG          curator.indexlist            __excludify:63   Removed from actionable list: .internal.alerts-observability.logs.alerts-default-000001 has index.lifecycle.name .alerts-ilm-policy
2024-08-29 06:43:50,998 DEBUG          curator.indexlist       __not_actionable:44   Index .internal.alerts-transform.health.alerts-default-000001 is not actionable, removing from list.
2024-08-29 06:43:50,998 DEBUG          curator.indexlist            __excludify:63   Removed from actionable list: .internal.alerts-transform.health.alerts-default-000001 has index.lifecycle.name .alerts-ilm-policy
2024-08-29 06:43:50,998 DEBUG          curator.indexlist       __not_actionable:44   Index .internal.alerts-security.alerts-default-000001 is not actionable, removing from list.
2024-08-29 06:43:50,999 DEBUG          curator.indexlist            __excludify:63   Removed from actionable list: .internal.alerts-security.alerts-default-000001 has index.lifecycle.name .alerts-ilm-policy
2024-08-29 06:43:50,999 DEBUG          curator.indexlist       __not_actionable:44   Index .internal.alerts-stack.alerts-default-000001 is not actionable, removing from list.
2024-08-29 06:43:50,999 DEBUG          curator.indexlist            __excludify:63   Removed from actionable list: .internal.alerts-stack.alerts-default-000001 has index.lifecycle.name .alerts-ilm-policy
2024-08-29 06:43:50,999 DEBUG          curator.indexlist       __not_actionable:44   Index .internal.alerts-observability.slo.alerts-default-000001 is not actionable, removing from list.
2024-08-29 06:43:50,999 DEBUG          curator.indexlist            __excludify:63   Removed from actionable list: .internal.alerts-observability.slo.alerts-default-000001 has index.lifecycle.name .alerts-ilm-policy
2024-08-29 06:43:50,999 DEBUG          curator.indexlist       __not_actionable:44   Index ecs-logstash-2024.08.28-000001 is not actionable, removing from list.
2024-08-29 06:43:50,999 DEBUG          curator.indexlist            __excludify:63   Removed from actionable list: ecs-logstash-2024.08.28-000001 has index.lifecycle.name logstash-policy
2024-08-29 06:43:50,999 DEBUG          curator.indexlist        iterate_filters:1240 Post-instance: ['.kibana-observability-ai-assistant-conversations-000001', '.kibana-observability-ai-assistant-kb-000001']
2024-08-29 06:43:50,999 DEBUG          curator.indexlist       empty_list_check:400  Checking for empty list
Traceback (most recent call last):
  File "/usr/local/bin/curator_cli", line 8, in <module>
    sys.exit(curator_cli())
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/decorators.py", line 33, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/curator/cli_singletons/show.py", line 43, in show_indices
    allbytes.append(byte_size(action.list_object.index_info[idx]['size_in_bytes']))
KeyError: '.kibana-observability-ai-assistant-conversations-000001'

Sorry for the long delayed response. I must have missed it in my inbox.

This is unusual. Thank you for the debug output. It seems that some piece of metadata is missing at a sub-key of ${index-name} for these various index names. I will attempt to replicate this.