Currently shrinking a series of index patterns and running into a problem suddenly. When shrinking our main index pattern, I suddenly get a red index health. The source index is only 2.2GB, 5 shards, 1 replica and I get this behavior every time with this index pattern.
The new index is created, however no docs or size and just a read state. I'm using Curator and I don't see any errors in the log, even with Debug logs.
The really weird thing is that I've probably shrunk 300 indices in other index patterns without a single issue.
Any input on how to trouble shoot this?
ES v6.3.1
Curator v5.5.4 and v5.6.0
Log:
Configuration:
actions:
1:
action: shrink
description: >-
Shrink selected indices on the node with the most available space.
Delete source index after successful shrink, then reroute the shrunk
index with the provided parameters.
options:
ignore_empty_list: True
shrink_node: DETERMINISTIC
node_filters:
permit_masters: True
number_of_shards: 1
number_of_replicas: 1
shrink_prefix:
shrink_suffix: '-cold'
delete_after: True
wait_for_active_shards: 1
extra_settings:
settings:
index.codec: best_compression
wait_for_completion: True
wait_for_rebalance: True
wait_interval: 9
max_wait: -1
filters:
- filtertype: pattern
kind: prefix
value: logstash-2018.1
- filtertype: age
source: creation_date
direction: older
unit: days
unit_count: 100