Hi All,
ElasticSearch 6.5.4 and Curator 5.6
I'm testing out curator and have it successfully moving shards from 'hot' nodes to 'warm' nodes.
I'm now looking at shrinking the shards down to 3 (3 warm nodes). This is working 'sort of' except that the replica shards are being initialised on my 'hot' / nodes in the ignored list then being moved back to warm once they have been initialised on the wrong nodes.
Also I'm seeing all 3 active shards being created on one 'warm' node then again being redistributed once the process in complete.
Is there anything wrong with my config or a feature of curator?
My curator config is this:
actions:
1:
action: shrink
description: >-
Shrink selected indices on the node with the most available space.
Delete source index after successful shrink, then reroute the shrunk
index with the provided parameters.
options:
ignore_empty_list: True
shrink_node: DETERMINISTIC
node_filters:
permit_masters: False
exclude_nodes: ["10.12.74.11", "10.12.74.12", "10.12.74.13", "10.12.74.14", "10.12.74.15", "10.12.74.16", "10.12.74.17", "10.12.74.18", "10.12.74.19"]
number_of_shards: 3
number_of_replicas: 1
shrink_prefix:
shrink_suffix: '-shrink'
delete_after: True
post_allocation:
allocation_type: include
key: boxtype
value: warm
wait_for_active_shards: 1
extra_settings:
settings:
index.codec: best_compression
wait_for_completion: True
wait_for_rebalance: True
wait_interval: 9
max_wait: -1
filters:
- filtertype: pattern
kind: prefix
value: graylog_
- filtertype: age
source: creation_date
direction: older
unit: hours
unit_count: 80
- filtertype: age
source: creation_date
direction: younger
unit: hours
unit_count: 100