How to re configure a data stream for lowering the usage of shards

Elastic Stack Elasticsearch
,
1

I have a data stream which is associated with an index template which create 3 shards per index daily. This is a time based indices which creates new index daily. We are approaching the maximum number of allowed shards in our cluster and hence we need to re index these existing data stream indices so that we can lower the number of shards . We are not afforded to spin up new nodes. The indicies in this data stream is very low in size and most of them in KBs.Could you please help with some options.

We have 3 master nodes and 3 data nodes in our cluster.

2

Hi vijaybpzr!

You can use the shrink API to reduce the number of shards for a given index. Note that the index must be readonly and all primary shards must reside on the same node.

If your indices use an ILM policy you can also have ILM handle this process as part of your phase actions. See Shrink | Elasticsearch Guide [7.15] | Elastic for more information.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.