Reduce number of shard

Elastic Stack Elasticsearch
1

My Elasticsearch received three logs:
Log_A
Log_B
Log_C

To facilitate index lifecycle management (iLM), I updated the index names as follows:
Log_A_YYYYMMDD
Log_B_YYYYMMDD
Log_C_YYYYMMDD

Consequently, a new index is created every day.

Now, my concern is that as the number of indices grows, so does the number of shards (one primary shard and one replica).

How can I effectively manage the increasing number of shards

2

What is the size of each shard? If not 50gb each then you are probably wasting a lot of resources. Increasing the max number of shards on the cluster with the same number of nodes is not really an option unless you want to take some risks...

The other option is to add more nodes as the number of shards grows.

But to me the best thing to use is Data streams | Elasticsearch Guide [8.13] | Elastic.

3

Thanks for the reply.
Would it be a good idea to create a index every 30days instead of daily

4

It depends of the estimated size of a shard for 30 days. That's what datastreams are solving. They just rollover automatically for you basically.