Increase in shard count vs increase in shard size - Performance comparison

Elastic Stack Elasticsearch
1

Currently we are creating an index which will take space of around 900GB. We are not able to use ILM because there are updates possible to any older data as well.

So the only option left to us is sharding optimization where we are currently in a dilemma on which of the below options we can go ahead with

Option 1: Keep number of shards as 24 with capacity of 37GB per shard
Option 2: Keep number of shards as 18 with capacity of 50GB per shard

Our main operation where optimization is needed is search as we are okay to slow down the ingestion by a bit.

Basically we want to understand which of the above options is preffered.

2

It depends on your exact workload, or indeed there may be no difference. The only way to tell would be to run your own benchmarks.

1 Like
3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.