# Not able to figure out number of shards in my cluster

**URL:** <https://discuss.elastic.co/t/not-able-to-figure-out-number-of-shards-in-my-cluster/199436>\
**Category:** Elasticsearch\
**Created:** [September 13, 2019, 1:22pm UTC](https://discuss.elastic.co/t/not-able-to-figure-out-number-of-shards-in-my-cluster/199436 "2019-09-13T13:22:26Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![adarshzphin](https://avatars.discourse-cdn.com/v4/letter/a/958977/32.png) [@adarshzphin](https://discuss.elastic.co/u/adarshzphin)\
**Post date:** [September 13, 2019, 1:22pm UTC](https://discuss.elastic.co/t/not-able-to-figure-out-number-of-shards-in-my-cluster/199436/1 "2019-09-13T13:22:26Z")

</div>

I have 5 node cluster. 1 dedicated master node ( 16 GB/4 core ) and 4 data nodes (32 GB/8 cores/ 5 TB SSD )on each data node . I am having around 10 TB of data to store in one index(as of now not doing time base indexing cause of my use case) on Elasticsearch.  
Please help me to figure out to how many shards should I keep for faster query.

Any suggestion would be helpful!

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [September 14, 2019, 9:40am UTC](https://discuss.elastic.co/t/not-able-to-figure-out-number-of-shards-in-my-cluster/199436/2 "2019-09-14T09:40:09Z")

</div>

The first thing I would like to point out, even though it is not related to what you are asking, is that you always should aim to run at least 3 master eligible nodes in order to avoid s single point of failure.

When it comes to shard size and count and the impact on query performance this heavily depends on your data, mappings, types of queries and how many concurrent queries you need to support. It is hard to give a general answer do I would recommend running some benchmarks to find out.

---

<div class="post-metadata">

**Author:** ![adarshzphin](https://avatars.discourse-cdn.com/v4/letter/a/958977/32.png) [@adarshzphin](https://discuss.elastic.co/u/adarshzphin)\
**Post date:** [September 16, 2019, 5:50am UTC](https://discuss.elastic.co/t/not-able-to-figure-out-number-of-shards-in-my-cluster/199436/3 "2019-09-16T05:50:47Z")

</div>

yes... that we have kept 2 master eligible master node as you have mentioned.

Now, comes to query part, mostly I have count queries, I just wanted to know, is that fine if I keep 200-300 number of shards having 30 GB each in the cluster as per my given configuration.

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [September 16, 2019, 6:01am UTC](https://discuss.elastic.co/t/not-able-to-figure-out-number-of-shards-in-my-cluster/199436/4 "2019-09-16T06:01:57Z")

</div>

> [@adarshzphin](#):
>
> that we have kept 2 master eligible master node as you have mentioned.

You need **at least 3** master eligible nodes in a cluster for high availability. 2 is not enough.

> [@adarshzphin](#):
>
> Now, comes to query part, mostly I have count queries, I just wanted to know, is that fine if I keep 200-300 number of shards having 30 GB each in the cluster as per my given configuration.

That gives around 2.5TB per node, which should be possible. The amount of data stored per node is generally limited by query performance or heap usage. Have a look at [this webinar](https://www.elastic.co/webinars/optimizing-storage-efficiency-in-elasticsearch) for more details.

---

<div class="post-metadata">

**Author:** ![adarshzphin](https://avatars.discourse-cdn.com/v4/letter/a/958977/32.png) [@adarshzphin](https://discuss.elastic.co/u/adarshzphin)\
**Post date:** [September 16, 2019, 6:08am UTC](https://discuss.elastic.co/t/not-able-to-figure-out-number-of-shards-in-my-cluster/199436/5 "2019-09-16T06:08:12Z")

</div>

Sure. I am new in es and really needed input from expert.  
Thanks a lot for your input.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 14, 2019, 6:08am UTC](https://discuss.elastic.co/t/not-able-to-figure-out-number-of-shards-in-my-cluster/199436/6 "2019-10-14T06:08:15Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
