# ES Cluster Capacity Planning - Storage Limit

**URL:** <https://discuss.elastic.co/t/es-cluster-capacity-planning-storage-limit/198915>\
**Category:** Elasticsearch\
**Created:** [September 10, 2019, 1:59pm UTC](https://discuss.elastic.co/t/es-cluster-capacity-planning-storage-limit/198915 "2019-09-10T13:59:03Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![moni15moni](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/moni15moni/32/42311_2.png) [@moni15moni](https://discuss.elastic.co/u/moni15moni)\
**Post date:** [September 10, 2019, 1:59pm UTC](https://discuss.elastic.co/t/es-cluster-capacity-planning-storage-limit/198915/1 "2019-09-10T13:59:03Z")

</div>

In elasticsearch documentation for capacity planning, I read Per GB Heap will handle the 20 shards, with avg shard size of 20 - 40 GB.

In ES Cluster it has 10 data nodes with the following config,

64 GB Heap (30 GB heap-allocated)  
16 CPU's  
2 TB SSD

What I would like to know based on the capacity planning docs,

It's illustrated data storage per Data Node ( 30 GB heap allocated to ES )

30 GB \* 20 Shards ( Each 20 - 40 GB) . = 600 Shards , Approx Disk size ( 12 TB - 24 TB ) Per node.

How much TB we can have stored max per ES Data node? , Do we have any limit on this?

I handled up to 5 TB per data node using the HDD .

Does anyone store high storage size per data node? (Real-time or benchmark)

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [September 14, 2019, 10:48am UTC](https://discuss.elastic.co/t/es-cluster-capacity-planning-storage-limit/198915/2 "2019-09-14T10:48:25Z")

</div>

The 20 shards per GB heap is a recommended maximum. The total amount of data a node can handle is generally limited by heap or query performance. There is no guarantee that a node can handle that many large shards. Have a look st [this webinar](https://www.elastic.co/webinars/optimizing-storage-efficiency-in-elasticsearch) for a discussion on the topic.

---

<div class="post-metadata">

**Author:** ![moni15moni](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/moni15moni/32/42311_2.png) [@moni15moni](https://discuss.elastic.co/u/moni15moni)\
**Post date:** [September 16, 2019, 11:11am UTC](https://discuss.elastic.co/t/es-cluster-capacity-planning-storage-limit/198915/3 "2019-09-16T11:11:55Z")

</div>

Thank You, @Christian_Dahlqvist

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 14, 2019, 11:12am UTC](https://discuss.elastic.co/t/es-cluster-capacity-planning-storage-limit/198915/4 "2019-10-14T11:12:01Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
