# How to calculate disk space needed for a cluster?

**URL:** <https://discuss.elastic.co/t/how-to-calculate-disk-space-needed-for-a-cluster/213445>\
**Category:** Elasticsearch\
**Created:** [December 31, 2019, 12:04pm UTC](https://discuss.elastic.co/t/how-to-calculate-disk-space-needed-for-a-cluster/213445 "2019-12-31T12:04:56Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![tortillla](https://avatars.discourse-cdn.com/v4/letter/t/cc9497/32.png) [@tortillla](https://discuss.elastic.co/u/tortillla)\
**Post date:** [December 31, 2019, 12:04pm UTC](https://discuss.elastic.co/t/how-to-calculate-disk-space-needed-for-a-cluster/213445/1 "2019-12-31T12:04:56Z")

</div>

I would like to have a rough estimate on how much disk space is required for a cluster. I found a paper that includes the following equation for calculating disk space:

![equation](https://us1.discourse-cdn.com/elastic/original/3X/3/9/39c4d9551c8221899f5e0dfaeeb14c2361898ea5.png)

I am trying to find any Elastic documentation on estimating disk space, but cannot find any. The paper did not mention if the equation was just made up or taken from some source.

Is this equation accurate?

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [January 1, 2020, 12:44pm UTC](https://discuss.elastic.co/t/how-to-calculate-disk-space-needed-for-a-cluster/213445/2 "2020-01-01T12:44:40Z")

</div>

It's not completely inaccurate but it is certainly an oversimplification. The 0.85 in the denominator indicates that the size of each shard on disk is about 117% (1/0.85) of the input size. In fact the ratio of input size to size on disk can vary greatly depending on your configuration. Here is an old blog post showing various configurations with ratios between 61% and 140%:

[https://www.elastic.co/blog/elasticsearch-storage-the-true-story](https://www.elastic.co/blog/elasticsearch-storage-the-true-story)

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [January 1, 2020, 12:52pm UTC](https://discuss.elastic.co/t/how-to-calculate-disk-space-needed-for-a-cluster/213445/3 "2020-01-01T12:52:32Z")

</div>

As David points out this seems to be a simpification. I do however wonder if the 0.85 factor is meant to account for the fact that watermarks will prevent you from using the full disk capacity and that you need some headroom. [This blog post](https://www.elastic.co/blog/filebeat-modiles-access-logs-and-elasticsearch-storage-requirements) also provides some information as does [this one](https://www.elastic.co/blog/sizing-hot-warm-architectures-for-logging-and-metrics-in-the-elasticsearch-service-on-elastic-cloud).

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [January 1, 2020, 1:03pm UTC](https://discuss.elastic.co/t/how-to-calculate-disk-space-needed-for-a-cluster/213445/4 "2020-01-01T13:03:56Z")

</div>

Good point, it could be for the default low disk watermark indeed. In which case there's no accounting for compression/expansion at all.

---

<div class="post-metadata">

**Author:** ![loren](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/loren/32/44942_2.png) [@loren](https://discuss.elastic.co/u/loren)\
**Post date:** [January 1, 2020, 4:30pm UTC](https://discuss.elastic.co/t/how-to-calculate-disk-space-needed-for-a-cluster/213445/5 "2020-01-01T16:30:46Z")

</div>

In an update-heavy environment, be sure to take deleted docs into consideration as this could add another 50% to the index size.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [January 30, 2020, 4:58am UTC](https://discuss.elastic.co/t/how-to-calculate-disk-space-needed-for-a-cluster/213445/7 "2020-01-30T04:58:32Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
