# Storage per heap?

**URL:** <https://discuss.elastic.co/t/storage-per-heap/52157>\
**Category:** Elasticsearch\
**Created:** [June 8, 2016, 6:40am UTC](https://discuss.elastic.co/t/storage-per-heap/52157 "2016-06-08T06:40:33Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![brain](https://avatars.discourse-cdn.com/v4/letter/b/439d5e/32.png) [@brain](https://discuss.elastic.co/u/brain)\
**Post date:** [June 8, 2016, 6:40am UTC](https://discuss.elastic.co/t/storage-per-heap/52157/1 "2016-06-08T06:40:33Z")

</div>

is there a recommended storage size per heap for a node at all?

for example; if you have 16GB heap would 5tb of data for that node be too much? or if you have a node with 32GB for the heap, can it handle 10tb of data?

i couldnt find anything in the documentation and searching google has produced no results. hopefully someone here can point me in the right direction.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [June 8, 2016, 6:42am UTC](https://discuss.elastic.co/t/storage-per-heap/52157/2 "2016-06-08T06:42:47Z")

</div>

Because it all depends.  
What sort of data? What sort of queries? How many EPS/QPS? What version of ES? What version of the JVM? What do your mappings look like? How many shards? What sort of infrastructure?

---

<div class="post-metadata">

**Author:** ![brain](https://avatars.discourse-cdn.com/v4/letter/b/439d5e/32.png) [@brain](https://discuss.elastic.co/u/brain)\
**Post date:** [June 8, 2016, 6:48am UTC](https://discuss.elastic.co/t/storage-per-heap/52157/3 "2016-06-08T06:48:46Z")

</div>

currently i have 7 data nodes, ~32GB heap, 10TB of storage

as for indexes there are a few different types. all of the documents are small for each index, some are larger than others (depending on the source). the one i'm mostly concerned about;

daily average size is ~300GB with 275M documents - this will be the most frequently queried index (doc values is set). mappings on this one are quite large -- lots of fields and types, but small documents, 10 shards, 1 replica

other indexes vary quite wildly, but nothing like that  
index #2 - imported once per quarter (from static csv dataset), average size of 100GB, 95M documents, 5 shards, 2 replicas

the 3rd index i'm currently building, so no real stats there that i can use

i got carried away there; forgot to add, elasticsearch 1.7.5, latest oracle java 8

in terms of EPS, currently sits at an index rate of about 6K according to marvel, however thats about to get a dramatic increase over the next few months

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 10:45pm UTC](https://discuss.elastic.co/t/storage-per-heap/52157/4 "2017-07-05T22:45:24Z")

</div>