# Crashed with out of memory

**URL:** <https://discuss.elastic.co/t/crashed-with-out-of-memory/38014>\
**Category:** Elasticsearch\
**Created:** [December 28, 2015, 2:19am UTC](https://discuss.elastic.co/t/crashed-with-out-of-memory/38014 "2015-12-28T02:19:02Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![justmao945](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/justmao945/32/4211_2.png) [@justmao945](https://discuss.elastic.co/u/justmao945)\
**Post date:** [December 28, 2015, 2:19am UTC](https://discuss.elastic.co/t/crashed-with-out-of-memory/38014/1 "2015-12-28T02:19:02Z")

</div>

Hi all,

My cluster has 4 machines, every node has 8 CPUS, 32GB memory, and has thousands of indices and shards. Some nodes were crashed with out of memory error during query in recent days. I found the segments memory uses about 14gb of the heap size 16gb, and never be released. If I do more query, nodes will crashed with OOM error, so what can I do to avoid this error ?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [December 28, 2015, 2:28am UTC](https://discuss.elastic.co/t/crashed-with-out-of-memory/38014/2 "2015-12-28T02:28:33Z")

</div>

Add more memory/nodes or reduce the amount of data you have on the cluster and query.

How many shards and indices in total?

---

<div class="post-metadata">

**Author:** ![justmao945](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/justmao945/32/4211_2.png) [@justmao945](https://discuss.elastic.co/u/justmao945)\
**Post date:** [December 28, 2015, 2:37am UTC](https://discuss.elastic.co/t/crashed-with-out-of-memory/38014/3 "2015-12-28T02:37:47Z")

</div>

1000 indices, 7000 shards, every index has 1 segment and is about 6gb

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [December 28, 2015, 2:39am UTC](https://discuss.elastic.co/t/crashed-with-out-of-memory/38014/4 "2015-12-28T02:39:59Z")

</div>

You're wasting a lot of memory on shards, with 4 nodes and indices that big I would only have 1 primary + 1 replica shard.

Are you using doc values?

---

<div class="post-metadata">

**Author:** ![justmao945](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/justmao945/32/4211_2.png) [@justmao945](https://discuss.elastic.co/u/justmao945)\
**Post date:** [December 28, 2015, 2:42am UTC](https://discuss.elastic.co/t/crashed-with-out-of-memory/38014/5 "2015-12-28T02:42:08Z")

</div>

do you mean 1 shard per index ?  
What's doc values ?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [December 28, 2015, 3:03am UTC](https://discuss.elastic.co/t/crashed-with-out-of-memory/38014/6 "2015-12-28T03:03:36Z")

</div>

Yes, one per index, with a replica.

[https://www.elastic.co/guide/en/elasticsearch/reference/current/doc-values.html](https://www.elastic.co/guide/en/elasticsearch/reference/current/doc-values.html)

---

<div class="post-metadata">

**Author:** ![justmao945](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/justmao945/32/4211_2.png) [@justmao945](https://discuss.elastic.co/u/justmao945)\
**Post date:** [December 28, 2015, 3:06am UTC](https://discuss.elastic.co/t/crashed-with-out-of-memory/38014/7 "2015-12-28T03:06:34Z")

</div>

OK, I'll have a try, thank you.😀

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 11:28pm UTC](https://discuss.elastic.co/t/crashed-with-out-of-memory/38014/8 "2017-07-05T23:28:23Z")

</div>


