# How to reduce terms\_memory\_in\_bytes? Help Help Help

**URL:** <https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135>\
**Category:** Elasticsearch\
**Created:** [May 4, 2016, 8:20am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135 "2016-05-04T08:20:06Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![liusy](https://avatars.discourse-cdn.com/v4/letter/l/e95f7d/32.png) [@liusy](https://discuss.elastic.co/u/liusy)\
**Post date:** [May 4, 2016, 8:20am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/1 "2016-05-04T08:20:06Z")

</div>

"segments" : {  
"count" : 11954,  
"memory\_in\_bytes" : 12613933974,  
"terms\_memory\_in\_bytes" : 10524364098,  
"stored\_fields\_memory\_in\_bytes" : 2057138120,  
"term\_vectors\_memory\_in\_bytes" : 0,  
"norms\_memory\_in\_bytes" : 0,  
"doc\_values\_memory\_in\_bytes" : 32431756,  
"index\_writer\_memory\_in\_bytes" : 129807028,  
"index\_writer\_max\_memory\_in\_bytes" : 14773611532,  
"version\_map\_memory\_in\_bytes" : 26636779,  
"fixed\_bit\_set\_memory\_in\_bytes" : 0  
}

As the topic

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 4, 2016, 8:25am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/2 "2016-05-04T08:25:19Z")

</div>

What version are you on?

---

<div class="post-metadata">

**Author:** ![liusy](https://avatars.discourse-cdn.com/v4/letter/l/e95f7d/32.png) [@liusy](https://discuss.elastic.co/u/liusy)\
**Post date:** [May 4, 2016, 8:34am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/3 "2016-05-04T08:34:10Z")

</div>

2.3.1 tks

---

<div class="post-metadata">

**Author:** ![liusy](https://avatars.discourse-cdn.com/v4/letter/l/e95f7d/32.png) [@liusy](https://discuss.elastic.co/u/liusy)\
**Post date:** [May 4, 2016, 8:57am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/4 "2016-05-04T08:57:19Z")

</div>

@warkolm You have any suggestions?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 4, 2016, 9:34am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/5 "2016-05-04T09:34:50Z")

</div>

Are you using doc values wherever is possible?

---

<div class="post-metadata">

**Author:** ![liusy](https://avatars.discourse-cdn.com/v4/letter/l/e95f7d/32.png) [@liusy](https://discuss.elastic.co/u/liusy)\
**Post date:** [May 4, 2016, 9:51am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/6 "2016-05-04T09:51:42Z")

</div>

yes ! all field use doc\_values

---

<div class="post-metadata">

**Author:** ![liusy](https://avatars.discourse-cdn.com/v4/letter/l/e95f7d/32.png) [@liusy](https://discuss.elastic.co/u/liusy)\
**Post date:** [May 4, 2016, 9:57am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/7 "2016-05-04T09:57:42Z")

</div>

use store is The default type,It's cause by Lucene term dictionary ?

---

<div class="post-metadata">

**Author:** ![liusy](https://avatars.discourse-cdn.com/v4/letter/l/e95f7d/32.png) [@liusy](https://discuss.elastic.co/u/liusy)\
**Post date:** [May 5, 2016, 6:25am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/8 "2016-05-05T06:25:58Z")

</div>

@warkolm Help Help Help

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 7, 2016, 12:41am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/9 "2016-05-07T00:41:26Z")

</div>

You have a lot of shards, how much data in the cluster?

---

<div class="post-metadata">

**Author:** ![liusy](https://avatars.discourse-cdn.com/v4/letter/l/e95f7d/32.png) [@liusy](https://discuss.elastic.co/u/liusy)\
**Post date:** [May 7, 2016, 6:20am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/10 "2016-05-07T06:20:20Z")

</div>

primary\_shards : 12055  
active\_shards : 24110  
100TB Data in cluster  
24 data node

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 7, 2016, 6:23am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/11 "2016-05-07T06:23:38Z")

</div>

You're probably at the limits of what you can do with that many nodes then.

You may want to look at reducing the shard count too, that's only ~4GB a shard, which is very small.

---

<div class="post-metadata">

**Author:** ![liusy](https://avatars.discourse-cdn.com/v4/letter/l/e95f7d/32.png) [@liusy](https://discuss.elastic.co/u/liusy)\
**Post date:** [May 7, 2016, 6:41am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/12 "2016-05-07T06:41:03Z")

</div>

too big shard will create other problems ?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 7, 2016, 6:52am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/13 "2016-05-07T06:52:39Z")

</div>

What other problems?

---

<div class="post-metadata">

**Author:** ![liusy](https://avatars.discourse-cdn.com/v4/letter/l/e95f7d/32.png) [@liusy](https://discuss.elastic.co/u/liusy)\
**Post date:** [May 7, 2016, 6:56am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/14 "2016-05-07T06:56:42Z")

</div>

Index performance 、 Recovery rate

---

<div class="post-metadata">

**Author:** ![liusy](https://avatars.discourse-cdn.com/v4/letter/l/e95f7d/32.png) [@liusy](https://discuss.elastic.co/u/liusy)\
**Post date:** [May 7, 2016, 6:57am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/15 "2016-05-07T06:57:56Z")

</div>

Generally recommended shard size range is？

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 7, 2016, 7:00am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/16 "2016-05-07T07:00:05Z")

</div>

Less than 50GB.

Are all your shards an even size? Do you have some really small ones with hardly any data, and then some that are really larger?

---

<div class="post-metadata">

**Author:** ![liusy](https://avatars.discourse-cdn.com/v4/letter/l/e95f7d/32.png) [@liusy](https://discuss.elastic.co/u/liusy)\
**Post date:** [May 7, 2016, 7:02am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/17 "2016-05-07T07:02:48Z")

</div>

The vast majority in 2-16 g

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 7, 2016, 7:08am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/18 "2016-05-07T07:08:47Z")

</div>

You should definitely increase the size.

---

<div class="post-metadata">

**Author:** ![liusy](https://avatars.discourse-cdn.com/v4/letter/l/e95f7d/32.png) [@liusy](https://discuss.elastic.co/u/liusy)\
**Post date:** [May 7, 2016, 7:20am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/19 "2016-05-07T07:20:36Z")

</div>

you are so nice ,tks!!!

---

<div class="post-metadata">

**Author:** ![liusy](https://avatars.discourse-cdn.com/v4/letter/l/e95f7d/32.png) [@liusy](https://discuss.elastic.co/u/liusy)\
**Post date:** [May 9, 2016, 5:31am UTC](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135/20 "2016-05-09T05:31:07Z")

</div>

Increase shard size,but don't solve this problem, only reduce 5% memory in use。  
I want to know content in terms\_memory, when and how it's generated，it's can LRU?

[Next page](https://discuss.elastic.co/t/how-to-reduce-terms-memory-in-bytes-help-help-help/49135.md?page=2)
