# Memory Issues: linear growth in the memory when using daily indexing

**URL:** <https://discuss.elastic.co/t/memory-issues-linear-growth-in-the-memory-when-using-daily-indexing/112662>\
**Category:** Elasticsearch\
**Created:** [December 20, 2017, 3:14pm UTC](https://discuss.elastic.co/t/memory-issues-linear-growth-in-the-memory-when-using-daily-indexing/112662 "2017-12-20T15:14:23Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![pravj](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/pravj/32/20386_2.png) [@pravj](https://discuss.elastic.co/u/pravj)\
**Post date:** [December 20, 2017, 3:14pm UTC](https://discuss.elastic.co/t/memory-issues-linear-growth-in-the-memory-when-using-daily-indexing/112662/1 "2017-12-20T15:14:24Z")

</div>

Hi all,

I have an ELK setup that uses per-day-indexing `PREFIX-%{+YYYY.MM.dd}`.

The memory consumed by the setup keeps growing with more indices, leading to a system restart with extra memory allocation. I observe a drop in the memory usage after the restart but eventually ending up in the same situation.

It's storing almost `5,00,000` events daily with `5 shards` and `a replica`. Currently, I have allocated `32GB` RAM to the system running ELK.

I am assuming this is because of the daily-indexing, and plan to switch to a monthly-indexing.

It will be helpful if you can review my observations and guide for the same.

Is there any rule of thumb to scale with more events?  
OR  
Is there anything else that I'm missing completely?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [December 20, 2017, 4:51pm UTC](https://discuss.elastic.co/t/memory-issues-linear-growth-in-the-memory-when-using-daily-indexing/112662/2 "2017-12-20T16:51:08Z")

</div>

Read [this blog post for guidande on shard count and size](https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [January 17, 2018, 4:52pm UTC](https://discuss.elastic.co/t/memory-issues-linear-growth-in-the-memory-when-using-daily-indexing/112662/3 "2018-01-17T16:52:03Z")

</div>

Closed on January 17, 2018, 4:52pm UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.