# AppSearch disk consumption keeps growing

**URL:** <https://discuss.elastic.co/t/appsearch-disk-consumption-keeps-growing/236101>\
**Category:** Elastic Search\
**Tags:** elastic-app-search\
**Created:** [June 7, 2020, 6:14pm UTC](https://discuss.elastic.co/t/appsearch-disk-consumption-keeps-growing/236101 "2020-06-07T18:14:51Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![gpribi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gpribi/32/65066_2.png) [@gpribi](https://discuss.elastic.co/u/gpribi)\
**Post date:** [June 7, 2020, 6:14pm UTC](https://discuss.elastic.co/t/appsearch-disk-consumption-keeps-growing/236101/1 "2020-06-07T18:14:51Z")

</div>

Hello, I see my dockerized Enterprise Elastic Search v7.7.0 self hosted appsearch is consuming each time more and more disk space, even my document count is almost the same.

I even deleted the engine (30k records) but didn't see any change in the disk space after an hour. Then I made a full import of my documents and the disk space didn't change noticeabilly nither. I guess that's ES way to handle the filesystem.

After that I've been using appsearch normally, but it has increased 4gb in less than a week. I still have 30k documents.  
Could it be the analytics indexes? Or some sort of transaction logs? In Kibana I see a lot of EES indexes.

How can I stop EES eating my storage? Or delete the analytics in order to free disk space?  
Please help. I can't keep increasing my storage every week

---

<div class="post-metadata">

**Author:** ![gpribi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gpribi/32/65066_2.png) [@gpribi](https://discuss.elastic.co/u/gpribi)\
**Post date:** [June 7, 2020, 8:15pm UTC](https://discuss.elastic.co/t/appsearch-disk-consumption-keeps-growing/236101/2 "2020-06-07T20:15:38Z")

</div>

This is my Kibana report for bigger indexes. As you can see, all of them regard logging and monitoring wich I don't need.

 ![ScreenHunter_302 Jun. 07 17.14](https://us1.discourse-cdn.com/elastic/original/3X/4/e/4e9a7d684ffa08c781c8e2283a17e8daa1fa6f1c.jpeg)

---

<div class="post-metadata">

**Author:** ![gpribi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gpribi/32/65066_2.png) [@gpribi](https://discuss.elastic.co/u/gpribi)\
**Post date:** [June 16, 2020, 3:22pm UTC](https://discuss.elastic.co/t/appsearch-disk-consumption-keeps-growing/236101/3 "2020-06-16T15:22:53Z")

</div>

Any ideas? 😕

---

<div class="post-metadata">

**Author:** ![wangqinghuan](https://avatars.discourse-cdn.com/v4/letter/w/d26b3c/32.png) [@wangqinghuan](https://discuss.elastic.co/u/wangqinghuan)\
**Post date:** [June 23, 2020, 4:38am UTC](https://discuss.elastic.co/t/appsearch-disk-consumption-keeps-growing/236101/4 "2020-06-23T04:38:03Z")

</div>

Hi  
I see a setting 'xpack.monitoring.history.duration' that can set retention duration in [this](https://www.elastic.co/guide/en/elasticsearch/reference/current/monitoring-settings.html) doc. And other indices could be deleted automatically, I believe.

---

<div class="post-metadata">

**Author:** ![gpribi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gpribi/32/65066_2.png) [@gpribi](https://discuss.elastic.co/u/gpribi)\
**Post date:** [June 28, 2020, 12:11am UTC](https://discuss.elastic.co/t/appsearch-disk-consumption-keeps-growing/236101/5 "2020-06-28T00:11:43Z")

</div>

Thank you. That setting doesn't work with basic licence, so I'm stuck with 7d history of those indices. At least, they have their retention.

The other indices (.ent-search-api-ecs-logs-togo\_production and .ent-search-app-search-analytics-ecs-logs-togo\_production) still accumulate endlessly

---

<div class="post-metadata">

**Author:** ![wangqinghuan](https://avatars.discourse-cdn.com/v4/letter/w/d26b3c/32.png) [@wangqinghuan](https://discuss.elastic.co/u/wangqinghuan)\
**Post date:** [June 28, 2020, 6:03am UTC](https://discuss.elastic.co/t/appsearch-disk-consumption-keeps-growing/236101/6 "2020-06-28T06:03:22Z")

</div>

Another way , use indices management tool like Elasticsearch Curator to manage indices automatically.

---

<div class="post-metadata">

**Author:** ![gpribi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gpribi/32/65066_2.png) [@gpribi](https://discuss.elastic.co/u/gpribi)\
**Post date:** [June 28, 2020, 4:04pm UTC](https://discuss.elastic.co/t/appsearch-disk-consumption-keeps-growing/236101/7 "2020-06-28T16:04:38Z")

</div>

Thanks. I should check on that!

However the bottomline about this issue is whether I can or can't delete those EES indexes, since they are automatically created by this module, not being automatically deleted, and have no way to manage them in the EES console.

if I delete them, am I going to break something? Do I need to have any precautions regarding their age?

I guess next time my HD is about to fill, I'll find it out...

---

<div class="post-metadata">

**Author:** ![gpribi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gpribi/32/65066_2.png) [@gpribi](https://discuss.elastic.co/u/gpribi)\
**Post date:** [June 28, 2020, 9:48pm UTC](https://discuss.elastic.co/t/appsearch-disk-consumption-keeps-growing/236101/8 "2020-06-28T21:48:47Z")

</div>

I deleted all those logs and everything seems to be working fine.

It would be nice to find a way to avoid them to be created in the first place 🙂

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 26, 2020, 9:48pm UTC](https://discuss.elastic.co/t/appsearch-disk-consumption-keeps-growing/236101/9 "2020-07-26T21:48:51Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
