# Working on old Indices

**URL:** <https://discuss.elastic.co/t/working-on-old-indices/162347>\
**Category:** Elasticsearch\
**Created:** [December 28, 2018, 1:41pm UTC](https://discuss.elastic.co/t/working-on-old-indices/162347 "2018-12-28T13:41:24Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Zerobot](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zerobot/32/48977_2.png) [@Zerobot](https://discuss.elastic.co/u/Zerobot)\
**Post date:** [December 28, 2018, 1:41pm UTC](https://discuss.elastic.co/t/working-on-old-indices/162347/1 "2018-12-28T13:41:24Z")

</div>

Hi!  
I was wondering if it's possible to "thin" documents in an index and by thinning I mean dropping 99.9% of docs in it - let's say all fields are numeric so I would like to find average of 1000 values, remove all those values and end up only with averages of every field.

Reason behind that would be: trying to store 1-2 years of data, around 100GB daily gives something close to 30 TB per year and that's quite too much for my infrastructure. Currently another solution is being used and they are literally storing 1 year of data on a 100 GB filesystem because they are calculating those averages / means for all field so instead of holding 100GB daily they store like 1 MB 🙂  
Would that be possible in elasticsearch? Also, I'm using Elasticsearch + Graylog.

---

<div class="post-metadata">

**Author:** ![Igor\_Motov](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/igor_motov/32/45193_2.png) [@Igor\_Motov](https://discuss.elastic.co/u/Igor_Motov)\
**Post date:** [December 28, 2018, 3:20pm UTC](https://discuss.elastic.co/t/working-on-old-indices/162347/2 "2018-12-28T15:20:04Z")

</div>

You mean something like [Rollup API](https://www.elastic.co/guide/en/elasticsearch/reference/6.x/rollup-overview.html)?

---

<div class="post-metadata">

**Author:** ![Zerobot](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zerobot/32/48977_2.png) [@Zerobot](https://discuss.elastic.co/u/Zerobot)\
**Post date:** [December 28, 2018, 5:04pm UTC](https://discuss.elastic.co/t/working-on-old-indices/162347/3 "2018-12-28T17:04:37Z")

</div>

Yeah that's exactly the thing I was looking for! Thanks 🙂

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [January 25, 2019, 5:04pm UTC](https://discuss.elastic.co/t/working-on-old-indices/162347/4 "2019-01-25T17:04:44Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.