# How can I compress or remove indirect data?

**URL:** <https://discuss.elastic.co/t/how-can-i-compress-or-remove-indirect-data/15780>\
**Category:** Elasticsearch\
**Created:** [February 13, 2014, 3:24pm UTC](https://discuss.elastic.co/t/how-can-i-compress-or-remove-indirect-data/15780 "2014-02-13T15:24:03Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Krystian\_Kulasza](https://avatars.discourse-cdn.com/v4/letter/k/91b2a8/32.png) [@Krystian\_Kulasza](https://discuss.elastic.co/u/Krystian_Kulasza)\
**Post date:** [February 13, 2014, 3:24pm UTC](https://discuss.elastic.co/t/how-can-i-compress-or-remove-indirect-data/15780/1 "2014-02-13T15:24:03Z")

</div>

Hello,

I connect few logstash agent to elasticsearch and it collect under 1GB data  
per day, I want collect all data for 1 or 3 day but older I want aggregate.  
I don't need data per one minute, enough one per hour for example.

I used this scripts  
[https://github.com/crashdump/logstash-elasticsearch-scripts](https://github.com/crashdump/logstash-elasticsearch-scripts) but this not  
resolve my problem.

Maybe somebody know how can I reduce data collect by elasticsearch?

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/a5c0f258-68c6-4270-bf64-279dc27db6a9%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/a5c0f258-68c6-4270-bf64-279dc27db6a9%40googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![jpountz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jpountz/32/45836_2.png) [@jpountz](https://discuss.elastic.co/u/jpountz)\
**Post date:** [February 13, 2014, 11:01pm UTC](https://discuss.elastic.co/t/how-can-i-compress-or-remove-indirect-data/15780/2 "2014-02-13T23:01:40Z")

</div>

Hi,

The logstash\_index\_optimize.py script should help gain back a bit of your  
disk space on your old and read-only indices.

Otherwise, unfortunately Logstash and Elasticsearch cannot index data into  
per-minute or per-hour summaries. If you are having issues regarding disk  
space, I guess there is not other choice but to decrease your rentention  
policy or to buy more disks.

On Thu, Feb 13, 2014 at 4:24 PM, Krystian Kulasza \<  
[krystian.kulasza@gmail.com](mailto:krystian.kulasza@gmail.com)\> wrote:

> Hello,
> 
> I connect few logstash agent to elasticsearch and it collect under 1GB  
> data per day, I want collect all data for 1 or 3 day but older I want  
> aggregate. I don't need data per one minute, enough one per hour for  
> example.
> 
> I used this scripts  
> [GitHub - crashdump/logstash-elasticsearch-scripts: Management scripts for Logstash over ES](https://github.com/crashdump/logstash-elasticsearch-scripts) but this not  
> resolve my problem.
> 
> Maybe somebody know how can I reduce data collect by elasticsearch?
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/a5c0f258-68c6-4270-bf64-279dc27db6a9%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/a5c0f258-68c6-4270-bf64-279dc27db6a9%40googlegroups.com)  
> .  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
Adrien Grand

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j4v\_FuYJksPLF5ahPfCvsAZeFVy5f5uNrLVR2c53b-aQQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j4v_FuYJksPLF5ahPfCvsAZeFVy5f5uNrLVR2c53b-aQQ%40mail.gmail.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:50am UTC](https://discuss.elastic.co/t/how-can-i-compress-or-remove-indirect-data/15780/3 "2017-07-06T01:50:20Z")

</div>


