As our data size is quite big, we wish to reduce the size of the record. Is it possible to do some kind of aggregation before indexing into ES in logstash? For example, it is possible to put only the record of the max value of specific field over 1 min into ES index ? Or just put one of every 10 rec…

Is there any way to reduce the size of data before indexing into elasticserch

iammanmale April 14, 2021, 1:41am 3

Thank you for quick reply. Let me have a look.
By the way, is it possible to accomplish the same thing on filebeat to reduce the network loading?

Topic		Replies	Views
How can I compress or remove indirect data? Elasticsearch	2	422	July 6, 2017
Reduce size data logs Elasticsearch	2	556	December 12, 2018
How To make my elasticsearch index smaller by field values? Elasticsearch	2	255	November 22, 2021
How to reduce primary storage size Beats filebeat	8	547	November 18, 2020
ES input : ingest aggregation result Logstash	1	601	September 4, 2017