Still new to ELK. I have logstash running on my machine generating 1mbps of plain text data(with lot of redundancy of text in logs). Is there a way to encode/compress this output so it consumes less bandwidth and at the same time I need/want to decode this on cloud and feed it my elasticsearch.
Logstash(on my machine low resources)(compressed data) --> (decode it some how) elasticsearch(on my server)
Logstash(on my machine low resources)(compress data output plugin) --> (decode data input plugin)(logstash)(on centralized server)(elastic search output plugin)---> elasticsearch(on my server)
Are there any ways or plugins to address my problem. theme is to save network bandwidth.