Filebeat does compression when sending logs to logstash. I think sending directly to ES ingest node it will not do compression, is there any plan to add compression to ingest node?
We have lot of filebeat clients that send logs to a cloud server over internet and compression will reduce bandwith usage.
it looks like beats just added the ability to enable gzip compression of JSON payload in this pull request:
This should be included in the upcoming 5.0 release then. It also seems you need to enable http compression on the ES side by setting the "http.compression" parameter on all you nodes, and this thread also suggests your response might be compressed in that case. Some things to try out, but at least this seems to be possible somehow in the neat future.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.