Hello. I forward my logs to redis and I have logstash redis input. Logstash filter use aggregate plugin. I have real events per second rate 20k, but logstash can only 1.5 k events per sec. I use one logstash worker. My server have 16 cpus (Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz), but logstash u…

Aggregate plugin perfomance

111126 (Михаил) October 28, 2016, 3:59pm 4

what I need, I described here Specific GROK filter for multi-line Postgresql log and here https://github.com/logstash-plugins/logstash-filter-aggregate/issues/41

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.