We are trying to use Filebeat in front of our ELK stack, feeding it logs from network sensors. We have some particularly 'talky' logs coming out of a system. One of the logs can generate 15k lines per second (eps), and has gotten up to 40k lines per second (eps). Others on that system peak out at…

Speed limitations of filebeat?

steffens (Steffen Siering) April 11, 2016, 3:47pm 6

have you tried to measure throughput in your processing chain as described here: Filebeat sending data to Logstash seems too slow ?

Topic		Replies	Views
Filebeat sending data to Logstash seems too slow Beats filebeat	20	22139	June 1, 2017
Filebeat isn't keeping up with our logs Beats filebeat	1	453	December 2, 2021
Filebeat - logstash performances troubleshooting Beats filebeat	15	4648	April 17, 2017
Filebeat slowing to a halt within 20-30 minutes of starting Beats filebeat	4	1362	May 19, 2017
Performance tunning Beats filebeat	18	3220	December 29, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Speed limitations of filebeat?

Related topics