We are trying to use Filebeat in front of our ELK stack, feeding it logs from network sensors. We have some particularly 'talky' logs coming out of a system. One of the logs can generate 15k lines per second (eps), and has gotten up to 40k lines per second (eps). Others on that system peak out at…

Speed limitations of filebeat?

steffens (Steffen Siering) April 11, 2016, 3:47pm 6

have you tried to measure throughput in your processing chain as described here: Filebeat sending data to Logstash seems too slow ?

Topic		Replies	Views
Filebeat isn't keeping up with our logs Beats filebeat	1	450	December 2, 2021
Filebeat - logstash performances troubleshooting Beats filebeat	15	4643	April 17, 2017
Performance tunning Beats filebeat	18	3220	December 29, 2017
How fast can Filebeat send logs from disk? Beats filebeat	2	1202	June 17, 2022
Filebeat 6.2 throughput and general performance Beats filebeat	7	4456	April 3, 2018

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Speed limitations of filebeat?

Related Topics