# How to test performance of filebeat

**URL:** https://discuss.elastic.co/t/how-to-test-performance-of-filebeat/57130
**Category:** Beats
**Tags:** filebeat
**Created:** [August 3, 2016, 4:26pm UTC](https://discuss.elastic.co/t/how-to-test-performance-of-filebeat/57130 "2016-08-03T16:26:43Z")
**Posts on this page:** 1
**Showing post:** 3

<div class="post-metadata">

### Author: ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)
#### Post date: [August 8, 2016, 12:56pm UTC](https://discuss.elastic.co/t/how-to-test-performance-of-filebeat/57130/3 "2016-08-08T12:56:44Z")

</div>

Performance will pretty much depend on your complete chain of processing. Filebeat itself can tail files pretty fast. Especially when content is still in file cache. But once you add logstash, redis, kafka or elasticsearch, performance will highly depend on network and ingest rate of your destination, as filebeat will slow down on back-pressure.

For testing you first need a source. 2 Options:

1. a prepared few hundred megabytes log files
2. acustom script writing random log lines with configurable rate simulating a real process (rate can be dynamic for simulating peek times)

Having a prepared log-file gives you an easy start. E.g. [NASA HTTP log](http://ita.ee.lbl.gov/html/contrib/NASA-HTTP.html). You can multiply log files by copying content multiple times in destination log file like `$ cat in.log in.log in.log > test.log`.

filebeat can export some stats via `-httpprof :6060` flag. Use [expvar\_rates.py](https://github.com/urso/ljtest/blob/master/scripts/expvar_rates.py) script to collect some stats.

See [this post](https://discuss.elastic.co/t/filebeat-sending-data-to-logstash-seems-too-slow/37596/13) for some more tips and how to use `expvar_rate.py` script.

There is also [collectbeat](https://github.com/urso/collectbeat), another beat collecting same information as `expvar_rates.py`, but forwards to elasticsearch. I use it with master branch, so no idea if it works with 1.x release.

---

_[View the full topic](https://discuss.elastic.co/t/how-to-test-performance-of-filebeat/57130)._
