Can you configure filebeat to exit as soon as eof is reached?


(Lin Zhao) #1

I'm trying to do benchmark on filebeat and elasticsearch and would like to time the time taken to publish and index a file. Closest configuration I can find is close_eof, but it doesn't cause filebeat process to exit.


(ruflin) #2

This is currently not possible. Here is an open issue for this feature request: https://github.com/elastic/beats/issues/880


(Steffen Siering) #3

As this is not possible yet, I normally use -httpprof :6060 to open the beats HTTP debugging endpoint and fetch number of published events about every second. This gives me the throughput. Search Beats forum for expvar_rates.py for python script showing the current rate + some average rate.

Using collectbeat throughput info can be written to another/local elasticsearch instance for querying via kibana. Build might be broken from time to time + it might work with master most recent beats alpha only as I update from time to time to keep up with master branch (no versioning yet).


(system) #4

This topic was automatically closed after 21 days. New replies are no longer allowed.