Benchmarking Filebeats

[Ravi_Shanker_Reddy]

I copied my script from the same mentioned link.

Filebeat sending data to Logstash seems too slow

why not set bulk_max_size=2048? I found 4k and 2k much better for throughput in comparison to. with this many workers on physical machine with 16 cores I measured like 45k lines/s. some ways to measure performance and look for bottlenecks: have filebeat publish to console and redirect to /dev/null. Alternatively configure file output in filebeat have filebeat->logstash, but configure logstash stdout plugin only with 'dots' codec. Use pv to measure throughput. run filebeat->logstash->elasticse…