I am using beaver to monitor a single log file and dump the contents as JSON to redis, from where logstash picks it up via the redis input plugin. This is working but the throughput is poor.
After performing some analysis the problem is with beaver - it is only adding records to redis at a rate of ~250 per second, when I know redis is capable of significantly higher throughput.
The server is utilising approx 5% CPU and has plenty of memory spare.
Is anyone else using beaver to ship to redis, and if so what sort of throughput are you getting?