Hi!
I have a logging system which is basicly standard. Logstash ships into Kafka, Logstash pulls from Kafka and puts the messages into Elasticsearch. The shipper logstashs open several ports for different formats (like GELF, fluentd and syslog).
I was now wondering how I could loadtest this setup. Is there a tool which generates specific messages in different formats? I would like to tell this tool "send as many GELF messages of size X as you can" or "send mixed messages of GELF and fluentd from size 1kb to 3kb".
Is there such a tool? I found tools for loadtesting Elasticsearch, but that would not reflect the actual speed of the entire pipeline.
Thanks for any help,
Alex