we are running a single instance of ELK. All is running on the same server.
Processing in logstash seems fast enough, because inserted data is shown up to date in kibana.
But we have performance issues on querying. Often we get timeouts or exceptions, that es rejected because of full queue.
I wanted to try to optimize the shard size and the relation between shard and type.
But how can I loadtest the querying of es.
Is there a log where ES or kibana is logging the post data which I can fetch and reuse it in a jmeter testcase for example?
First I want to replay our productive queries against elasticsearch and find a configuration where it runs without errors. After that I would like to stress the system and find out the max usage and tune the configuration more.