I would like to benchmark high volume requests using esrally. I'm trying to max somewhere between 500k-1M RPM. I've modified an existing challenge and changed the client and target-throughput values to match 500k RPM with a few thousand clients. However, esrally seems to hang and I don't see traffic coming through on my cluster.
I don't think I'm using the best approach to accomplish this. Appreciate any advice.
Actually it appears when doing benchmark-only pipeline at any target-throughput rate, I only see 1 request coming through in my data node monitor. Should I not see number of requests coming in corresponding to the target-throughput rate? What am I doing wrong?