I noticed that the document says it need 1000 iterations or more in order to calculate 99.9th percentile. here
I wonder that why it has to base on number of iterations but not the actual amount of requests.
In many tracks, including Rally default tracks, define iteration and target-throughput. For example, one of the percolator track's operation,
According to the document, I understand that the operation will make 50 requests per iteration for 100 times. Result in total of 5000 requests. Which is more than enough for calculating 99.9th percentile since the sample size is more than 1000.
(Honestly this specific number of percentile is not really important to me. But this is the shortest question that will help answer many other questions in my mind)
Hi! Thank you for your interest in Rally. We appreciate that you take the time to read our documentation and ask questions about it, as it's the best way to get reliable benchmarks.
According to the document, I understand that the operation will make 50 requests per iteration for 100 times. Result in total of 5000 requests. Which is more than enough for calculating 99.9th percentile since the sample size is more than 1000.
Thank you for your answer! Now I can understand more clearly.
From your info, it means that Rally will make 50 requests per second and will take roughly 2 seconds to finish the task, sending 100 requests in total.
So the iteration is actually the numbers of request to be sent to Elasticsearch. Is it correct?
If so, it would be great if this can be more clarified in the docs. When I read through these words, there is no apparent relation between them.
To be specific, the latency section in summary report only mention about request, not iteration. Although the FAQ can give me some clue about iteration being the request itself, I started to confuse again when I read at the throughput-throttled mode section and target-throughput definition since they did not really explain me enough how to interpret the meaning of iteration. Leading to this misunderstanding.
(I actually went skimming through the code (include the part that you mentioned) but gave up after few hours )
It's more complicated than that. While apparently true in your case, it depends on the operation you're using (it could make multiple requests per iteration) and the number of clients you have (as iterations are defined per-client).
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.
)
While apparently true in your case, it depends on the operation you're using (it could make multiple requests per iteration) and the number of clients you have (as iterations are defined per-client).