# Are there docs to help interpret the results?

**URL:** <https://discuss.elastic.co/t/are-there-docs-to-help-interpret-the-results/73436>\
**Category:** Elasticsearch\
**Tags:** rally\
**Created:** [January 31, 2017, 10:34pm UTC](https://discuss.elastic.co/t/are-there-docs-to-help-interpret-the-results/73436 "2017-01-31T22:34:33Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![flavor8](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/flavor8/32/14984_2.png) [@flavor8](https://discuss.elastic.co/u/flavor8)\
**Post date:** [January 31, 2017, 10:34pm UTC](https://discuss.elastic.co/t/are-there-docs-to-help-interpret-the-results/73436/1 "2017-01-31T22:34:33Z")

</div>

Obviously the results from Rally are relative and depend on the cluster configuration. That said, it would be useful if there was a reference guide to explain what would be a good or a bad result for each of the scores. Does such a thing exist?

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [February 1, 2017, 6:45am UTC](https://discuss.elastic.co/t/are-there-docs-to-help-interpret-the-results/73436/2 "2017-02-01T06:45:52Z")

</div>

Hi @flavor8,

there is not so much in the official docs about that but I gave a talk around this topic at Javazone last year ([slides](http://daniel.mitterdorfer.name/talks/2016/Benchmarking%20Elasticsearch.pdf)). They usually record the talks but there was a technical problem with mine. However another [video with a very similar version of this talk](https://www.youtube.com/watch?v=HriBY2zoChw) is available.

I think it is crucial to understand the relationship between service time, latency and throughput and all these terms are explained in the talk (around 35 minutes in the talk; I overhauled slides quite a bit from the video version to make this even clearer).

I plan to improve the documentation on this front anyway but I am also happy to accept PRs. 😉

If something is not clear after you've watched the talk or looked at the slides (hint: there is bonus material at the end of the slides), please just ask questions here or even raise a doc issue in the [Rally Github repo](https://github.com/elastic/rally).

Daniel

---

<div class="post-metadata">

**Author:** ![flavor8](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/flavor8/32/14984_2.png) [@flavor8](https://discuss.elastic.co/u/flavor8)\
**Post date:** [February 1, 2017, 6:34pm UTC](https://discuss.elastic.co/t/are-there-docs-to-help-interpret-the-results/73436/3 "2017-02-01T18:34:18Z")

</div>

Thanks @danielmitterdorfer,

I watched your talk -- good presentation, and informative. We'll reapproach our benchmarking with several improvements to our process.

That said I think it would be useful to have documentation that talked about the relationships between the scores in a healthy configuration. Might be a stretch, but perhaps Rally itself could identify "green", "yellow" or "red" findings, just based on the relative differences rather than the whole numbers.

You might also offer a reference benchmark on a known cluster config. E.g. "results from geodata benchmarks with 1 dedicated master of m4.large & 2 data nodes of r4.large on a well configured(\*) cluster". That'd help give some confidence about a given configuration.

Nice work. Thanks!

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [February 3, 2017, 7:04am UTC](https://discuss.elastic.co/t/are-there-docs-to-help-interpret-the-results/73436/4 "2017-02-03T07:04:29Z")

</div>

Hi @flavor8,

glad to hear that the talk has helped you.

> [@flavor8](#):
>
> That said I think it would be useful to have documentation that talked about the relationships between the scores in a healthy configuration. Might be a stretch, but perhaps Rally itself could identify "green", "yellow" or "red" findings, just based on the relative differences rather than the whole numbers.

Interesting idea; I need to ponder that. 🙂

> [@flavor8](#):
>
> You might also offer a reference benchmark on a known cluster config. E.g. "results from geodata benchmarks with 1 dedicated master of m4.large & 2 data nodes of r4.large on a well configured(\*) cluster". That'd help give some confidence about a given configuration.

We have something like this in the making but I fear it will take some time.

Daniel

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 3, 2017, 7:05am UTC](https://discuss.elastic.co/t/are-there-docs-to-help-interpret-the-results/73436/5 "2017-03-03T07:05:04Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
