# Running benchmark-only tournaments

**URL:** <https://discuss.elastic.co/t/running-benchmark-only-tournaments/71056>\
**Category:** Elasticsearch\
**Tags:** rally\
**Created:** [January 10, 2017, 10:18am UTC](https://discuss.elastic.co/t/running-benchmark-only-tournaments/71056 "2017-01-10T10:18:48Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![so0k](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/so0k/32/14422_2.png) [@so0k](https://discuss.elastic.co/u/so0k)\
**Post date:** [January 10, 2017, 10:18am UTC](https://discuss.elastic.co/t/running-benchmark-only-tournaments/71056/1 "2017-01-10T10:18:49Z")

</div>

I'm using benchmark-only and datastore.type = elasticsearch

I'm able to list the races (I was using --track=tiny for quick tests), however - comparing 2 races completes "successfully" - but it doesn't show any metrics..

Please let me know what more information you need?

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [January 10, 2017, 10:22am UTC](https://discuss.elastic.co/t/running-benchmark-only-tournaments/71056/2 "2017-01-10T10:22:48Z")

</div>

Hi Vincent,

which version of Rally do you use? Can you please provide the full output including the command you issue?

Daniel

---

<div class="post-metadata">

**Author:** ![so0k](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/so0k/32/14422_2.png) [@so0k](https://discuss.elastic.co/u/so0k)\
**Post date:** [January 10, 2017, 10:29am UTC](https://discuss.elastic.co/t/running-benchmark-only-tournaments/71056/3 "2017-01-10T10:29:28Z")

</div>

forgot to include the link to my set-up (Docker)

> **[honestbee/docker-esrally](https://github.com/honestbee/docker-esrally)**
>
> docker-esrally - Benchmark Elasticsearch with Rally

esrally 0.4.6 - container image built yesterday (you can `docker run so0k/es-rally` locally to try it out)

[https://hub.docker.com/r/so0k/es-rally](https://hub.docker.com/r/so0k/es-rally)

**Output** :

```
/ # esrally --pipeline=benchmark-only --target-hosts=benchtest-elasticsearch:9200 --track=tiny
/ # esrally list races

    ________
   / __\____ _/ / /_ __
  / /_/ / __ `/ / / / / /
 / _, _/ /_/ / / / /_/ /
/_/ |_|\ __,_/_/_/\__ , /
                / ____ /

[INFO] Writing logs to /root/.rally/benchmarks/races/2017-01-10-09-43-03/Kubernetes/logs/rally_out.log

Recent races:

Race Timestamp Track Challenge Car User Tag
---------------- ------- ------------------- -------- ----------
20170110T092951Z tiny append-no-conflicts external
20170110T092544Z tiny append-no-conflicts external

-------------------------------
[INFO] SUCCESS (took 0 seconds)
-------------------------------
/ # esrally compare --baseline 20170110T092951Z --contender=20170110T092544Z

    ________
   / __\____ _/ / /_ __
  / /_/ / __ `/ / / / / /
 / _, _/ /_/ / / / /_/ /
/_/ |_|\ __,_/_/_/\__ , /
                / ____ /

[INFO] Writing logs to /root/.rally/benchmarks/races/2017-01-10-09-43-39/Kubernetes/logs/rally_out.log

Comparing baseline
  Race timestamp: 2017-01-10 09:29:51
  Challenge: append-no-conflicts
  Car: external

with contender
  Race timestamp: 2017-01-10 09:25:44
  Challenge: append-no-conflicts
  Car: external

------------------------------------------------------
    _________  _____
   / ____(_)___  _____/ / /___ / _________________
  / /_ / / __\/__ `/ / \ __\/___ / __\/___ / _ \
 / __/ / / / / / /_/ / /___ / / / __/ /_/ / / /__ /
/_/ /_/_/ /_/\ __,_/_/ /____ /\ ___/\____ /_/ \___/
------------------------------------------------------

  Metric Operation Baseline Contender Diff Unit
-------- ----------- ---------- ----------- ------ ------

-------------------------------
[INFO] SUCCESS (took 1 seconds)
-------------------------------
```

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [January 10, 2017, 11:10am UTC](https://discuss.elastic.co/t/running-benchmark-only-tournaments/71056/4 "2017-01-10T11:10:49Z")

</div>

Hi Vincent,

what you're doing looks ok to me. I'll check what's going on.

Daniel

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [January 10, 2017, 2:29pm UTC](https://discuss.elastic.co/t/running-benchmark-only-tournaments/71056/5 "2017-01-10T14:29:51Z")

</div>

Hi Vincent,

it's a bug in the reporting code (this means your data should be safe, you're just not seeing anything).

I just released 0.4.7 earlier today but I guess I can add a fix and do another release today or tomorrow.

Daniel

---

<div class="post-metadata">

**Author:** ![so0k](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/so0k/32/14422_2.png) [@so0k](https://discuss.elastic.co/u/so0k)\
**Post date:** [January 10, 2017, 5:01pm UTC](https://discuss.elastic.co/t/running-benchmark-only-tournaments/71056/6 "2017-01-10T17:01:12Z")

</div>

oh sweet, thanks for the fast response! 😃

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [January 10, 2017, 5:05pm UTC](https://discuss.elastic.co/t/running-benchmark-only-tournaments/71056/7 "2017-01-10T17:05:56Z")

</div>

Hi Vincent,

you're welcome. I'm currently preparing 0.4.8 so the fix should be out soon. By the way, you should not use `tiny`, I already announced its removal with Rally 0.4.5 (IIRC) and it's definitely going away next week.

Daniel

---

<div class="post-metadata">

**Author:** ![so0k](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/so0k/32/14422_2.png) [@so0k](https://discuss.elastic.co/u/so0k)\
**Post date:** [January 10, 2017, 5:13pm UTC](https://discuss.elastic.co/t/running-benchmark-only-tournaments/71056/8 "2017-01-10T17:13:20Z")

</div>

Thanks, is there a comparatively quick/small track to play with tournaments and races?

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [January 10, 2017, 5:20pm UTC](https://discuss.elastic.co/t/running-benchmark-only-tournaments/71056/9 "2017-01-10T17:20:50Z")

</div>

You can use any track and add `--test-mode`. This is what our integration tests use now instead of `tiny`.

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [January 10, 2017, 6:02pm UTC](https://discuss.elastic.co/t/running-benchmark-only-tournaments/71056/10 "2017-01-10T18:02:18Z")

</div>

The release is now out: [Rally 0.4.8 released](https://discuss.elastic.co/t/rally-0-4-8-released/71130)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 7, 2017, 6:02pm UTC](https://discuss.elastic.co/t/running-benchmark-only-tournaments/71056/11 "2017-02-07T18:02:44Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
