Running benchmark-only tournaments

Elastic Stack Elasticsearch
1

I'm using benchmark-only and datastore.type = elasticsearch

I'm able to list the races (I was using --track=tiny for quick tests), however - comparing 2 races completes "successfully" - but it doesn't show any metrics..

Please let me know what more information you need?

2

Hi Vincent,

which version of Rally do you use? Can you please provide the full output including the command you issue?

Daniel

3

forgot to include the link to my set-up (Docker)

esrally 0.4.6 - container image built yesterday (you can docker run so0k/es-rally locally to try it out)

https://hub.docker.com/r/so0k/es-rally

Output:

/ # esrally --pipeline=benchmark-only --target-hosts=benchtest-elasticsearch:9200 --track=tiny
/ # esrally list races

    ____        ____
   / __ \____ _/ / /_  __
  / /_/ / __ `/ / / / / /
 / _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
                /____/

[INFO] Writing logs to /root/.rally/benchmarks/races/2017-01-10-09-43-03/Kubernetes/logs/rally_out.log

Recent races:

Race Timestamp    Track    Challenge            Car       User Tag
----------------  -------  -------------------  --------  ----------
20170110T092951Z  tiny     append-no-conflicts  external
20170110T092544Z  tiny     append-no-conflicts  external

-------------------------------
[INFO] SUCCESS (took 0 seconds)
-------------------------------
/ # esrally compare --baseline 20170110T092951Z --contender=20170110T092544Z

    ____        ____
   / __ \____ _/ / /_  __
  / /_/ / __ `/ / / / / /
 / _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
                /____/

[INFO] Writing logs to /root/.rally/benchmarks/races/2017-01-10-09-43-39/Kubernetes/logs/rally_out.log

Comparing baseline
  Race timestamp: 2017-01-10 09:29:51
  Challenge: append-no-conflicts
  Car: external

with contender
  Race timestamp: 2017-01-10 09:25:44
  Challenge: append-no-conflicts
  Car: external

------------------------------------------------------
    _______             __   _____
   / ____(_)___  ____ _/ /  / ___/_________  ________
  / /_  / / __ \/ __ `/ /   \__ \/ ___/ __ \/ ___/ _ \
 / __/ / / / / / /_/ / /   ___/ / /__/ /_/ / /  /  __/
/_/   /_/_/ /_/\__,_/_/   /____/\___/\____/_/   \___/
------------------------------------------------------

  Metric    Operation    Baseline    Contender    Diff    Unit
--------  -----------  ----------  -----------  ------  ------

-------------------------------
[INFO] SUCCESS (took 1 seconds)
-------------------------------
4

Hi Vincent,

what you're doing looks ok to me. I'll check what's going on.

Daniel

5

Hi Vincent,

it's a bug in the reporting code (this means your data should be safe, you're just not seeing anything).

I just released 0.4.7 earlier today but I guess I can add a fix and do another release today or tomorrow.

Daniel

1 Like
6

oh sweet, thanks for the fast response! :smiley:

7

Hi Vincent,

you're welcome. I'm currently preparing 0.4.8 so the fix should be out soon. By the way, you should not use tiny, I already announced its removal with Rally 0.4.5 (IIRC) and it's definitely going away next week.

Daniel

8

Thanks, is there a comparatively quick/small track to play with tournaments and races?

9

You can use any track and add --test-mode. This is what our integration tests use now instead of tiny.

10

The release is now out: Rally 0.4.8 released

1 Like
11

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.