Running benchmark-only tournaments

I'm using benchmark-only and datastore.type = elasticsearch

I'm able to list the races (I was using --track=tiny for quick tests), however - comparing 2 races completes "successfully" - but it doesn't show any metrics..

Please let me know what more information you need?

Hi Vincent,

which version of Rally do you use? Can you please provide the full output including the command you issue?

Daniel

forgot to include the link to my set-up (Docker)

esrally 0.4.6 - container image built yesterday (you can docker run so0k/es-rally locally to try it out)

https://hub.docker.com/r/so0k/es-rally

Output:

/ # esrally --pipeline=benchmark-only --target-hosts=benchtest-elasticsearch:9200 --track=tiny
/ # esrally list races

    ____        ____
   / __ \____ _/ / /_  __
  / /_/ / __ `/ / / / / /
 / _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
                /____/

[INFO] Writing logs to /root/.rally/benchmarks/races/2017-01-10-09-43-03/Kubernetes/logs/rally_out.log

Recent races:

Race Timestamp    Track    Challenge            Car       User Tag
----------------  -------  -------------------  --------  ----------
20170110T092951Z  tiny     append-no-conflicts  external
20170110T092544Z  tiny     append-no-conflicts  external

-------------------------------
[INFO] SUCCESS (took 0 seconds)
-------------------------------
/ # esrally compare --baseline 20170110T092951Z --contender=20170110T092544Z

    ____        ____
   / __ \____ _/ / /_  __
  / /_/ / __ `/ / / / / /
 / _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
                /____/

[INFO] Writing logs to /root/.rally/benchmarks/races/2017-01-10-09-43-39/Kubernetes/logs/rally_out.log

Comparing baseline
  Race timestamp: 2017-01-10 09:29:51
  Challenge: append-no-conflicts
  Car: external

with contender
  Race timestamp: 2017-01-10 09:25:44
  Challenge: append-no-conflicts
  Car: external

------------------------------------------------------
    _______             __   _____
   / ____(_)___  ____ _/ /  / ___/_________  ________
  / /_  / / __ \/ __ `/ /   \__ \/ ___/ __ \/ ___/ _ \
 / __/ / / / / / /_/ / /   ___/ / /__/ /_/ / /  /  __/
/_/   /_/_/ /_/\__,_/_/   /____/\___/\____/_/   \___/
------------------------------------------------------

  Metric    Operation    Baseline    Contender    Diff    Unit
--------  -----------  ----------  -----------  ------  ------

-------------------------------
[INFO] SUCCESS (took 1 seconds)
-------------------------------

Hi Vincent,

what you're doing looks ok to me. I'll check what's going on.

Daniel

Hi Vincent,

it's a bug in the reporting code (this means your data should be safe, you're just not seeing anything).

I just released 0.4.7 earlier today but I guess I can add a fix and do another release today or tomorrow.

Daniel

1 Like

oh sweet, thanks for the fast response! :smiley:

Hi Vincent,

you're welcome. I'm currently preparing 0.4.8 so the fix should be out soon. By the way, you should not use tiny, I already announced its removal with Rally 0.4.5 (IIRC) and it's definitely going away next week.

Daniel

Thanks, is there a comparatively quick/small track to play with tournaments and races?

You can use any track and add --test-mode. This is what our integration tests use now instead of tiny.

The release is now out: Rally 0.4.8 released

1 Like

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.