Running rally locally

After following Developing Rally - Rally 2.10.0.dev0 documentation

I ran:

(.venv) ➜  rally git:(master) python esrally/rally.py race --pipeline=benchmark-only --target-host=127.0.0.1:39200 --track=geonames --challenge=append-no-conflicts-index-only --on-error=abort --race-id=${RACE_ID}

errors:

2024-03-07 08:08:53,640 -not-actor-/PID:49360 __main__ INFO OS [uname_result(system='Darwin', node='88665a1d692f.ant.amazon.com', release='23.3.0', version='Darwin Kernel Version 23.3.0: Wed Dec 20 21:28:58 PST 2023; root:xnu-10002.81.5~7/RELEASE_X86_64', machine='x86_64', processor='i386')]
2024-03-07 08:08:53,643 -not-actor-/PID:49360 __main__ INFO Python [namespace(_multiarch='darwin', cache_tag='cpython-38', hexversion=50860272, name='cpython', version=sys.version_info(major=3, minor=8, micro=16, releaselevel='final', serial=0))]
2024-03-07 08:08:53,717 -not-actor-/PID:49360 __main__ INFO Rally version [2.10.0.dev0 (git revision: a2c09a751d7e2797fde531f90aea43ac1375c987)]
2024-03-07 08:08:53,718 -not-actor-/PID:49360 esrally.utils.net INFO Connecting directly to the Internet (no proxy support) for [all_proxy].
2024-03-07 08:08:53,643 -not-actor-/PID:49360 __main__ INFO Python [namespace(_multiarch='darwin', cache_tag='cpython-38', hexversion=50860272, name='cpython', version=sys.vers
ion_info(major=3, minor=8, micro=16, releaselevel='final', serial=0))]
2024-03-07 08:08:53,717 -not-actor-/PID:49360 __main__ INFO Rally version [2.10.0.dev0 (git revision: a2c09a751d7e2797fde531f90aea43ac1375c987)]
2024-03-07 08:08:53,718 -not-actor-/PID:49360 esrally.utils.net INFO Connecting directly to the Internet (no proxy support) for [all_proxy].
2024-03-07 08:08:53,718 -not-actor-/PID:49360 esrally.utils.net INFO Connecting directly to the Internet (no proxy support) for [all_proxy].
2024-03-07 08:08:53,718 -not-actor-/PID:49360 __main__ INFO Cleaning track dependency directory [/Users/qiaoxux/.rally/libs]...
2024-03-07 08:08:53,798 -not-actor-/PID:49360 __main__ INFO Actor system already running locally? [True]
2024-03-07 08:08:53,814 -not-actor-/PID:49360 root WARNING Unable to get address info for address freeip.amazon.com (AddressFamily.AF_INET, SocketKind.SOCK_DGRAM, 17, 0): <class 'socket.gaierror'> [Errno 8] nodename nor servname provided, or not known
2024-03-07 08:08:53,815 -not-actor-/PID:49360 root WARNING Unable to get address info for address freeip.amazon.com (AddressFamily.AF_INET, SocketKind.SOCK_DGRAM, 17, AddressInfo.AI_PASSIVE): <class 'socket.gaierror'> [Errno 8] nodename nor servname provided, or not known
2024-03-07 08:08:53,823 -not-actor-/PID:49360 esrally.racecontrol INFO Race id is [0D0EA5A3-0CE3-4E8C-9134-2BFB46084152]
2024-03-07 08:08:53,824 -not-actor-/PID:49360 esrally.racecontrol INFO User specified pipeline [benchmark-only].
2024-03-07 08:08:53,824 -not-actor-/PID:49360 esrally.racecontrol INFO Using configured hosts [{'host': '127.0.0.1', 'port': 39200}]
2024-03-07 08:08:53,834 -not-actor-/PID:49360 __main__ ERROR Cannot run subcommand [race].
Traceback (most recent call last):
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 405, in run
    pipeline(cfg)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 74, in __call__
    self.target(cfg)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 344, in benchmark_only
    return race(cfg, external=True)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 292, in race
    benchmark_actor = actor_system.createActor(BenchmarkActor, targetActorRequirements={"coordinator": True})
  File "/Volumes/workplace/rally/rally/.venv/lib/python3.8/site-packages/thespian/actors.py", line 702, in createActor
    return self._systemBase.newPrimaryActor(actorClass,
  File "/Volumes/workplace/rally/rally/.venv/lib/python3.8/site-packages/thespian/system/systemBase.py", line 201, in newPrimaryActor
    raise ImportError(str(actorClass) + ': ' + info)
ImportError: <class 'esrally.racecontrol.BenchmarkActor'>: No module named 'esrally'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "esrally/rally.py", line 1184, in dispatch_sub_command
    race(cfg, args.kill_running_processes)
  File "esrally/rally.py", line 932, in race
    with_actor_system(racecontrol.run, cfg)
  File "esrally/rally.py", line 962, in with_actor_system
    runnable(cfg)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 414, in run
    raise exceptions.RallyError("This race ended with a fatal crash.").with_traceback(tb)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 405, in run
    pipeline(cfg)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 74, in __call__
    self.target(cfg)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 344, in benchmark_only
    return race(cfg, external=True)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 292, in race
    benchmark_actor = actor_system.createActor(BenchmarkActor, targetActorRequirements={"coordinator": True})
  File "/Volumes/workplace/rally/rally/.venv/lib/python3.8/site-packages/thespian/actors.py", line 702, in createActor
    return self._systemBase.newPrimaryActor(actorClass,
  File "/Volumes/workplace/rally/rally/.venv/lib/python3.8/site-packages/thespian/system/systemBase.py", line 201, in newPrimaryActor
    raise ImportError(str(actorClass) + ': ' + info)
esrally.exceptions.RallyError: This race ended with a fatal crash.

I would think that the install has failed somehow. What output did you get from make install? You should be able to validate as well running pip3 list and validate esrally is in the output. Finally you should also be able to run rally by just typing esrally - rather than needing to do python esrally/rally.py

Also, unless you want to modify Rally itself, you should follow Installation - Rally 2.10.0.dev0 documentation instead of the development docs.

thats right, I followed dev doc because I wanted to modify Rally for contributions.

Output from make install:

➜  rally git:(master) make install
. .venv/bin/activate; python3 -m pip install --upgrade hatch==1.3.1 hatchling==1.6.0 pip==22.2 wheel==0.37.1
Requirement already satisfied: hatch==1.3.1 in ./.venv/lib/python3.8/site-packages (1.3.1)
Requirement already satisfied: hatchling==1.6.0 in ./.venv/lib/python3.8/site-packages (1.6.0)
Requirement already satisfied: pip==22.2 in ./.venv/lib/python3.8/site-packages (22.2)
Requirement already satisfied: wheel==0.37.1 in ./.venv/lib/python3.8/site-packages (0.37.1)
Requirement already satisfied: tomli-w>=1.0 in ./.venv/lib/python3.8/site-packages (from hatch==1.3.1) (1.0.0)
Requirement already satisfied: httpx>=0.22.0 in ./.venv/lib/python3.8/site-packages (from hatch==1.3.1) (0.27.0)
Requirement already satisfied: tomlkit>=0.10.1 in ./.venv/lib/python3.8/site-packages (from hatch==1.3.1) (0.12.4)
Requirement already satisfied: keyring>=23.5.0 in ./.venv/lib/python3.8/site-packages (from hatch==1.3.1) (24.3.1)
Requirement already satisfied: click>=8.0.3 in ./.venv/lib/python3.8/site-packages (from hatch==1.3.1) (8.1.7)
Requirement already satisfied: pexpect~=4.8 in ./.venv/lib/python3.8/site-packages (from hatch==1.3.1) (4.9.0)
Requirement already satisfied: rich>=11.2.0 in ./.venv/lib/python3.8/site-packages (from hatch==1.3.1) (13.7.1)
Requirement already satisfied: userpath~=1.7 in ./.venv/lib/python3.8/site-packages (from hatch==1.3.1) (1.9.2)
Requirement already satisfied: platformdirs>=2.5.0 in ./.venv/lib/python3.8/site-packages (from hatch==1.3.1) (4.2.0)
Requirement already satisfied: virtualenv>=20.13.1 in ./.venv/lib/python3.8/site-packages (from hatch==1.3.1) (20.25.1)
Requirement already satisfied: shellingham>=1.4.0 in ./.venv/lib/python3.8/site-packages (from hatch==1.3.1) (1.5.4)
Requirement already satisfied: pyperclip>=1.8.2 in ./.venv/lib/python3.8/site-packages (from hatch==1.3.1) (1.8.2)
Requirement already satisfied: packaging>=21.3 in ./.venv/lib/python3.8/site-packages (from hatchling==1.6.0) (23.2)
Requirement already satisfied: tomli>=1.2.2 in ./.venv/lib/python3.8/site-packages (from hatchling==1.6.0) (2.0.1)
Requirement already satisfied: pluggy>=1.0.0 in ./.venv/lib/python3.8/site-packages (from hatchling==1.6.0) (1.4.0)
Requirement already satisfied: pathspec>=0.9 in ./.venv/lib/python3.8/site-packages (from hatchling==1.6.0) (0.12.1)
Requirement already satisfied: editables>=0.3 in ./.venv/lib/python3.8/site-packages (from hatchling==1.6.0) (0.5)
Requirement already satisfied: sniffio in ./.venv/lib/python3.8/site-packages (from httpx>=0.22.0->hatch==1.3.1) (1.3.1)
Requirement already satisfied: certifi in ./.venv/lib/python3.8/site-packages (from httpx>=0.22.0->hatch==1.3.1) (2024.2.2)
Requirement already satisfied: idna in ./.venv/lib/python3.8/site-packages (from httpx>=0.22.0->hatch==1.3.1) (3.6)
Requirement already satisfied: anyio in ./.venv/lib/python3.8/site-packages (from httpx>=0.22.0->hatch==1.3.1) (4.3.0)
Requirement already satisfied: httpcore==1.* in ./.venv/lib/python3.8/site-packages (from httpx>=0.22.0->hatch==1.3.1) (1.0.4)
Requirement already satisfied: h11<0.15,>=0.13 in ./.venv/lib/python3.8/site-packages (from httpcore==1.*->httpx>=0.22.0->hatch==1.3.1) (0.14.0)
Requirement already satisfied: importlib-metadata>=4.11.4 in ./.venv/lib/python3.8/site-packages (from keyring>=23.5.0->hatch==1.3.1) (7.0.1)
Requirement already satisfied: importlib-resources in ./.venv/lib/python3.8/site-packages (from keyring>=23.5.0->hatch==1.3.1) (6.1.2)
Requirement already satisfied: jaraco.classes in ./.venv/lib/python3.8/site-packages (from keyring>=23.5.0->hatch==1.3.1) (3.3.1)
Requirement already satisfied: ptyprocess>=0.5 in ./.venv/lib/python3.8/site-packages (from pexpect~=4.8->hatch==1.3.1) (0.7.0)
Requirement already satisfied: typing-extensions<5.0,>=4.0.0 in ./.venv/lib/python3.8/site-packages (from rich>=11.2.0->hatch==1.3.1) (4.10.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in ./.venv/lib/python3.8/site-packages (from rich>=11.2.0->hatch==1.3.1) (2.17.2)
Requirement already satisfied: markdown-it-py>=2.2.0 in ./.venv/lib/python3.8/site-packages (from rich>=11.2.0->hatch==1.3.1) (3.0.0)
Requirement already satisfied: distlib<1,>=0.3.7 in ./.venv/lib/python3.8/site-packages (from virtualenv>=20.13.1->hatch==1.3.1) (0.3.8)
Requirement already satisfied: filelock<4,>=3.12.2 in ./.venv/lib/python3.8/site-packages (from virtualenv>=20.13.1->hatch==1.3.1) (3.13.1)
Requirement already satisfied: zipp>=0.5 in ./.venv/lib/python3.8/site-packages (from importlib-metadata>=4.11.4->keyring>=23.5.0->hatch==1.3.1) (3.17.0)
Requirement already satisfied: mdurl~=0.1 in ./.venv/lib/python3.8/site-packages (from markdown-it-py>=2.2.0->rich>=11.2.0->hatch==1.3.1) (0.1.2)
Requirement already satisfied: exceptiongroup>=1.0.2 in ./.venv/lib/python3.8/site-packages (from anyio->httpx>=0.22.0->hatch==1.3.1) (1.2.0)
Requirement already satisfied: more-itertools in ./.venv/lib/python3.8/site-packages (from jaraco.classes->keyring>=23.5.0->hatch==1.3.1) (10.2.0)

[notice] A new release of pip available: 22.2 -> 24.0
[notice] To update, run: pip install --upgrade pip
. .venv/bin/activate; python3 -m pip install -e .
Obtaining file:///Volumes/workplace/rally/rally
  Installing build dependencies ... done
  Checking if build backend supports build_editable ... done
  Getting requirements to build editable ... done
  Preparing editable metadata (pyproject.toml) ... done
Requirement already satisfied: google-resumable-media[requests]==1.1.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (1.1.0)
Requirement already satisfied: zstandard==0.21.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (0.21.0)
Requirement already satisfied: psutil==5.9.4 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (5.9.4)
Requirement already satisfied: urllib3==1.26.18 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (1.26.18)
Requirement already satisfied: elastic-transport==8.4.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (8.4.1)
Requirement already satisfied: py-cpuinfo==7.0.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (7.0.0)
Requirement already satisfied: tabulate==0.8.9 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (0.8.9)
Requirement already satisfied: thespian==3.10.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (3.10.1)
Requirement already satisfied: markupsafe==2.0.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (2.0.1)
Requirement already satisfied: docker==6.0.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (6.0.0)
Requirement already satisfied: ijson==2.6.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (2.6.1)
Requirement already satisfied: elasticsearch[async]==8.6.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (8.6.1)
Requirement already satisfied: certifi in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (2024.2.2)
Requirement already satisfied: jinja2==3.1.3 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (3.1.3)
Requirement already satisfied: jsonschema==3.1.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (3.1.1)
Requirement already satisfied: yappi==1.4.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (1.4.0)
Requirement already satisfied: google-auth==1.22.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (1.22.1)
Requirement already satisfied: packaging>=14.0 in ./.venv/lib/python3.8/site-packages (from docker==6.0.0->esrally==2.10.0.dev0) (23.2)
Requirement already satisfied: requests>=2.26.0 in ./.venv/lib/python3.8/site-packages (from docker==6.0.0->esrally==2.10.0.dev0) (2.31.0)
Requirement already satisfied: websocket-client>=0.32.0 in ./.venv/lib/python3.8/site-packages (from docker==6.0.0->esrally==2.10.0.dev0) (1.7.0)
Requirement already satisfied: aiohttp<4,>=3 in ./.venv/lib/python3.8/site-packages (from elasticsearch[async]==8.6.1->esrally==2.10.0.dev0) (3.9.3)
Requirement already satisfied: pyasn1-modules>=0.2.1 in ./.venv/lib/python3.8/site-packages (from google-auth==1.22.1->esrally==2.10.0.dev0) (0.3.0)
Requirement already satisfied: cachetools<5.0,>=2.0.0 in ./.venv/lib/python3.8/site-packages (from google-auth==1.22.1->esrally==2.10.0.dev0) (4.2.4)
Requirement already satisfied: six>=1.9.0 in ./.venv/lib/python3.8/site-packages (from google-auth==1.22.1->esrally==2.10.0.dev0) (1.16.0)
Requirement already satisfied: setuptools>=40.3.0 in ./.venv/lib/python3.8/site-packages (from google-auth==1.22.1->esrally==2.10.0.dev0) (56.0.0)
Requirement already satisfied: rsa<5,>=3.1.4 in ./.venv/lib/python3.8/site-packages (from google-auth==1.22.1->esrally==2.10.0.dev0) (4.9)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in ./.venv/lib/python3.8/site-packages (from google-resumable-media[requests]==1.1.0->esrally==2.10.0.dev0) (1.5.0)
Requirement already satisfied: attrs>=17.4.0 in ./.venv/lib/python3.8/site-packages (from jsonschema==3.1.1->esrally==2.10.0.dev0) (23.2.0)
Requirement already satisfied: importlib-metadata in ./.venv/lib/python3.8/site-packages (from jsonschema==3.1.1->esrally==2.10.0.dev0) (7.0.1)
Requirement already satisfied: pyrsistent>=0.14.0 in ./.venv/lib/python3.8/site-packages (from jsonschema==3.1.1->esrally==2.10.0.dev0) (0.20.0)
Requirement already satisfied: frozenlist>=1.1.1 in ./.venv/lib/python3.8/site-packages (from aiohttp<4,>=3->elasticsearch[async]==8.6.1->esrally==2.10.0.dev0) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in ./.venv/lib/python3.8/site-packages (from aiohttp<4,>=3->elasticsearch[async]==8.6.1->esrally==2.10.0.dev0) (6.0.5)
Requirement already satisfied: aiosignal>=1.1.2 in ./.venv/lib/python3.8/site-packages (from aiohttp<4,>=3->elasticsearch[async]==8.6.1->esrally==2.10.0.dev0) (1.3.1)
Requirement already satisfied: async-timeout<5.0,>=4.0 in ./.venv/lib/python3.8/site-packages (from aiohttp<4,>=3->elasticsearch[async]==8.6.1->esrally==2.10.0.dev0) (4.0.3)
Requirement already satisfied: yarl<2.0,>=1.0 in ./.venv/lib/python3.8/site-packages (from aiohttp<4,>=3->elasticsearch[async]==8.6.1->esrally==2.10.0.dev0) (1.9.4)
Requirement already satisfied: pyasn1<0.6.0,>=0.4.6 in ./.venv/lib/python3.8/site-packages (from pyasn1-modules>=0.2.1->google-auth==1.22.1->esrally==2.10.0.dev0) (0.5.1)
Requirement already satisfied: idna<4,>=2.5 in ./.venv/lib/python3.8/site-packages (from requests>=2.26.0->docker==6.0.0->esrally==2.10.0.dev0) (3.6)
Requirement already satisfied: charset-normalizer<4,>=2 in ./.venv/lib/python3.8/site-packages (from requests>=2.26.0->docker==6.0.0->esrally==2.10.0.dev0) (3.3.2)
Requirement already satisfied: zipp>=0.5 in ./.venv/lib/python3.8/site-packages (from importlib-metadata->jsonschema==3.1.1->esrally==2.10.0.dev0) (3.17.0)
Building wheels for collected packages: esrally
  Building editable for esrally (pyproject.toml) ... done
  Created wheel for esrally: filename=esrally-2.10.0.dev0-py3-none-any.whl size=9358 sha256=604843df072639b77602a2fb58c3b1d66989543e5a877ba951be790521394806
  Stored in directory: /private/var/folders/lf/1nn4r4lx6sx6bjjy5z3_zgxw0000gr/T/pip-ephem-wheel-cache-isv4t3tu/wheels/90/5f/b7/7f87142cf7ef6197d000f0ce078e919cc63671c4a7b892b207
Successfully built esrally
Installing collected packages: esrally
  Attempting uninstall: esrally
    Found existing installation: esrally 2.10.0.dev0
    Uninstalling esrally-2.10.0.dev0:
      Successfully uninstalled esrally-2.10.0.dev0
Successfully installed esrally-2.10.0.dev0

[notice] A new release of pip available: 22.2 -> 24.0
[notice] To update, run: pip install --upgrade pip
# Also install development dependencies
. .venv/bin/activate; python3 -m pip install -e .[develop]
Obtaining file:///Volumes/workplace/rally/rally
  Installing build dependencies ... done
  Checking if build backend supports build_editable ... done
  Getting requirements to build editable ... done
  Preparing editable metadata (pyproject.toml) ... done
Requirement already satisfied: thespian==3.10.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (3.10.1)
Requirement already satisfied: elasticsearch[async]==8.6.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (8.6.1)
Requirement already satisfied: google-resumable-media[requests]==1.1.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (1.1.0)
Requirement already satisfied: jinja2==3.1.3 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (3.1.3)
Requirement already satisfied: jsonschema==3.1.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (3.1.1)
Requirement already satisfied: markupsafe==2.0.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (2.0.1)
Requirement already satisfied: psutil==5.9.4 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (5.9.4)
Requirement already satisfied: py-cpuinfo==7.0.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (7.0.0)
Requirement already satisfied: yappi==1.4.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (1.4.0)
Requirement already satisfied: docker==6.0.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (6.0.0)
Requirement already satisfied: certifi in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (2024.2.2)
Requirement already satisfied: urllib3==1.26.18 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (1.26.18)
Requirement already satisfied: zstandard==0.21.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (0.21.0)
Requirement already satisfied: ijson==2.6.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (2.6.1)
Requirement already satisfied: google-auth==1.22.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (1.22.1)
Requirement already satisfied: elastic-transport==8.4.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (8.4.1)
Requirement already satisfied: tabulate==0.8.9 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (0.8.9)
Requirement already satisfied: trustme==0.9.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (0.9.0)
Requirement already satisfied: pytest-benchmark==3.4.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (3.4.1)
Requirement already satisfied: pytest==7.1.2 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (7.1.2)
Requirement already satisfied: furo==2022.06.21 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (2022.6.21)
Requirement already satisfied: pre-commit==2.20.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (2.20.0)
Requirement already satisfied: pylint==2.17.4 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (2.17.4)
Requirement already satisfied: github3-py==3.2.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (3.2.0)
Requirement already satisfied: pytest-asyncio==0.19.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (0.19.0)
Requirement already satisfied: nox==2022.11.21 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (2022.11.21)
Requirement already satisfied: gitpython==3.1.30 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (3.1.30)
Requirement already satisfied: tox==3.25.0 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (3.25.0)
Requirement already satisfied: boto3==1.18.46 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (1.18.46)
Requirement already satisfied: ujson in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (5.9.0)
Requirement already satisfied: sphinx==5.1.1 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (5.1.1)
Requirement already satisfied: pytest-httpserver==1.0.5 in ./.venv/lib/python3.8/site-packages (from esrally==2.10.0.dev0) (1.0.5)
Requirement already satisfied: s3transfer<0.6.0,>=0.5.0 in ./.venv/lib/python3.8/site-packages (from boto3==1.18.46->esrally==2.10.0.dev0) (0.5.2)
Requirement already satisfied: jmespath<1.0.0,>=0.7.1 in ./.venv/lib/python3.8/site-packages (from boto3==1.18.46->esrally==2.10.0.dev0) (0.10.0)
Requirement already satisfied: botocore<1.22.0,>=1.21.46 in ./.venv/lib/python3.8/site-packages (from boto3==1.18.46->esrally==2.10.0.dev0) (1.21.65)
Requirement already satisfied: requests>=2.26.0 in ./.venv/lib/python3.8/site-packages (from docker==6.0.0->esrally==2.10.0.dev0) (2.31.0)
Requirement already satisfied: packaging>=14.0 in ./.venv/lib/python3.8/site-packages (from docker==6.0.0->esrally==2.10.0.dev0) (23.2)
Requirement already satisfied: websocket-client>=0.32.0 in ./.venv/lib/python3.8/site-packages (from docker==6.0.0->esrally==2.10.0.dev0) (1.7.0)
Requirement already satisfied: aiohttp<4,>=3 in ./.venv/lib/python3.8/site-packages (from elasticsearch[async]==8.6.1->esrally==2.10.0.dev0) (3.9.3)
Requirement already satisfied: beautifulsoup4 in ./.venv/lib/python3.8/site-packages (from furo==2022.06.21->esrally==2.10.0.dev0) (4.12.3)
Requirement already satisfied: sphinx-basic-ng in ./.venv/lib/python3.8/site-packages (from furo==2022.06.21->esrally==2.10.0.dev0) (1.0.0b2)
Requirement already satisfied: pygments in ./.venv/lib/python3.8/site-packages (from furo==2022.06.21->esrally==2.10.0.dev0) (2.17.2)
Requirement already satisfied: uritemplate>=3.0.0 in ./.venv/lib/python3.8/site-packages (from github3-py==3.2.0->esrally==2.10.0.dev0) (4.1.1)
Requirement already satisfied: python-dateutil>=2.6.0 in ./.venv/lib/python3.8/site-packages (from github3-py==3.2.0->esrally==2.10.0.dev0) (2.9.0.post0)
Requirement already satisfied: PyJWT[crypto]>=2.3.0 in ./.venv/lib/python3.8/site-packages (from github3-py==3.2.0->esrally==2.10.0.dev0) (2.8.0)
Requirement already satisfied: gitdb<5,>=4.0.1 in ./.venv/lib/python3.8/site-packages (from gitpython==3.1.30->esrally==2.10.0.dev0) (4.0.11)
Requirement already satisfied: six>=1.9.0 in ./.venv/lib/python3.8/site-packages (from google-auth==1.22.1->esrally==2.10.0.dev0) (1.16.0)
Requirement already satisfied: pyasn1-modules>=0.2.1 in ./.venv/lib/python3.8/site-packages (from google-auth==1.22.1->esrally==2.10.0.dev0) (0.3.0)
Requirement already satisfied: setuptools>=40.3.0 in ./.venv/lib/python3.8/site-packages (from google-auth==1.22.1->esrally==2.10.0.dev0) (56.0.0)
Requirement already satisfied: cachetools<5.0,>=2.0.0 in ./.venv/lib/python3.8/site-packages (from google-auth==1.22.1->esrally==2.10.0.dev0) (4.2.4)
Requirement already satisfied: rsa<5,>=3.1.4 in ./.venv/lib/python3.8/site-packages (from google-auth==1.22.1->esrally==2.10.0.dev0) (4.9)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in ./.venv/lib/python3.8/site-packages (from google-resumable-media[requests]==1.1.0->esrally==2.10.0.dev0) (1.5.0)
Requirement already satisfied: attrs>=17.4.0 in ./.venv/lib/python3.8/site-packages (from jsonschema==3.1.1->esrally==2.10.0.dev0) (23.2.0)
Requirement already satisfied: importlib-metadata in ./.venv/lib/python3.8/site-packages (from jsonschema==3.1.1->esrally==2.10.0.dev0) (7.0.1)
Requirement already satisfied: pyrsistent>=0.14.0 in ./.venv/lib/python3.8/site-packages (from jsonschema==3.1.1->esrally==2.10.0.dev0) (0.20.0)
Requirement already satisfied: argcomplete<3.0,>=1.9.4 in ./.venv/lib/python3.8/site-packages (from nox==2022.11.21->esrally==2.10.0.dev0) (2.1.2)
Requirement already satisfied: virtualenv>=14 in ./.venv/lib/python3.8/site-packages (from nox==2022.11.21->esrally==2.10.0.dev0) (20.25.1)
Requirement already satisfied: colorlog<7.0.0,>=2.6.1 in ./.venv/lib/python3.8/site-packages (from nox==2022.11.21->esrally==2.10.0.dev0) (6.8.2)
Requirement already satisfied: cfgv>=2.0.0 in ./.venv/lib/python3.8/site-packages (from pre-commit==2.20.0->esrally==2.10.0.dev0) (3.4.0)
Requirement already satisfied: pyyaml>=5.1 in ./.venv/lib/python3.8/site-packages (from pre-commit==2.20.0->esrally==2.10.0.dev0) (6.0.1)
Requirement already satisfied: identify>=1.0.0 in ./.venv/lib/python3.8/site-packages (from pre-commit==2.20.0->esrally==2.10.0.dev0) (2.5.35)
Requirement already satisfied: nodeenv>=0.11.1 in ./.venv/lib/python3.8/site-packages (from pre-commit==2.20.0->esrally==2.10.0.dev0) (1.8.0)
Requirement already satisfied: toml in ./.venv/lib/python3.8/site-packages (from pre-commit==2.20.0->esrally==2.10.0.dev0) (0.10.2)
Requirement already satisfied: tomlkit>=0.10.1 in ./.venv/lib/python3.8/site-packages (from pylint==2.17.4->esrally==2.10.0.dev0) (0.12.4)
Requirement already satisfied: dill>=0.2 in ./.venv/lib/python3.8/site-packages (from pylint==2.17.4->esrally==2.10.0.dev0) (0.3.8)
Requirement already satisfied: astroid<=2.17.0-dev0,>=2.15.4 in ./.venv/lib/python3.8/site-packages (from pylint==2.17.4->esrally==2.10.0.dev0) (2.15.8)
Requirement already satisfied: platformdirs>=2.2.0 in ./.venv/lib/python3.8/site-packages (from pylint==2.17.4->esrally==2.10.0.dev0) (4.2.0)
Requirement already satisfied: isort<6,>=4.2.5 in ./.venv/lib/python3.8/site-packages (from pylint==2.17.4->esrally==2.10.0.dev0) (5.13.2)
Requirement already satisfied: mccabe<0.8,>=0.6 in ./.venv/lib/python3.8/site-packages (from pylint==2.17.4->esrally==2.10.0.dev0) (0.7.0)
Requirement already satisfied: tomli>=1.1.0 in ./.venv/lib/python3.8/site-packages (from pylint==2.17.4->esrally==2.10.0.dev0) (2.0.1)
Requirement already satisfied: typing-extensions>=3.10.0 in ./.venv/lib/python3.8/site-packages (from pylint==2.17.4->esrally==2.10.0.dev0) (4.10.0)
Requirement already satisfied: py>=1.8.2 in ./.venv/lib/python3.8/site-packages (from pytest==7.1.2->esrally==2.10.0.dev0) (1.11.0)
Requirement already satisfied: pluggy<2.0,>=0.12 in ./.venv/lib/python3.8/site-packages (from pytest==7.1.2->esrally==2.10.0.dev0) (1.4.0)
Requirement already satisfied: iniconfig in ./.venv/lib/python3.8/site-packages (from pytest==7.1.2->esrally==2.10.0.dev0) (2.0.0)
Requirement already satisfied: Werkzeug>=2.0.0 in ./.venv/lib/python3.8/site-packages (from pytest-httpserver==1.0.5->esrally==2.10.0.dev0) (2.1.2)
Requirement already satisfied: sphinxcontrib-jsmath in ./.venv/lib/python3.8/site-packages (from sphinx==5.1.1->esrally==2.10.0.dev0) (1.0.1)
Requirement already satisfied: sphinxcontrib-devhelp in ./.venv/lib/python3.8/site-packages (from sphinx==5.1.1->esrally==2.10.0.dev0) (1.0.2)
Requirement already satisfied: docutils<0.20,>=0.14 in ./.venv/lib/python3.8/site-packages (from sphinx==5.1.1->esrally==2.10.0.dev0) (0.19)
Requirement already satisfied: sphinxcontrib-htmlhelp>=2.0.0 in ./.venv/lib/python3.8/site-packages (from sphinx==5.1.1->esrally==2.10.0.dev0) (2.0.1)
Requirement already satisfied: snowballstemmer>=1.1 in ./.venv/lib/python3.8/site-packages (from sphinx==5.1.1->esrally==2.10.0.dev0) (2.2.0)
Requirement already satisfied: sphinxcontrib-serializinghtml>=1.1.5 in ./.venv/lib/python3.8/site-packages (from sphinx==5.1.1->esrally==2.10.0.dev0) (1.1.5)
Requirement already satisfied: sphinxcontrib-applehelp in ./.venv/lib/python3.8/site-packages (from sphinx==5.1.1->esrally==2.10.0.dev0) (1.0.4)
Requirement already satisfied: alabaster<0.8,>=0.7 in ./.venv/lib/python3.8/site-packages (from sphinx==5.1.1->esrally==2.10.0.dev0) (0.7.13)
Requirement already satisfied: sphinxcontrib-qthelp in ./.venv/lib/python3.8/site-packages (from sphinx==5.1.1->esrally==2.10.0.dev0) (1.0.3)
Requirement already satisfied: imagesize in ./.venv/lib/python3.8/site-packages (from sphinx==5.1.1->esrally==2.10.0.dev0) (1.4.1)
Requirement already satisfied: babel>=1.3 in ./.venv/lib/python3.8/site-packages (from sphinx==5.1.1->esrally==2.10.0.dev0) (2.14.0)
Requirement already satisfied: filelock>=3.0.0 in ./.venv/lib/python3.8/site-packages (from tox==3.25.0->esrally==2.10.0.dev0) (3.13.1)
Requirement already satisfied: cryptography in ./.venv/lib/python3.8/site-packages (from trustme==0.9.0->esrally==2.10.0.dev0) (42.0.5)
Requirement already satisfied: idna in ./.venv/lib/python3.8/site-packages (from trustme==0.9.0->esrally==2.10.0.dev0) (3.6)
Requirement already satisfied: frozenlist>=1.1.1 in ./.venv/lib/python3.8/site-packages (from aiohttp<4,>=3->elasticsearch[async]==8.6.1->esrally==2.10.0.dev0) (1.4.1)
Requirement already satisfied: yarl<2.0,>=1.0 in ./.venv/lib/python3.8/site-packages (from aiohttp<4,>=3->elasticsearch[async]==8.6.1->esrally==2.10.0.dev0) (1.9.4)
Requirement already satisfied: async-timeout<5.0,>=4.0 in ./.venv/lib/python3.8/site-packages (from aiohttp<4,>=3->elasticsearch[async]==8.6.1->esrally==2.10.0.dev0) (4.0.3)
Requirement already satisfied: aiosignal>=1.1.2 in ./.venv/lib/python3.8/site-packages (from aiohttp<4,>=3->elasticsearch[async]==8.6.1->esrally==2.10.0.dev0) (1.3.1)
Requirement already satisfied: multidict<7.0,>=4.5 in ./.venv/lib/python3.8/site-packages (from aiohttp<4,>=3->elasticsearch[async]==8.6.1->esrally==2.10.0.dev0) (6.0.5)
Requirement already satisfied: wrapt<2,>=1.11 in ./.venv/lib/python3.8/site-packages (from astroid<=2.17.0-dev0,>=2.15.4->pylint==2.17.4->esrally==2.10.0.dev0) (1.16.0)
Requirement already satisfied: lazy-object-proxy>=1.4.0 in ./.venv/lib/python3.8/site-packages (from astroid<=2.17.0-dev0,>=2.15.4->pylint==2.17.4->esrally==2.10.0.dev0) (1.10.0)
Requirement already satisfied: pytz>=2015.7 in ./.venv/lib/python3.8/site-packages (from babel>=1.3->sphinx==5.1.1->esrally==2.10.0.dev0) (2024.1)
Requirement already satisfied: smmap<6,>=3.0.1 in ./.venv/lib/python3.8/site-packages (from gitdb<5,>=4.0.1->gitpython==3.1.30->esrally==2.10.0.dev0) (5.0.1)
Requirement already satisfied: zipp>=0.5 in ./.venv/lib/python3.8/site-packages (from importlib-metadata->jsonschema==3.1.1->esrally==2.10.0.dev0) (3.17.0)
Requirement already satisfied: pyasn1<0.6.0,>=0.4.6 in ./.venv/lib/python3.8/site-packages (from pyasn1-modules>=0.2.1->google-auth==1.22.1->esrally==2.10.0.dev0) (0.5.1)
Requirement already satisfied: cffi>=1.12 in ./.venv/lib/python3.8/site-packages (from cryptography->trustme==0.9.0->esrally==2.10.0.dev0) (1.16.0)
Requirement already satisfied: charset-normalizer<4,>=2 in ./.venv/lib/python3.8/site-packages (from requests>=2.26.0->docker==6.0.0->esrally==2.10.0.dev0) (3.3.2)
Requirement already satisfied: distlib<1,>=0.3.7 in ./.venv/lib/python3.8/site-packages (from virtualenv>=14->nox==2022.11.21->esrally==2.10.0.dev0) (0.3.8)
Requirement already satisfied: soupsieve>1.2 in ./.venv/lib/python3.8/site-packages (from beautifulsoup4->furo==2022.06.21->esrally==2.10.0.dev0) (2.5)
Requirement already satisfied: pycparser in ./.venv/lib/python3.8/site-packages (from cffi>=1.12->cryptography->trustme==0.9.0->esrally==2.10.0.dev0) (2.21)
Building wheels for collected packages: esrally
  Building editable for esrally (pyproject.toml) ... done
  Created wheel for esrally: filename=esrally-2.10.0.dev0-py3-none-any.whl size=9358 sha256=604843df072639b77602a2fb58c3b1d66989543e5a877ba951be790521394806
  Stored in directory: /private/var/folders/lf/1nn4r4lx6sx6bjjy5z3_zgxw0000gr/T/pip-ephem-wheel-cache-zw2rqvg7/wheels/90/5f/b7/7f87142cf7ef6197d000f0ce078e919cc63671c4a7b892b207
Successfully built esrally
Installing collected packages: esrally
  Attempting uninstall: esrally
    Found existing installation: esrally 2.10.0.dev0
    Uninstalling esrally-2.10.0.dev0:
      Successfully uninstalled esrally-2.10.0.dev0
Successfully installed esrally-2.10.0.dev0

[notice] A new release of pip available: 22.2 -> 24.0
[notice] To update, run: pip install --upgrade pip
. .venv/bin/activate; python3 -m pip install git+https://github.com/elastic/pytest-rally.git
Collecting git+https://github.com/elastic/pytest-rally.git
  Cloning https://github.com/elastic/pytest-rally.git to /private/var/folders/lf/1nn4r4lx6sx6bjjy5z3_zgxw0000gr/T/pip-req-build-s6t7osv_
  Running command git clone --filter=blob:none --quiet https://github.com/elastic/pytest-rally.git /private/var/folders/lf/1nn4r4lx6sx6bjjy5z3_zgxw0000gr/T/pip-req-build-s6t7osv_
  Resolved https://github.com/elastic/pytest-rally.git to commit 5bc8856f0532d38590e49fe2d15d8bf98a9f947f
  Preparing metadata (setup.py) ... done

[notice] A new release of pip available: 22.2 -> 24.0
[notice] To update, run: pip install --upgrade pip

I need to run Rally in debug mode with Pycharm to make code changes.

Did you try the rest of the instructions, now that make install worked well?

source .venv/bin/activate
./rally --help

errors related to circular import, which I also encountered before when using Pycharm debug locally.

➜  rally git:(master) python esrally/rally.py --help
Traceback (most recent call last):
  File "esrally/rally.py", line 18, in <module>
    import argparse
  File "/Users/qiaoxux/.pyenv/versions/3.8.16/lib/python3.8/argparse.py", line 88, in <module>
    import re as _re
  File "/Users/qiaoxux/.pyenv/versions/3.8.16/lib/python3.8/re.py", line 124, in <module>
    import enum
  File "/Users/qiaoxux/.pyenv/versions/3.8.16/lib/python3.8/enum.py", line 2, in <module>
    from types import MappingProxyType, DynamicClassAttribute
  File "/Volumes/workplace/rally/rally/esrally/types.py", line 18, in <module>
    from typing import Any, Literal, Protocol, TypeVar
  File "/Users/qiaoxux/.pyenv/versions/3.8.16/lib/python3.8/typing.py", line 23, in <module>
    import contextlib
  File "/Users/qiaoxux/.pyenv/versions/3.8.16/lib/python3.8/contextlib.py", line 7, in <module>
    from types import MethodType
ImportError: cannot import name 'MethodType' from partially initialized module 'types' (most likely due to a circular import) (/Volumes/workplace/rally/rally/esrally/types.py)

Again, please stop using python esrally/rally.py --help. This is the source of the issue. When doing that, esrally is not considered as a Python package so esrally.types becomes types and conflicts with the standard library.

Please use ./rally --help instead. Or esrally --help which does not perform updates but also works thanks to the editable install made by make install.

I got same error when running using ./rally:

./rally race --pipeline=benchmark-only --target-host=127.0.0.1:39200 --track=geonames --challenge=append-no-conflicts-index-only --on-error=abort --race-id=${RACE_ID}

ImportError: <class 'esrally.racecontrol.BenchmarkActor'>: No module named 'esrally'

Is this the full error?

Can you also please paste the full output you get with esrally --version?

the full error was posted in the original topic.

esrally --version did not give me any errors though - the errors occurred when systemBase class in thespianpy trying to import esrally.racecontrol.BenchmarkActor

(.venv) ➜  rally git:(master) esrally --version
esrally 2.10.0.dev0 (git revision: a2c09a751d7e2797fde531f90aea43ac1375c987)

Ah, I thought esrally --version failed too. Can you please remove the log file (rm ~/.rally/log/rally.log), then try running your race, and send us ~/.rally/log/rally.log?

Sure, here is the complete log:

2024-03-10 19:56:02,837 -not-actor-/PID:95729 esrally.rally INFO OS [uname_result(system='Darwin', node='88665a1d692f.ant.amazon.com', release='23.3.0', version='Darwin Kernel Version 23.3.0: Wed Dec 20 21:28:58 PST 2023; root:xnu-10002.81.5~7/RELEASE_X86_64', machine='x86_64', processor='i386')]
2024-03-10 19:56:02,837 -not-actor-/PID:95729 esrally.rally INFO Python [namespace(_multiarch='darwin', cache_tag='cpython-38', hexversion=50860272, name='cpython', version=sys.version_info(major=3, minor=8, micro=16, releaselevel='final', serial=0))]
2024-03-10 19:56:02,905 -not-actor-/PID:95729 esrally.rally INFO Rally version [2.10.0.dev0 (git revision: a2c09a751d7e2797fde531f90aea43ac1375c987)]
2024-03-10 19:56:02,906 -not-actor-/PID:95729 esrally.utils.net INFO Connecting directly to the Internet (no proxy support) for [all_proxy].
2024-03-10 19:56:02,906 -not-actor-/PID:95729 esrally.utils.net INFO Connecting directly to the Internet (no proxy support) for [all_proxy].
2024-03-10 19:56:02,906 -not-actor-/PID:95729 esrally.rally INFO Cleaning track dependency directory [/Users/qiaoxux/.rally/libs]...
2024-03-10 19:56:02,977 -not-actor-/PID:95729 esrally.rally INFO Actor system already running locally? [True]
2024-03-10 19:56:03,16 -not-actor-/PID:95729 esrally.racecontrol INFO Race id is [0D0EA5A3-0CE3-4E8C-9134-2BFB46084152]
2024-03-10 19:56:03,17 -not-actor-/PID:95729 esrally.racecontrol INFO User specified pipeline [benchmark-only].
2024-03-10 19:56:03,17 -not-actor-/PID:95729 esrally.racecontrol INFO Using configured hosts [{'host': '127.0.0.1', 'port': 39200}]
2024-03-10 19:56:03,34 -not-actor-/PID:95729 esrally.rally ERROR Cannot run subcommand [race].
Traceback (most recent call last):
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 405, in run
    pipeline(cfg)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 74, in __call__
    self.target(cfg)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 344, in benchmark_only
    return race(cfg, external=True)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 292, in race
    benchmark_actor = actor_system.createActor(BenchmarkActor, targetActorRequirements={"coordinator": True})
  File "/Volumes/workplace/rally/rally/.venv/lib/python3.8/site-packages/thespian/actors.py", line 702, in createActor
    return self._systemBase.newPrimaryActor(actorClass,
  File "/Volumes/workplace/rally/rally/.venv/lib/python3.8/site-packages/thespian/system/systemBase.py", line 201, in newPrimaryActor
    raise ImportError(str(actorClass) + ': ' + info)
ImportError: <class 'esrally.racecontrol.BenchmarkActor'>: No module named 'esrally'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Volumes/workplace/rally/rally/esrally/rally.py", line 1184, in dispatch_sub_command
    race(cfg, args.kill_running_processes)
  File "/Volumes/workplace/rally/rally/esrally/rally.py", line 932, in race
    with_actor_system(racecontrol.run, cfg)
  File "/Volumes/workplace/rally/rally/esrally/rally.py", line 962, in with_actor_system
    runnable(cfg)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 414, in run
    raise exceptions.RallyError("This race ended with a fatal crash.").with_traceback(tb)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 405, in run
    pipeline(cfg)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 74, in __call__
    self.target(cfg)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 344, in benchmark_only
    return race(cfg, external=True)
  File "/Volumes/workplace/rally/rally/esrally/racecontrol.py", line 292, in race
    benchmark_actor = actor_system.createActor(BenchmarkActor, targetActorRequirements={"coordinator": True})
  File "/Volumes/workplace/rally/rally/.venv/lib/python3.8/site-packages/thespian/actors.py", line 702, in createActor
    return self._systemBase.newPrimaryActor(actorClass,
  File "/Volumes/workplace/rally/rally/.venv/lib/python3.8/site-packages/thespian/system/systemBase.py", line 201, in newPrimaryActor
    raise ImportError(str(actorClass) + ': ' + info)
esrally.exceptions.RallyError: This race ended with a fatal crash.

Thanks for your patience.

As you might know, Rally is a distributed system which allows it to send load from multiple machines as well as handle the setup/teardown of Elasticsearch clusters. In your case, the actor system is already running:

2024-03-07 08:08:53,798 -not-actor-/PID:49360 __main__ INFO Actor system already running locally? [True]

The failures indicate that it is running with a broken installation of Rally. Can you please stop the actor system with ./rallyd stop? Then you can check that it has indeed stopped using ps aux | grep rally and making sure no rally process is left.

And then you can retry your race.

That works! Thanks!

(.venv) ➜  rally git:(master) python esrally/rally.py race --pipeline=benchmark-only --target-host=127.0.0.1:39200 --track=geonames --challenge=append-no-conflicts-index-only --on-error=abort --race-id=${RACE_ID} --kill-running-processes


    ____        ____
   / __ \____ _/ / /_  __
  / /_/ / __ `/ / / / / /
 / _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
                /____/

[INFO] Race id is [0D0EA5A3-0CE3-4E8C-9134-2BFB46084152]
[INFO] Racing on track [geonames], challenge [append-no-conflicts-index-only] and car ['external'] with version [8.12.2].

Running delete-index                                                           [100% done]
Running create-index                                                           [100% done]
Running check-cluster-health                                                   [  0% done]
1 Like

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.