In long:
Hey, I am trying to do a benchmark test against a cluster. The cluster in question contains 3 nodes in virtualbox, with no ssl restriction or authentication (fully for test). Then I have another cluster hosted in Azure where I want to store the metric store but I enabled SSL and HTTPS for this Azure cluster.
In short:
- local cluster in virtualbox to run benchmark test with rally in my local, SSL and HTTPS are disabled.
- cluster on the cloud to store the rally metrics, with SSL and HTTPS enabled.
Configuration:
- local cluster to run the test, using ELK 7.9.3
- cluster on the cloud: ELK 7.12.0
- esrally 2.2.1
- python 3.8.10 using pyenv
rally.ini:
...
[reporting]
datastore.type = elasticsearch
datastore.host = myhost.myregion.cloudapp.azure.com
datastore.port = 9200
datastore.secure = true
datastore.user = elastic # is the default user with admin privileges
datastore.password = ****
datastore.ssl.verification_mode = none
datastore.ssl.certificate_authorities = /home/user/.rally/elasticsearch-ca.pem
...
Output of the command: esrally race --track=percolator --target-hosts=node1:9200,node2:9200,node3:9200 --pipeline=benchmark-only --kill-running-processes:
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
/____/
[ERROR] Cannot race. Error in race control (Could not connect to your Elasticsearch metrics store. Please check that it is running on host [myhost.myregion.cloudapp.azure.com] at port [9200] or fix the configuration in [/home/user/.rally/rally.ini].)
---------------------------------
[INFO] FAILURE (took 487 seconds)
---------------------------------
rally.log:
...
2021-09-09 09:43:44,904 ActorAddr-(T|:41764)/PID:3073 esrally.actor INFO BenchmarkActor received unknown message [ActorExitRequest] (ignoring).
2021-09-09 09:43:47,907 -not-actor-/PID:3066 esrally.rally INFO Attempting to shutdown internal actor system.
2021-09-09 09:43:47,910 -not-actor-/PID:3072 root INFO ActorSystem Logging Shutdown
2021-09-09 09:43:47,919 -not-actor-/PID:3066 esrally.rally INFO Actor system is still running. Waiting...
2021-09-09 09:43:47,919 -not-actor-/PID:3071 root INFO ---- Actor System shutdown
2021-09-09 09:43:48,920 -not-actor-/PID:3066 esrally.rally INFO Shutdown completed.
2021-09-09 09:43:48,921 -not-actor-/PID:3066 esrally.rally ERROR Cannot run subcommand [race].
Traceback (most recent call last):
File "/home/user/.local/lib/python3.8/site-packages/esrally/rally.py", line 854, in dispatch_sub_command
race(cfg, args.kill_running_processes)
File "/home/user/.local/lib/python3.8/site-packages/esrally/rally.py", line 637, in race
with_actor_system(racecontrol.run, cfg)
File "/home/user/.local/lib/python3.8/site-packages/esrally/rally.py", line 664, in with_actor_system
runnable(cfg)
File "/home/user/.local/lib/python3.8/site-packages/esrally/racecontrol.py", line 357, in run
raise e
File "/home/user/.local/lib/python3.8/site-packages/esrally/racecontrol.py", line 354, in run
pipeline(cfg)
File "/home/user/.local/lib/python3.8/site-packages/esrally/racecontrol.py", line 60, in __call__
self.target(cfg)
File "/home/user/.local/lib/python3.8/site-packages/esrally/racecontrol.py", line 292, in benchmark_only
return race(cfg, external=True)
File "/home/user/.local/lib/python3.8/site-packages/esrally/racecontrol.py", line 251, in race
raise exceptions.RallyError(result.message, result.cause)
esrally.exceptions.RallyError: Error in race control (Could not connect to your Elasticsearch metrics store. Please check that it is running on host [myhost.myregion.cloudapp.azure.com] at port [9200] or fix the configuration in [/home/user/.rally/rally.ini].)
I don't know what I am doing wrong, should I do a sort of configuration in azure cluster in order for rally to create the metric store?