# Error Benchmarking AWS Managed Elasticsearch Cluster (version 7.10) using esrally **URL:** \ **Category:** Elasticsearch\ **Tags:** rally\ **Created:** [June 7, 2024, 11:51am UTC](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031 "2024-06-07T11:51:53Z")\ **Posts on this page:** 12\ **Page:** 1
**Author:** ![Peter\_Eskandar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/peter_eskandar/32/135115_2.png) [@Peter\_Eskandar](https://discuss.elastic.co/u/Peter_Eskandar)\ **Post date:** [June 7, 2024, 11:51am UTC](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031/1 "2024-06-07T11:51:53Z")
I'm attempting to benchmark an AWS Managed Elasticsearch Cluster (version: 7.10) using esrally, but I'm encountering the following error: ```auto ________ / __\____ _/ / /_ __ / /_/ / __ `/ / / / / / / _, _/ /_/ / / / /_/ / /_/ |_|\ __,_/_/_/\__ , / / ____ / [INFO] Race id is [a84cd7ee-f35e-4183-a87f-508622f857fc] [ERROR] Cannot race. Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/esrally/actor.py", line 92, in guard return f(self, msg, sender) File "/usr/local/lib/python3.9/site-packages/esrally/racecontrol.py", line 114, in receiveMsg_Setup self.coordinator.setup(sources=msg.sources) File "/usr/local/lib/python3.9/site-packages/esrally/racecontrol.py", line 203, in setup ) = client.factory.cluster_distribution_version(hosts, client_options) File "/usr/local/lib/python3.9/site-packages/esrally/client/factory.py", line 359, in cluster_distribution_version version = es.info()["version"] File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/utils.py", line 414, in wrapped return api(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/ __init__.py", line 2296, in info return self.perform_request( # type: ignore[return-value] File "/usr/local/lib/python3.9/site-packages/esrally/client/synchronous.py", line 178, in perform_request _ProductChecker.raise_error(self._verified_elasticsearch, info_meta, info_body) File "/usr/local/lib/python3.9/site-packages/esrally/client/synchronous.py", line 73, in raise_error raise UnsupportedProductError(message, meta=meta, body=body) elasticsearch.UnsupportedProductError: The client noticed that the server is not a supported distribution of Elasticsearch ``` ### Environment Details - **Elasticsearch Version** : 7.10 (AWS Managed) - **esrally Version** : [2.11.0] ### Command used : ```auto esrally race --pipeline benchmark-only \ --track=geonames --challenge append-no-conflicts-index-only \ --target-host=https://cluster-endpoint \ --client-options="use_ssl:true,basic_auth_user:'user',basic_auth_password:'password',verify_certs:false" ``` ### Additional Information I've ensured that the cluster is accessible from the EC2 instance from where the benchmark should be done and that the necessary configurations are in place. Any guidance or help on resolving this issue would be greatly appreciated. Thank you! ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [June 7, 2024, 12:18pm UTC](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031/2 "2024-06-07T12:18:44Z")
Welcome! It's because the version which runs there is a "modified" version of Elasticsearch. I guess you need to use an older version of Rally in that case, but I don't know which one. Did you look at [Cloud by Elastic](https://www.elastic.co/cloud), also available if needed from [AWS Marketplace](https://aws.amazon.com/marketplace/pp/Elasticsearch-Inc-Elasticsearch-Service-on-Elastic/B01N6YCISK)? Cloud by elastic is one way to have access to **all features** , all managed by us. Think about what is there yet like Vector Search, Security, Monitoring, Reporting, ES|QL, Canvas, Maps UI, Alerting and built-in solutions named [Observability](https://www.elastic.co/observability), [Security](https://www.elastic.co/security) and what is coming next 🙂 ... ---
**Author:** ![Peter\_Eskandar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/peter_eskandar/32/135115_2.png) [@Peter\_Eskandar](https://discuss.elastic.co/u/Peter_Eskandar)\ **Post date:** [June 7, 2024, 12:37pm UTC](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031/3 "2024-06-07T12:37:11Z")
Thanks for the prompt reply, I've tried with an older version "2.8.0" but in this case I'm recieving a different error message : ```auto ________ / __\____ _/ / /_ __ / /_/ / __ `/ / / / / / / _, _/ /_/ / / / /_/ / /_/ |_|\ __,_/_/_/\__ , / / ____ / [INFO] Race id is [b1acedb2-86aa-44ad-841e-7051d86093e4] [ERROR] Cannot race. Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/esrally/actor.py", line 92, in guard return f(self, msg, sender) File "/usr/local/lib/python3.9/site-packages/esrally/racecontrol.py", line 110, in receiveMsg_Setup self.coordinator.setup(sources=msg.sources) File "/usr/local/lib/python3.9/site-packages/esrally/racecontrol.py", line 186, in setup distribution_version = mechanic.cluster_distribution_version(self.cfg) File "/usr/local/lib/python3.9/site-packages/esrally/mechanic/mechanic.py", line 285, in cluster_distribution_version es = client_factory(hosts, client_options).create() File "/usr/local/lib/python3.9/site-packages/esrally/client/factory.py", line 181, in create from esrally.client.synchronous import RallySyncElasticsearch File "/usr/local/lib/python3.9/site-packages/esrally/client/synchronous.py", line 32, in from elasticsearch.compat import warn_stacklevel ImportError: cannot import name 'warn_stacklevel' from 'elasticsearch.compat' (/usr/local/lib/python3.9/site-packages/elasticsearch/compat.py) ``` ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [June 7, 2024, 12:59pm UTC](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031/4 "2024-06-07T12:59:15Z")
7.10.2 was released more than 3 years ago. January 14, 2021. So you need to find a version which is older than that I think. 2.0.0 might work. But, do not use a 7.10.2 version. It's outdated, unsafe... I'd at least upgrade to 7.17.21 or better to 8.14.0. So many things have changed since then... ---
**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\ **Post date:** [June 8, 2024, 2:10am UTC](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031/5 "2024-06-08T02:10:55Z")
> [@Peter\_Eskandar](#): > > I've tried with an older version "2.8.0" but in this case I'm recieving a different error message : There has never been an Elasticsearch version 2.8.0. I suspect you're using an entirely different product, possibly OpenSearch? OpenSearch and Elasticsearch have some common ancestry but they diverged many years ago and are now quite different. Rally is for benchmarking Elasticsearch, I doubt it'll work with any other systems. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [June 8, 2024, 2:10am UTC](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031/6 "2024-06-08T02:10:55Z")
OpenSearch/OpenDistro are AWS run products and differ from the original Elasticsearch and Kibana products that Elastic builds and maintains. You may need to contact them directly for further assistance. See [What is OpenSearch and the OpenSearch Dashboard? | Elastic](https://www.elastic.co/elasticsearch/opensearch) for more details. (This is an automated response from your friendly Elastic bot. Please report this post if you have any suggestions or concerns :elasticheart: ) ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [June 8, 2024, 2:03pm UTC](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031/7 "2024-06-08T14:03:55Z")
I guess he said Rally 2.8.0. 😉 ---
**Author:** ![Peter\_Eskandar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/peter_eskandar/32/135115_2.png) [@Peter\_Eskandar](https://discuss.elastic.co/u/Peter_Eskandar)\ **Post date:** [June 8, 2024, 4:52pm UTC](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031/8 "2024-06-08T16:52:39Z")
I was refering to the version of Rally we are trying to use ---
**Author:** ![Peter\_Eskandar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/peter_eskandar/32/135115_2.png) [@Peter\_Eskandar](https://discuss.elastic.co/u/Peter_Eskandar)\ **Post date:** [June 8, 2024, 5:04pm UTC](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031/9 "2024-06-08T17:04:46Z")
seems that AWS isn't supporting later versions than 7.10.0 of Elasticsearch ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [June 8, 2024, 5:33pm UTC](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031/10 "2024-06-08T17:33:14Z")
After version 7.10 the license changed and AWS can no longer offer Elasticsearch as a service. As this version is very old and no longer maintained I would recommend you upgrade to a newer version. Elastic offers Elasticsearch as a service on AWS through [Elastic Cloud](https://www.elastic.co/cloud). This supports all the latest features and versions. If you do not want to go down this way, AWS forked the version you are currently using and created OpenSearch for their search service. As David stated it has developed separately from Elasticsearch and now has it's own ecosystem and client libraries. ---
**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\ **Post date:** [June 8, 2024, 7:41pm UTC](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031/11 "2024-06-08T19:41:54Z")
> [@Peter\_Eskandar](#): > > I was refering to the version of Rally we are trying to use Apologies, TIL that both Rally and OpenSearch have pretty much the same version numbers right now 🙂 That said, even the service that AWS call "Elasticsearch 7.10" is not really Elasticsearch - the divergence between Elasticsearch and AWS's offering started before that point. But yeah echoing what Christian and DavidP say: 7.10 is _really_ old now, Elasticsearch has moved on a long way since then and our only real recommendation is to upgrade to a supported version ASAP. ---
**Author:** ![Peter\_Eskandar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/peter_eskandar/32/135115_2.png) [@Peter\_Eskandar](https://discuss.elastic.co/u/Peter_Eskandar)\ **Post date:** [June 9, 2024, 6:13pm UTC](https://discuss.elastic.co/t/error-benchmarking-aws-managed-elasticsearch-cluster-version-7-10-using-esrally/361031/12 "2024-06-09T18:13:17Z")
Thank you all for your valuable answers. I appreciate your help and insights!