# \[ERROR\] Cannot race. Worker \[22\] has exited prematurely

**URL:** <https://discuss.elastic.co/t/error-cannot-race-worker-22-has-exited-prematurely/325690>\
**Category:** Elasticsearch\
**Tags:** rally\
**Created:** [February 16, 2023, 7:09am UTC](https://discuss.elastic.co/t/error-cannot-race-worker-22-has-exited-prematurely/325690 "2023-02-16T07:09:42Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Utkarsh17](https://avatars.discourse-cdn.com/v4/letter/u/bc8723/32.png) [@Utkarsh17](https://discuss.elastic.co/u/Utkarsh17)\
**Post date:** [February 16, 2023, 7:09am UTC](https://discuss.elastic.co/t/error-cannot-race-worker-22-has-exited-prematurely/325690/1 "2023-02-16T07:09:42Z")

</div>

Hi,  
I am getting the error -------\>[ERROR] Cannot race. Worker [22] has exited prematurely.  
Following is setup and configuration

- Elastic Search ver 8.5.2
- ESRally ver 2.7.0
- 5 node Kubernetes cluster with 1 controller , 1 Rally benchmark pod, 1 Elasticsearch master pod , 2 Elasticsearch Data pods i.e 4 worker nodes.
- num of vcpus : ( Rally node - 128 vcpus, ES- Master 8 vcpus, ES data nodes - 8 vcpus)
- num of shards = 4
- Bulk size = 10,000
- Bulk indexing client = 128
- Translog flush = 4g
- codec = LZ4
- MAX MERGE COUNT = 4.

I am seeing this error for bulk indexing client =128 but for lower values of bulk indexing client like 8,16 or 32 not seeing this error.

Kindly some one help me with it.

```plaintext
nyc_taxis_params.json nyc_taxis https://es-master:9200 basic_auth_user:rally,basic_auth_password:changeme,timeout:240,use_rue,verify_certs:false,ca_certs:/rally/cacert.pem
4 0 100 20000 128 -1 append-no-conflicts-index-only

    ________
   / __\____ _/ / /_ __
  / /_/ / __ `/ / / / / /
 / _, _/ /_/ / / / /_/ /
/_/ |_|\ __,_/_/_/\__ , /
                / ____ /

[INFO] Decompressing track data from [/rally/.rally/benchmarks/data/nyc_taxis/documents.json.bz2] to [/rally/.rally/benchmarta/nyc_taxis/documents.json] (resulting size: [74.32] GB) ... [OK]
[INFO] Preparing file offset table for [/rally/.rally/benchmarks/data/nyc_taxis/documents.json] ... [OK]
[INFO] Race id is [6fe6cad6-1145-4d58-a307-07dd3e3adbfc]
[WARNING] Could not terminate all internal processes within timeout. Please check and force-terminate all Rally processes.
[ERROR] Cannot race. Worker [10] has exited prematurely.

Getting further help:
*********************
* Check the log files in /rally/.rally/logs for errors.
* Read the documentation at https://esrally.readthedocs.io/en/2.7.0/.
* Ask a question on the forum at https://discuss.elastic.co/tags/c/elastic-stack/elasticsearch/rally.
* Raise an issue at https://github.com/elastic/rally/issues and include the log files in /rally/.rally/logs.

---------------------------------
[INFO] FAILURE (took 215 seconds)
---------------------------------

```

---

<div class="post-metadata">

**Author:** ![Evgenia\_Badiyanova](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/evgenia_badiyanova/32/84068_2.png) [@Evgenia\_Badiyanova](https://discuss.elastic.co/u/Evgenia_Badiyanova)\
**Post date:** [February 21, 2023, 9:40pm UTC](https://discuss.elastic.co/t/error-cannot-race-worker-22-has-exited-prematurely/325690/2 "2023-02-21T21:40:35Z")

</div>

@Utkarsh17 Hello! Thank you for using Rally.

It looks like there could possibly be processes leftover from another Rally run on your system. Can you try executing Rally with [--kill-running-processes](https://esrally.readthedocs.io/en/stable/command_line_reference.html#kill-running-processes)? The [--test-mode](https://esrally.readthedocs.io/en/stable/command_line_reference.html#test-mode) flag also can be used for fast iteration and troubleshooting.

If you have further questions, could you please include the full rally.log?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 21, 2023, 9:41pm UTC](https://discuss.elastic.co/t/error-cannot-race-worker-22-has-exited-prematurely/325690/3 "2023-03-21T21:41:34Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
