# Determining number of clients to achieve target-throughput

**URL:** <https://discuss.elastic.co/t/determining-number-of-clients-to-achieve-target-throughput/342634>\
**Category:** Elasticsearch\
**Tags:** rally\
**Created:** [September 8, 2023, 5:14pm UTC](https://discuss.elastic.co/t/determining-number-of-clients-to-achieve-target-throughput/342634 "2023-09-08T17:14:49Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Dhineshkumar\_R](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dhineshkumar_r/32/122038_2.png) [@Dhineshkumar\_R](https://discuss.elastic.co/u/Dhineshkumar_R)\
**Post date:** [September 8, 2023, 5:14pm UTC](https://discuss.elastic.co/t/determining-number-of-clients-to-achieve-target-throughput/342634/1 "2023-09-08T17:14:49Z")

</div>

Continuing the discussion from [The number of clients in search operation](https://discuss.elastic.co/t/the-number-of-clients-in-search-operation/143255/9):

> [@The number of clients in search operation](https://discuss.elastic.co/t/the-number-of-clients-in-search-operation/143255/9):
>
> The number of clients depends on what you want to achieve; e.g. if you are benchmarking a 300ms SLA for your query responses under a load of 100 queries/s, you'll need at least 30 clients.

Hi Folks,

I found this thread on relationship between number of clients and target throughput.

@dliappis Can you help me understand how did you arrive at 30 clients?

Following are my questions

1. How are requests generated with set number of `clients` to achieve the set `target-throughput` ? Is the trigger/generation deterministic?
2. Is there a thumb rule that I can use to decide the number of clients based `target-throughput ` and expected `service-time `?
3. Do the `max_connections ` parameter of the python client play any role when triggering requests?
4. How to execute tests in [throughput-benchmarking](https://esrally.readthedocs.io/en/stable/faq.html#what-do-latency-and-service-time-mean-and-how-do-they-relate-to-the-took-field-that-elasticsearch-returns) mode? Will that give me the max. throughput my cluster can handle?

Thanks

---

<div class="post-metadata">

**Author:** ![dliappis](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dliappis/32/56174_2.png) [@dliappis](https://discuss.elastic.co/u/dliappis)\
**Post date:** [September 11, 2023, 12:34pm UTC](https://discuss.elastic.co/t/determining-number-of-clients-to-achieve-target-throughput/342634/2 "2023-09-11T12:34:48Z")

</div>

> [@Dhineshkumar\_R](#):
>
> @dliappis Can you help me understand how did you arrive at 30 clients?

Thank you for your interest. The [particular comment](https://discuss.elastic.co/t/the-number-of-clients-in-search-operation/143255/9) dates from Aug 2018, i.e. over 5 years ago, and as I am not actively involved in the specific area anymore, I'd suggest closing this topic and opening a new one in the (same) Rally category with your specific questions.

Thank you.  
Dimitris

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [September 11, 2023, 12:50pm UTC](https://discuss.elastic.co/t/determining-number-of-clients-to-achieve-target-throughput/342634/3 "2023-09-11T12:50:16Z")

</div>

Each client uses one connection and does not queue up requests. If we assume a latency per request of 300ms and no time wasted client side, each client/connection can handle 3.333 requests per second. In order to serve 100 requests per second at east 30 clients/connections are required (3.333 \* 30 = 100).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 9, 2023, 12:50pm UTC](https://discuss.elastic.co/t/determining-number-of-clients-to-achieve-target-throughput/342634/4 "2023-10-09T12:50:38Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
