# Parallel Iterations of Bulk

**URL:** <https://discuss.elastic.co/t/parallel-iterations-of-bulk/202271>\
**Category:** Elasticsearch\
**Tags:** rally\
**Created:** [October 4, 2019, 3:11am UTC](https://discuss.elastic.co/t/parallel-iterations-of-bulk/202271 "2019-10-04T03:11:59Z")\
**Posts on this page:** 1\
**Showing post:** 5

<div class="post-metadata">

**Author:** ![dliappis](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dliappis/32/56174_2.png) [@dliappis](https://discuss.elastic.co/u/dliappis)\
**Post date:** [October 15, 2019, 7:14am UTC](https://discuss.elastic.co/t/parallel-iterations-of-bulk/202271/5 "2019-10-15T07:14:34Z")

</div>

> [@David\_Samokovlisky](#):
>
> A question for the jinja solution, when I duplicate the same file, Is there any lag\delay between each time it reads the same file again? because continuity is very important for my testings, This way I can save a lot of disc space

When you use a Jinja2 for loop there will be the same (small) delay between tasks to the delay you see between executing explicitly defined operations in a regular track.

> [@David\_Samokovlisky](#):
>
> if I set for each operation a `target-throughput` , will it slow down the whole thing? because it's a log of timers\sleeps concurrently across 10+ operations and each operation with multiple clients

Tasks inside the `parallel` element can have their own independent `clients` and `target-throughput` and are independent. There is a large number of examples about the parallel element in [this part of the documentation](https://esrally.readthedocs.io/en/stable/track.html#running-tasks-in-parallel) that I suggest you take a look at.

> [@David\_Samokovlisky](#):
>
> I have tried playing with the `target-throughput` , and it seem to be connected\related to `bulk-size` , I've tried setting the `target-throughput` to either `1` `1000` and not use it at all, and the `Median Throughput` stays the same, for a parallel 1 bulk operation, with just 1 client.

This sounds normal. `target-throughput` is not a property that will "accelerate" the execution of bulk by automatically increasing clients; if you've specified 1 client, it will stick to that to achieve the specified `target-throughput` with 1 client. If `target-throughput` is smaller that what 1 client can achieve, Rally will pause the schedule as required to honor this, but it won't automatically increase clients to achieve larger throughputs. You need to scale the number of clients/bulk size yourself (and read up on [sizing Elasticsearch](https://discuss.elastic.co/t/elasticsearch-best-practice-sizing/150782/2)) if the target-throughput can't be achieved.

---

_[View the full topic](https://discuss.elastic.co/t/parallel-iterations-of-bulk/202271)._
