# Bulk-update challenge tuning

**URL:** <https://discuss.elastic.co/t/bulk-update-challenge-tuning/255686>\
**Category:** Elasticsearch\
**Tags:** rally\
**Created:** [November 17, 2020, 12:16pm UTC](https://discuss.elastic.co/t/bulk-update-challenge-tuning/255686 "2020-11-17T12:16:11Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Oleg\_Ruchovets](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/oleg_ruchovets/32/60137_2.png) [@Oleg\_Ruchovets](https://discuss.elastic.co/u/Oleg_Ruchovets)\
**Post date:** [November 17, 2020, 12:16pm UTC](https://discuss.elastic.co/t/bulk-update-challenge-tuning/255686/1 "2020-11-17T12:16:11Z")

</div>

Hello, I run the bulk-update challenge:

**esrally --pipeline=benchmark-only --track=eventdata --track-repository=eventdata --challenge=bulk-update --track-params=bulk\_size:10000,bulk\_indexing\_clients:64 --target-hosts=10.145.14.241:9200 --client-options="timeout:240" --kill-running-processes**

we are quite happy with the results however tests run 7 days. Data is stored in elastic.  
Questions:  
1. having data populated into elastic, will it be possible to reduce the time execution for 6 hours or 1 day and got the performance of the last day load. I know to control the number of cycles in bulk-update.json

1. from the execution It shows the 1 phase is most operations are writes but the majority of the load comes from the reads. I tried to find how it works in the code but it is not clear to me where the switch from write to read is happening.  
[https://github.com/elastic/rally-eventdata-track/blob/master/eventdata/parameter\_sources/elasticlogs\_bulk\_source.py](https://github.com/elastic/rally-eventdata-track/blob/master/eventdata/parameter_sources/elasticlogs_bulk_source.py)

1. Also it looks like the rally client executions are adapted based on response time. In my case rally machine has 64 CPUs and utilization up to 10%, and it is around 130 MB per / second how can I accelerate thruput from rally client

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/5/d/5d4c7d31aa278063d36637dce7c7c6fd42148a09.png)

---

<div class="post-metadata">

**Author:** ![Oleg\_Ruchovets](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/oleg_ruchovets/32/60137_2.png) [@Oleg\_Ruchovets](https://discuss.elastic.co/u/Oleg_Ruchovets)\
**Post date:** [November 18, 2020, 8:35pm UTC](https://discuss.elastic.co/t/bulk-update-challenge-tuning/255686/2 "2020-11-18T20:35:47Z")

</div>

Can you guys please answer the question. It is required knowledge of some framework internals and it would really speed up our research.

Thanks in advance.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 19, 2020, 1:43am UTC](https://discuss.elastic.co/t/bulk-update-challenge-tuning/255686/3 "2020-11-19T01:43:55Z")

</div>

Please be patient in waiting for responses to your question and refrain from pinging multiple times asking for a response or opening multiple topics for the same question. This is a community forum, it may take time for someone to reply to your question. For more information please refer to the [Community Code of Conduct](https://www.elastic.co/community/codeofconduct) specifically the section "Be patient". Also, please refrain from pinging folks directly, this is a forum and anyone that participates might be able to assist you.

If you are in need of a service with an SLA that covers response times for questions then you may want to consider talking to us about a [subscription](https://www.elastic.co/subscriptions).

It's fine to answer on your own thread after 2 or 3 days (not including weekends) if you don't have an answer.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 17, 2020, 1:44am UTC](https://discuss.elastic.co/t/bulk-update-challenge-tuning/255686/4 "2020-12-17T01:44:09Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
