# Is there a configuration in esrally to replicate the track data X times or run index-append for a specific period of time?

**URL:** <https://discuss.elastic.co/t/is-there-a-configuration-in-esrally-to-replicate-the-track-data-x-times-or-run-index-append-for-a-specific-period-of-time/186999>\
**Category:** Elasticsearch\
**Tags:** rally\
**Created:** [June 23, 2019, 9:27am UTC](https://discuss.elastic.co/t/is-there-a-configuration-in-esrally-to-replicate-the-track-data-x-times-or-run-index-append-for-a-specific-period-of-time/186999 "2019-06-23T09:27:58Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ali\_Reza\_Haghighat](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ali_reza_haghighat/32/48590_2.png) [@Ali\_Reza\_Haghighat](https://discuss.elastic.co/u/Ali_Reza_Haghighat)\
**Post date:** [June 23, 2019, 9:27am UTC](https://discuss.elastic.co/t/is-there-a-configuration-in-esrally-to-replicate-the-track-data-x-times-or-run-index-append-for-a-specific-period-of-time/186999/1 "2019-06-23T09:27:58Z")

</div>

Hello,  
I'm a newbie to elastic and esrally. I'm using esrally to benchmark our elastic cluster. Currently, I want to measure the index-append rate of our cluster using our sample data. With the default configuration, the esrally send the track data only one time which last for a few minutes, however, I want to run the test for a few hours to test the stability of our cluster. I cannot create a very large track data for such a test. I need an input parameter for esrally which specifies the numbers of replication of the track data or specifies the time of index-appending.

Thank you for your help!

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [June 23, 2019, 9:51am UTC](https://discuss.elastic.co/t/is-there-a-configuration-in-esrally-to-replicate-the-track-data-x-times-or-run-index-append-for-a-specific-period-of-time/186999/2 "2019-06-23T09:51:11Z")

</div>

You should be able to use the [laps parameter](https://esrally.readthedocs.io/en/1.2.1/command_line_reference.html#laps) to run the track multiple times in a row.

---

<div class="post-metadata">

**Author:** ![Ali\_Reza\_Haghighat](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ali_reza_haghighat/32/48590_2.png) [@Ali\_Reza\_Haghighat](https://discuss.elastic.co/u/Ali_Reza_Haghighat)\
**Post date:** [June 23, 2019, 10:02am UTC](https://discuss.elastic.co/t/is-there-a-configuration-in-esrally-to-replicate-the-track-data-x-times-or-run-index-append-for-a-specific-period-of-time/186999/3 "2019-06-23T10:02:34Z")

</div>

Thank you!  
Using laps parameter there is a pause between each test. I know the pause time is quite small, but is there a way to have no pause between tests?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [June 23, 2019, 10:24am UTC](https://discuss.elastic.co/t/is-there-a-configuration-in-esrally-to-replicate-the-track-data-x-times-or-run-index-append-for-a-specific-period-of-time/186999/4 "2019-06-23T10:24:49Z")

</div>

Then you probably need to modify the structure of the track. Am not sure exactly how to best do that if you have a single file you want to repeatedly replay.

It would be useful to have a parameter source that is able to generate infinite amounts of data based on sample files and I created [an issue for this](https://github.com/elastic/rally/issues/294) some time back. Please add comments and/or a +1 to this.

---

<div class="post-metadata">

**Author:** ![Ali\_Reza\_Haghighat](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ali_reza_haghighat/32/48590_2.png) [@Ali\_Reza\_Haghighat](https://discuss.elastic.co/u/Ali_Reza_Haghighat)\
**Post date:** [June 23, 2019, 10:42am UTC](https://discuss.elastic.co/t/is-there-a-configuration-in-esrally-to-replicate-the-track-data-x-times-or-run-index-append-for-a-specific-period-of-time/186999/5 "2019-06-23T10:42:19Z")

</div>

I have thumb up the issue. I hope that this feature will be added soon!

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [June 23, 2019, 10:59am UTC](https://discuss.elastic.co/t/is-there-a-configuration-in-esrally-to-replicate-the-track-data-x-times-or-run-index-append-for-a-specific-period-of-time/186999/6 "2019-06-23T10:59:28Z")

</div>

Yes, I think it is a feature that would make it a lot easier to work with Rally for a lot of people.

---

<div class="post-metadata">

**Author:** ![dliappis](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dliappis/32/56174_2.png) [@dliappis](https://discuss.elastic.co/u/dliappis)\
**Post date:** [June 24, 2019, 7:38am UTC](https://discuss.elastic.co/t/is-there-a-configuration-in-esrally-to-replicate-the-track-data-x-times-or-run-index-append-for-a-specific-period-of-time/186999/7 "2019-06-24T07:38:03Z")

</div>

One alternative approach is described in [this comment](https://discuss.elastic.co/t/increase-data-size-in-rally-existing-tracks/116514/2) using jinja2 loops. One catch is that to do that it uses multiple indices, but in many cases (depending on the size of the corpus) this could be a realistic scenario.

---

<div class="post-metadata">

**Author:** ![Ali\_Reza\_Haghighat](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ali_reza_haghighat/32/48590_2.png) [@Ali\_Reza\_Haghighat](https://discuss.elastic.co/u/Ali_Reza_Haghighat)\
**Post date:** [June 24, 2019, 8:04am UTC](https://discuss.elastic.co/t/is-there-a-configuration-in-esrally-to-replicate-the-track-data-x-times-or-run-index-append-for-a-specific-period-of-time/186999/8 "2019-06-24T08:04:20Z")

</div>

Yes, it is very similar to what I need. Thank you!

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 22, 2019, 8:04am UTC](https://discuss.elastic.co/t/is-there-a-configuration-in-esrally-to-replicate-the-track-data-x-times-or-run-index-append-for-a-specific-period-of-time/186999/9 "2019-07-22T08:04:20Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
