# How to create and use data for indexing using Rally **URL:** \ **Category:** Elasticsearch\ **Tags:** rally\ **Created:** [March 5, 2020, 9:26pm UTC](https://discuss.elastic.co/t/how-to-create-and-use-data-for-indexing-using-rally/222376 "2020-03-05T21:26:39Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![Abhimanyu\_Garg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/abhimanyu_garg/32/61154_2.png) [@Abhimanyu\_Garg](https://discuss.elastic.co/u/Abhimanyu_Garg)\ **Post date:** [March 5, 2020, 9:26pm UTC](https://discuss.elastic.co/t/how-to-create-and-use-data-for-indexing-using-rally/222376/1 "2020-03-05T21:26:40Z")
We are using Rally to do performance benchmarking on our ELK stacks. For this we want to use our own data (like apm events) to ingest to elastic and measure index performance. [https://github.com/elastic/apm-server/tree/master/rally](https://github.com/elastic/apm-server/tree/master/rally) has the dataset for apm but looks like it is old data (2 years old) and is not working for current versions of ES 7xx. How can we create our own data, compress it and use for indexing with Rally? Is there some documentation or guidelines listed that can help in this. Please share. Thanks ---
**Author:** ![dliappis](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dliappis/32/56174_2.png) [@dliappis](https://discuss.elastic.co/u/dliappis)\ **Post date:** [March 6, 2020, 9:07am UTC](https://discuss.elastic.co/t/how-to-create-and-use-data-for-indexing-using-rally/222376/2 "2020-03-06T09:07:14Z")
Hello, Thank you for your interest in Rally. Regarding creating your own custom track please take a look at: [https://esrally.readthedocs.io/en/stable/adding\_tracks.html#example-track](https://esrally.readthedocs.io/en/stable/adding_tracks.html#example-track) Regards, Dimitris ---
**Author:** ![Abhimanyu\_Garg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/abhimanyu_garg/32/61154_2.png) [@Abhimanyu\_Garg](https://discuss.elastic.co/u/Abhimanyu_Garg)\ **Post date:** [March 6, 2020, 6:56pm UTC](https://discuss.elastic.co/t/how-to-create-and-use-data-for-indexing-using-rally/222376/3 "2020-03-06T18:56:40Z")
Thank you but my query is regarding creation of dataset. How can i create dataset with my own indexes data like for apm events. Any pointers for that? Thanks ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [March 7, 2020, 8:19am UTC](https://discuss.elastic.co/t/how-to-create-and-use-data-for-indexing-using-rally/222376/4 "2020-03-07T08:19:35Z")
There are a few enhancement requests in this area e.g. making it easier for Rally to [use existing data for benchmarks](https://github.com/elastic/rally/issues/444) and to be able to [generate load based on the slowlog](https://github.com/elastic/rally/issues/262) (which can log most traffic if threshold is set low enough). Please add comments and a +1 if any of these approaches would work for you. As it stands now I do not think there is any official way to generate test data and track configuration for existing indices. ---
**Author:** ![dliappis](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dliappis/32/56174_2.png) [@dliappis](https://discuss.elastic.co/u/dliappis)\ **Post date:** [March 11, 2020, 2:23pm UTC](https://discuss.elastic.co/t/how-to-create-and-use-data-for-indexing-using-rally/222376/5 "2020-03-11T14:23:03Z")
[This PR](https://github.com/elastic/rally/pull/875) in particular is about a tool that will help generating a track from an existing ES cluster. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [April 8, 2020, 2:23pm UTC](https://discuss.elastic.co/t/how-to-create-and-use-data-for-indexing-using-rally/222376/6 "2020-04-08T14:23:12Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.