# Create simulated data for ingestion using Rally **URL:** \ **Category:** Elasticsearch\ **Tags:** rally\ **Created:** [June 28, 2022, 7:11pm UTC](https://discuss.elastic.co/t/create-simulated-data-for-ingestion-using-rally/308392 "2022-06-28T19:11:13Z")\ **Posts on this page:** 10\ **Page:** 1
**Author:** ![lance.zukel](https://avatars.discourse-cdn.com/v4/letter/l/dbc845/32.png) [@lance.zukel](https://discuss.elastic.co/u/lance.zukel)\ **Post date:** [June 28, 2022, 7:11pm UTC](https://discuss.elastic.co/t/create-simulated-data-for-ingestion-using-rally/308392/1 "2022-06-28T19:11:13Z")
I would like to be able to perform the following: 1. Have a sample templated document for ingestion 2. Have a custom class that randomizes data to be inserted into the templated document 3. Be able to specify the number of documents to be generated and ingested into elasticsearch 4. Not use static files for ingestion Any tips/hints/help on being able to perform the above? ---
**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\ **Post date:** [June 28, 2022, 10:53pm UTC](https://discuss.elastic.co/t/create-simulated-data-for-ingestion-using-rally/308392/2 "2022-06-28T22:53:42Z")
Hi @lance.zukel Did you look at this > **[GitHub - elastic/makelogs: Simple script that generates sample logs for...](https://github.com/elastic/makelogs)** > > Simple script that generates sample logs for testing kibana - GitHub - elastic/makelogs: Simple script that generates sample logs for testing kibana Or this > **[Generator input plugin | Logstash Reference \[8.3\] | Elastic](https://www.elastic.co/guide/en/logstash/current/plugins-inputs-generator.html)** ---
**Author:** ![lance.zukel](https://avatars.discourse-cdn.com/v4/letter/l/dbc845/32.png) [@lance.zukel](https://discuss.elastic.co/u/lance.zukel)\ **Post date:** [June 29, 2022, 1:58pm UTC](https://discuss.elastic.co/t/create-simulated-data-for-ingestion-using-rally/308392/3 "2022-06-29T13:58:20Z")
Was hoping to utilize rally to perform this. We are looking to benchmark ingestion, keyword vs text types effects on different fields, and generate enough data into our dev cluster to more accurately simulate the data in our prod cluster. ---
**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\ **Post date:** [June 29, 2022, 2:38pm UTC](https://discuss.elastic.co/t/create-simulated-data-for-ingestion-using-rally/308392/4 "2022-06-29T14:38:30Z")
@lance.zukel Oh Welcome to the community... If you specifically want to use Rally I would open a Topic with Rally in the Subject line (or edit this one), there are folks that know about Rally (not me 🙂 ) Your current subject wont bring the Rally folks 🙂 ---
**Author:** ![lance.zukel](https://avatars.discourse-cdn.com/v4/letter/l/dbc845/32.png) [@lance.zukel](https://discuss.elastic.co/u/lance.zukel)\ **Post date:** [June 29, 2022, 2:49pm UTC](https://discuss.elastic.co/t/create-simulated-data-for-ingestion-using-rally/308392/5 "2022-06-29T14:49:49Z")
I guess I figured the rally tag would suffice, I have modified the title of my post... Thank you ---
**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\ **Post date:** [June 29, 2022, 2:53pm UTC](https://discuss.elastic.co/t/create-simulated-data-for-ingestion-using-rally/308392/6 "2022-06-29T14:53:30Z")
Didn't even notice it.. 🙂 Perhaps someone will... Good Subject Lines get noticed... just my experience. ---
**Author:** ![Quentin\_Pradet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/quentin_pradet/32/94192_2.png) [@Quentin\_Pradet](https://discuss.elastic.co/u/Quentin_Pradet)\ **Post date:** [June 30, 2022, 12:50pm UTC](https://discuss.elastic.co/t/create-simulated-data-for-ingestion-using-rally/308392/7 "2022-06-30T12:50:05Z")
Oh as a Rally developer I noticed (the tag is indeed enough) but we don't have any tool to generate data in Rally itself, Rally only works with data that is already generated. Can you write a script to generate the data you need? ---
**Author:** ![lance.zukel](https://avatars.discourse-cdn.com/v4/letter/l/dbc845/32.png) [@lance.zukel](https://discuss.elastic.co/u/lance.zukel)\ **Post date:** [June 30, 2022, 2:54pm UTC](https://discuss.elastic.co/t/create-simulated-data-for-ingestion-using-rally/308392/8 "2022-06-30T14:54:36Z")
This would be a great feature to have in rally. I think it would be very helpful for users to be able to specify a document template, some array of random/pseudo random values, and the number of documents to be generated. This would allow simulation/benchmarking of documents/fields that are specific to a particular deployment, thus better replicating actual workloads. ---
**Author:** ![Andrea\_Spacca](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrea_spacca/32/76976_2.png) [@Andrea\_Spacca](https://discuss.elastic.co/u/Andrea_Spacca)\ **Post date:** [July 7, 2022, 3:14am UTC](https://discuss.elastic.co/t/create-simulated-data-for-ingestion-using-rally/308392/9 "2022-07-07T03:14:53Z")
hello @lance.zukel > [@lance.zukel](#): > > I think it would be very helpful for users to be able to specify a document template, some array of random/pseudo random values, and the number of documents to be generated. you can take a look at [GitHub - elastic/elastic-integration-corpus-generator-tool: Command line tool used for generating events corpus dynamically given a specific integration](https://github.com/elastic/elastic-integration-corpus-generator-tool) it's limited to integration packages and I'm not sure it is your use case ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [August 4, 2022, 3:15am UTC](https://discuss.elastic.co/t/create-simulated-data-for-ingestion-using-rally/308392/10 "2022-08-04T03:15:06Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.