# How to limit the dataset size of elastic/security ESRally track

**URL:** https://discuss.elastic.co/t/how-to-limit-the-dataset-size-of-elastic-security-esrally-track/348281
**Category:** Elasticsearch
**Tags:** rally
**Created:** [November 30, 2023, 1:01am UTC](https://discuss.elastic.co/t/how-to-limit-the-dataset-size-of-elastic-security-esrally-track/348281 "2023-11-30T01:01:05Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![VidR](https://avatars.discourse-cdn.com/v4/letter/v/c77e96/32.png) [@VidR](https://discuss.elastic.co/u/VidR)
#### Post date: [November 30, 2023, 1:01am UTC](https://discuss.elastic.co/t/how-to-limit-the-dataset-size-of-elastic-security-esrally-track/348281/1 "2023-11-30T01:01:05Z")

</div>

I am running esrally elastic/security track on ESRally version 2.7.0.  
By default, it downloads the following datasets, with total size of 128GB. but I only need ~30-50GB input dataset size.

```auto
rally@benchmark-bqfd7:~/.rally/benchmarks/data$ du -h
21G ./elastic/security/filebeat-security
32G ./elastic/security/packetbeat-security
33G ./elastic/security/auditbeat-security
11G ./elastic/security/winlogbeat-security
130M ./elastic/security/generated/99cd64d93e95084bb8bc7eea08cc1dbf
130M ./elastic/security/generated
32G ./elastic/security/metricbeat-security
128G ./elastic/security
128G ./elastic
128G .

```

command used:

```auto
esrally race --track=elastic/security --track-params="wait_for_status:yellow,number_of_shards:2,number_of_replicas:0,max_generated_corpus_size:100MB" --pipeline=benchmark-only --target-hosts=https://es-master:9200 --challenge=security-indexing-querying --client-options=basic_auth_user:rally,basic_auth_password:changeme,timeout:240,use_ssl:true,verify_certs:false,ca_certs:/rally/cacert.pem --report-format=csv --kill-running-processes

```

I also tried the following track\_params, but still downloaded data size remains the same.  
max\_total\_download\_gb:1  
max\_generated\_corpus\_size:1GB  
force\_data\_generation:true

Thanks in advance!

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [December 28, 2023, 1:01am UTC](https://discuss.elastic.co/t/how-to-limit-the-dataset-size-of-elastic-security-esrally-track/348281/2 "2023-12-28T01:01:35Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.