# How to send same eventdata track 1billion json documnets to multiple ES instances

**URL:** <https://discuss.elastic.co/t/how-to-send-same-eventdata-track-1billion-json-documnets-to-multiple-es-instances/215667>\
**Category:** Elasticsearch\
**Tags:** rally\
**Created:** [January 20, 2020, 5:54am UTC](https://discuss.elastic.co/t/how-to-send-same-eventdata-track-1billion-json-documnets-to-multiple-es-instances/215667 "2020-01-20T05:54:24Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![suvarna](https://avatars.discourse-cdn.com/v4/letter/s/51bf81/32.png) [@suvarna](https://discuss.elastic.co/u/suvarna)\
**Post date:** [January 20, 2020, 5:54am UTC](https://discuss.elastic.co/t/how-to-send-same-eventdata-track-1billion-json-documnets-to-multiple-es-instances/215667/1 "2020-01-20T05:54:24Z")

</div>

Hi ,

I have configured 4 ES instances independently in single server by providing unique values (for each ES instances) for below commands in Elasticsearch.yml.

- http.port
- transport.tcp.port
- path\_data
- path\_logs
- path\_pid
- node.name
- cluster.name

Successfully 4 ES instances are running in my server with different ports.

I have started the Esrally with below commands

esrally --track=eventdata --track-repository=eventdata --pipeline=benchmark-only --challenge=elasticlogs-1bn-load --track-params="/home/ssuvarna/parameter\_custom\_evendata.json" --target-hosts="target\_host.json" --report-file=/home/ssuvarna/report.md --report-format=csv &

target\_host.json:

{  
"default": [  
{"host": "127.0,0,1", "port": 9200},  
{"host": "127.0,0,1", "port": 9202},  
{"host": "127.0,0,1", "port": 9203},  
{"host": "127.0,0,1", "port": 9204}  
]  
}

Currently Esrally sending json documents to each ES instances .. and please find the below issue:

1)We are expecting Esrally to send 1Billion Json documents to each ES instances but we can see its sending "250,000,000" json documents to each ES instances (it means 1Billion/4 ES instance="250,000,000" json docs).  
2)Each ES instances should have indices name as "elasticlogs\_q-000001" but only one ES instance will have indices name as "elasticlogs\_q-000001" and rest of 3 ES instances will have indices name as "elasticlogs\_q\_write"

Can you please let me know what changes I have to do on esrally to get the expected behavior ..

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [January 20, 2020, 6:09am UTC](https://discuss.elastic.co/t/how-to-send-same-eventdata-track-1billion-json-documnets-to-multiple-es-instances/215667/2 "2020-01-20T06:09:00Z")

</div>

Rally expects to work with a cluster and will distribute the load across the nodes you list. I do not believe you can get it to send the same load to multiple clusters during a single run.

---

<div class="post-metadata">

**Author:** ![suvarna](https://avatars.discourse-cdn.com/v4/letter/s/51bf81/32.png) [@suvarna](https://discuss.elastic.co/u/suvarna)\
**Post date:** [January 20, 2020, 11:04am UTC](https://discuss.elastic.co/t/how-to-send-same-eventdata-track-1billion-json-documnets-to-multiple-es-instances/215667/3 "2020-01-20T11:04:52Z")

</div>

Thanks a lot for info ..

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 17, 2020, 11:04am UTC](https://discuss.elastic.co/t/how-to-send-same-eventdata-track-1billion-json-documnets-to-multiple-es-instances/215667/4 "2020-02-17T11:04:55Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.