# Why Are Bulk Insertions Not Being Round Robined?

**URL:** <https://discuss.elastic.co/t/why-are-bulk-insertions-not-being-round-robined/207461>\
**Category:** Elasticsearch\
**Created:** [November 12, 2019, 8:14am UTC](https://discuss.elastic.co/t/why-are-bulk-insertions-not-being-round-robined/207461 "2019-11-12T08:14:14Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![thegrif](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thegrif/32/85515_2.png) [@thegrif](https://discuss.elastic.co/u/thegrif)\
**Post date:** [November 12, 2019, 8:14am UTC](https://discuss.elastic.co/t/why-are-bulk-insertions-not-being-round-robined/207461/1 "2019-11-12T08:14:14Z")

</div>

**This question is cross-posted from Amazon's Elasticsearch Forum.** ([link](https://forums.aws.amazon.com/thread.jspa?threadID=312662)) I'm unsure whether it's an Elasticsearch or an AWS issue - but would welcome any help/feedback this community can offer.

**Bulk indexing requests pointed at a AWS ES domain's VPC endpoint are not being round-robined to each of the data nodes for processing.** This can most obviously be seen by looking at the instance health dashboard: [https://imgur.com/a/wdhlkhk](https://imgur.com/a/wdhlkhk)

Domain settings:

- 5 r5.xlarge.elasticsearch nodes
- 1 AZ
- General Purpose SSD (60GB per node)
- Isolated in a private subnet

Full settings: [https://imgur.com/a/vFOrueC](https://imgur.com/a/vFOrueC)

_Background_

I have a process that uses the Elasticsearch Bulk API to load data. I am pointing the process at the Elasticsearch VPC endpoint. I assumed that there was a load balancer between this endpoint and the data nodes - but I am looking at the individual health of each instance and it's clear that **the indexing operations are only being handled by one of the nodes.**

Additional settings I have configured to accelerate indexing:

replicas: 0  
shards: 1  
index refresh interval: -1  
translog flush threshold size: 1024MB

Data Instance Health: [https://imgur.com/a/wdhlkhk](https://imgur.com/a/wdhlkhk)

Index Settings: [https://gist.github.com/thegrif/64c3d5f1b4465cf13d3ddeaee4d2b9a2](https://gist.github.com/thegrif/64c3d5f1b4465cf13d3ddeaee4d2b9a2)  
Overall Stats: [https://gist.github.com/thegrif/a43ff8fcfd83eca254d4f9a90dfb57d0](https://gist.github.com/thegrif/a43ff8fcfd83eca254d4f9a90dfb57d0)  
Node Info: [https://gist.github.com/thegrif/fa55e72f3e995bbb8ba44f3a2dc51a57](https://gist.github.com/thegrif/fa55e72f3e995bbb8ba44f3a2dc51a57)  
Node Stats: [https://gist.github.com/thegrif/acae53ffbfe7a6f154b175332779817f](https://gist.github.com/thegrif/acae53ffbfe7a6f154b175332779817f)

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 12, 2019, 9:37am UTC](https://discuss.elastic.co/t/why-are-bulk-insertions-not-being-round-robined/207461/2 "2019-11-12T09:37:29Z")

</div>

I don't think it's related to elasticsearch.

BTW did you look at [https://www.elastic.co/cloud](https://www.elastic.co/cloud) and [https://aws.amazon.com/marketplace/pp/B01N6YCISK](https://aws.amazon.com/marketplace/pp/B01N6YCISK) ?

Cloud by elastic is one way to have access to all features, all managed by us. Think about what is there yet like Security, Monitoring, Reporting, SQL, Canvas, APM, Logs UI, Infra UI, SIEM, Maps UI and what is coming next 🙂 ...

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 10, 2019, 9:37am UTC](https://discuss.elastic.co/t/why-are-bulk-insertions-not-being-round-robined/207461/3 "2019-12-10T09:37:29Z")

</div>

Closed on December 10, 2019, 9:37am UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.